Meta-analysis in a digitalized world: A step-by-step primer
Behav Res Methods. 2024 Apr 4. doi: 10.3758/s13428-024-02374-8. Online ahead of print.ABSTRACTIn recent years, much research and many data sources have become digital. Some advantages of digital or Internet-based research, compared to traditional lab research (e.g., comprehensive data collection and storage, availability of data) are ideal for an improved meta-analyses approach.In the meantime, in meta-analyses research, different types of meta-analyses have been developed to provide research syntheses with accurate quantitative estimations. Due to its rich and unique palette of corrections, we recommend to using the Schmi...
Source: Behavior Research Methods - April 4, 2024 Category: Psychiatry & Psychology Authors: Esther Kaufmann Ulf-Dietrich Reips Source Type: research
OpenWMB: An open-source and automated working memory task battery for OpenSesame
This study also tried to contribute to the ongoing debate regarding the best method to assess WMC. We computed a permutation analysis to compare the amount of variance shared between a fluid intelligence factor and (1) each WM task, (2) homogenous WMC factors (based on multiple tasks from the same paradigm), and (3) heterogeneous WMC factors (derived from triplets of tasks from different paradigms). Our results suggested that heterogeneous factors provided the best estimates of WMC.PMID:38575775 | DOI:10.3758/s13428-024-02397-1 (Source: Behavior Research Methods)
Source: Behavior Research Methods - April 4, 2024 Category: Psychiatry & Psychology Authors: F ábio Monteiro Let ícia Botan Nascimento Jos é Leitão Eduardo J R Santos Paulo Rodrigues Isabel M Santos F átima Simões Carla S Nascimento Source Type: research
A systematic evaluation of text mining methods for short texts: Mapping individuals' internal states from online posts
Behav Res Methods. 2024 Apr 4. doi: 10.3758/s13428-024-02381-9. Online ahead of print.ABSTRACTShort texts generated by individuals in online environments can provide social and behavioral scientists with rich insights into these individuals' internal states. Trained manual coders can reliably interpret expressions of such internal states in text. However, manual coding imposes restrictions on the number of texts that can be analyzed, limiting our ability to extract insights from large-scale textual data. We evaluate the performance of several automatic text analysis methods in approximating trained human coders' evaluation...
Source: Behavior Research Methods - April 4, 2024 Category: Psychiatry & Psychology Authors: Ana Macanovic Wojtek Przepiorka Source Type: research
Meta-analysis in a digitalized world: A step-by-step primer
Behav Res Methods. 2024 Apr 4. doi: 10.3758/s13428-024-02374-8. Online ahead of print.ABSTRACTIn recent years, much research and many data sources have become digital. Some advantages of digital or Internet-based research, compared to traditional lab research (e.g., comprehensive data collection and storage, availability of data) are ideal for an improved meta-analyses approach.In the meantime, in meta-analyses research, different types of meta-analyses have been developed to provide research syntheses with accurate quantitative estimations. Due to its rich and unique palette of corrections, we recommend to using the Schmi...
Source: Behavior Research Methods - April 4, 2024 Category: Psychiatry & Psychology Authors: Esther Kaufmann Ulf-Dietrich Reips Source Type: research
OpenWMB: An open-source and automated working memory task battery for OpenSesame
This study also tried to contribute to the ongoing debate regarding the best method to assess WMC. We computed a permutation analysis to compare the amount of variance shared between a fluid intelligence factor and (1) each WM task, (2) homogenous WMC factors (based on multiple tasks from the same paradigm), and (3) heterogeneous WMC factors (derived from triplets of tasks from different paradigms). Our results suggested that heterogeneous factors provided the best estimates of WMC.PMID:38575775 | DOI:10.3758/s13428-024-02397-1 (Source: Behavior Research Methods)
Source: Behavior Research Methods - April 4, 2024 Category: Psychiatry & Psychology Authors: F ábio Monteiro Let ícia Botan Nascimento Jos é Leitão Eduardo J R Santos Paulo Rodrigues Isabel M Santos F átima Simões Carla S Nascimento Source Type: research
A systematic evaluation of text mining methods for short texts: Mapping individuals' internal states from online posts
Behav Res Methods. 2024 Apr 4. doi: 10.3758/s13428-024-02381-9. Online ahead of print.ABSTRACTShort texts generated by individuals in online environments can provide social and behavioral scientists with rich insights into these individuals' internal states. Trained manual coders can reliably interpret expressions of such internal states in text. However, manual coding imposes restrictions on the number of texts that can be analyzed, limiting our ability to extract insights from large-scale textual data. We evaluate the performance of several automatic text analysis methods in approximating trained human coders' evaluation...
Source: Behavior Research Methods - April 4, 2024 Category: Psychiatry & Psychology Authors: Ana Macanovic Wojtek Przepiorka Source Type: research
Examining the performance of the chi-square difference test when the unrestricted model is slightly misspecified
Behav Res Methods. 2024 Apr 2. doi: 10.3758/s13428-024-02384-6. Online ahead of print.ABSTRACTStructural equation models are used to model the relationships between latent constructs and observable behaviors such as survey responses. Researchers are often interested in testing nested models to determine whether additional constraints that create a more parsimonious model are also supported by the data. A popular statistical tool for nested model comparison is the chi-square difference test. However, there is some evidence that this test performs suboptimally when the unrestricted model is misspecified. In this paper, we ex...
Source: Behavior Research Methods - April 2, 2024 Category: Psychiatry & Psychology Authors: Dunigan Folk Victoria Savalei Source Type: research
Examining the performance of the chi-square difference test when the unrestricted model is slightly misspecified
Behav Res Methods. 2024 Apr 2. doi: 10.3758/s13428-024-02384-6. Online ahead of print.ABSTRACTStructural equation models are used to model the relationships between latent constructs and observable behaviors such as survey responses. Researchers are often interested in testing nested models to determine whether additional constraints that create a more parsimonious model are also supported by the data. A popular statistical tool for nested model comparison is the chi-square difference test. However, there is some evidence that this test performs suboptimally when the unrestricted model is misspecified. In this paper, we ex...
Source: Behavior Research Methods - April 2, 2024 Category: Psychiatry & Psychology Authors: Dunigan Folk Victoria Savalei Source Type: research
Creating a Bot-tleneck for malicious AI: Psychological methods for bot detection
Behav Res Methods. 2024 Apr 1. doi: 10.3758/s13428-024-02357-9. Online ahead of print.ABSTRACTThe standard approach for detecting and preventing bots from doing harm online involves CAPTCHAs. However, recent AI research, including our own in this manuscript, suggests that bots can complete many common CAPTCHAs with ease. The most effective methodology for identifying potential bots involves completing image-processing, causal-reasoning based, free-response questions that are hand coded by human analysts. However, this approach is labor intensive, slow, and inefficient. Moreover, with the advent of Generative AI such as GPT...
Source: Behavior Research Methods - April 1, 2024 Category: Psychiatry & Psychology Authors: Christopher Rodriguez Daniel M Oppenheimer Source Type: research
Creating a Bot-tleneck for malicious AI: Psychological methods for bot detection
Behav Res Methods. 2024 Apr 1. doi: 10.3758/s13428-024-02357-9. Online ahead of print.ABSTRACTThe standard approach for detecting and preventing bots from doing harm online involves CAPTCHAs. However, recent AI research, including our own in this manuscript, suggests that bots can complete many common CAPTCHAs with ease. The most effective methodology for identifying potential bots involves completing image-processing, causal-reasoning based, free-response questions that are hand coded by human analysts. However, this approach is labor intensive, slow, and inefficient. Moreover, with the advent of Generative AI such as GPT...
Source: Behavior Research Methods - April 1, 2024 Category: Psychiatry & Psychology Authors: Christopher Rodriguez Daniel M Oppenheimer Source Type: research
Normative ratings for the Kitchen and Food Sounds (KFS) database
Behav Res Methods. 2024 Mar 28. doi: 10.3758/s13428-024-02402-7. Online ahead of print.ABSTRACTSounds are important sensory cues for food perception and acceptance. We developed and validated a large-scale database of kitchen and food sounds (180 stimuli) capturing different stages of preparing, cooking, serving, and/or consuming foods and beverages and sounds of packaging, kitchen utensils, and appliances. Each sound was evaluated across nine subjective evaluative dimensions (random order), including stimuli-related properties (e.g., valence, arousal) and food-related items (e.g., healthfulness, appetizingness) by a subsa...
Source: Behavior Research Methods - March 29, 2024 Category: Psychiatry & Psychology Authors: Mar ília Prada David Guedes Margarida Vaz Garrido Magda Saraiva Source Type: research
Normative ratings for the Kitchen and Food Sounds (KFS) database
Behav Res Methods. 2024 Mar 28. doi: 10.3758/s13428-024-02402-7. Online ahead of print.ABSTRACTSounds are important sensory cues for food perception and acceptance. We developed and validated a large-scale database of kitchen and food sounds (180 stimuli) capturing different stages of preparing, cooking, serving, and/or consuming foods and beverages and sounds of packaging, kitchen utensils, and appliances. Each sound was evaluated across nine subjective evaluative dimensions (random order), including stimuli-related properties (e.g., valence, arousal) and food-related items (e.g., healthfulness, appetizingness) by a subsa...
Source: Behavior Research Methods - March 29, 2024 Category: Psychiatry & Psychology Authors: Mar ília Prada David Guedes Margarida Vaz Garrido Magda Saraiva Source Type: research
Normative ratings for the Kitchen and Food Sounds (KFS) database
Behav Res Methods. 2024 Mar 28. doi: 10.3758/s13428-024-02402-7. Online ahead of print.ABSTRACTSounds are important sensory cues for food perception and acceptance. We developed and validated a large-scale database of kitchen and food sounds (180 stimuli) capturing different stages of preparing, cooking, serving, and/or consuming foods and beverages and sounds of packaging, kitchen utensils, and appliances. Each sound was evaluated across nine subjective evaluative dimensions (random order), including stimuli-related properties (e.g., valence, arousal) and food-related items (e.g., healthfulness, appetizingness) by a subsa...
Source: Behavior Research Methods - March 29, 2024 Category: Psychiatry & Psychology Authors: Mar ília Prada David Guedes Margarida Vaz Garrido Magda Saraiva Source Type: research
Normative ratings for the Kitchen and Food Sounds (KFS) database
Behav Res Methods. 2024 Mar 28. doi: 10.3758/s13428-024-02402-7. Online ahead of print.ABSTRACTSounds are important sensory cues for food perception and acceptance. We developed and validated a large-scale database of kitchen and food sounds (180 stimuli) capturing different stages of preparing, cooking, serving, and/or consuming foods and beverages and sounds of packaging, kitchen utensils, and appliances. Each sound was evaluated across nine subjective evaluative dimensions (random order), including stimuli-related properties (e.g., valence, arousal) and food-related items (e.g., healthfulness, appetizingness) by a subsa...
Source: Behavior Research Methods - March 29, 2024 Category: Psychiatry & Psychology Authors: Mar ília Prada David Guedes Margarida Vaz Garrido Magda Saraiva Source Type: research
Bayesian evidence synthesis as a flexible alternative to meta-analysis: A simulation study and empirical demonstration
In this study, we introduce Bayesian evidence synthesis and show through simulations when this method diverges from what would be expected in a meta-analysis to help researchers correctly interpret the synthesis results. As an empirical demonstration, we also apply Bayesian evidence synthesis to a published meta-analysis on statistical learning in people with and without developmental language disorder. We highlight the strengths and weaknesses of the proposed method and offer suggestions for future research.PMID:38532062 | DOI:10.3758/s13428-024-02350-2 (Source: Behavior Research Methods)
Source: Behavior Research Methods - March 27, 2024 Category: Psychiatry & Psychology Authors: Elise van Wonderen Mari ëlle Zondervan-Zwijnenburg Irene Klugkist Source Type: research
