The Efficiency of Question-Asking Strategies in a Real-World Visual Search Task
We present a method that leverages the recent development of powerful computational models to obtain the fine-grained annotation required to apply metrics and techniques from Cognitive Science to large datasets. Previous work in Cognitive Science has investigated the question-asking strategies of human participants by employing different variants of the so-called 20-question-game setting and proposing several evaluation methods. In our work, we focus on GuessWhat, a task proposed within the Computer Vision and Natural Language Processing communities that is similar in structure to the 20-question-game setting. Crucially, t...
Source: Cognitive Science - December 24, 2023 Category: Neuroscience Authors: Alberto Testoni Raffaella Bernardi Azzurra Ruggeri Source Type: research
Differences in Social Expectations About Robot Signals and Human Signals
Cogn Sci. 2023 Dec;47(12):e13393. doi: 10.1111/cogs.13393.ABSTRACTIn our daily lives, we are continually involved in decision-making situations, many of which take place in the context of social interaction. Despite the ubiquity of such situations, there remains a gap in our understanding of how decision-making unfolds in social contexts, and how communicative signals, such as social cues and feedback, impact the choices we make. Interestingly, there is a new social context to which humans are recently increasingly more frequently exposed-social interaction with not only other humans but also artificial agents, such as rob...
Source: Cognitive Science - December 22, 2023 Category: Neuroscience Authors: Lorenzo Parenti Marwen Belkaid Agnieszka Wykowska Source Type: research
Differences in Social Expectations About Robot Signals and Human Signals
Cogn Sci. 2023 Dec;47(12):e13393. doi: 10.1111/cogs.13393.ABSTRACTIn our daily lives, we are continually involved in decision-making situations, many of which take place in the context of social interaction. Despite the ubiquity of such situations, there remains a gap in our understanding of how decision-making unfolds in social contexts, and how communicative signals, such as social cues and feedback, impact the choices we make. Interestingly, there is a new social context to which humans are recently increasingly more frequently exposed-social interaction with not only other humans but also artificial agents, such as rob...
Source: Cognitive Science - December 22, 2023 Category: Neuroscience Authors: Lorenzo Parenti Marwen Belkaid Agnieszka Wykowska Source Type: research
Differences in Social Expectations About Robot Signals and Human Signals
Cogn Sci. 2023 Dec;47(12):e13393. doi: 10.1111/cogs.13393.ABSTRACTIn our daily lives, we are continually involved in decision-making situations, many of which take place in the context of social interaction. Despite the ubiquity of such situations, there remains a gap in our understanding of how decision-making unfolds in social contexts, and how communicative signals, such as social cues and feedback, impact the choices we make. Interestingly, there is a new social context to which humans are recently increasingly more frequently exposed-social interaction with not only other humans but also artificial agents, such as rob...
Source: Cognitive Science - December 22, 2023 Category: Neuroscience Authors: Lorenzo Parenti Marwen Belkaid Agnieszka Wykowska Source Type: research
Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings
Cogn Sci. 2023 Dec;47(12):e13388. doi: 10.1111/cogs.13388.ABSTRACTThe meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), a...
Source: Cognitive Science - December 16, 2023 Category: Neuroscience Authors: Andrea Bruera Yuan Tao Andrew Anderson Derya Çokal Janosch Haber Massimo Poesio Source Type: research
Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings
Cogn Sci. 2023 Dec;47(12):e13388. doi: 10.1111/cogs.13388.ABSTRACTThe meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), a...
Source: Cognitive Science - December 16, 2023 Category: Neuroscience Authors: Andrea Bruera Yuan Tao Andrew Anderson Derya Çokal Janosch Haber Massimo Poesio Source Type: research
Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings
Cogn Sci. 2023 Dec;47(12):e13388. doi: 10.1111/cogs.13388.ABSTRACTThe meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), a...
Source: Cognitive Science - December 16, 2023 Category: Neuroscience Authors: Andrea Bruera Yuan Tao Andrew Anderson Derya Çokal Janosch Haber Massimo Poesio Source Type: research
Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings
Cogn Sci. 2023 Dec;47(12):e13388. doi: 10.1111/cogs.13388.ABSTRACTThe meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), a...
Source: Cognitive Science - December 16, 2023 Category: Neuroscience Authors: Andrea Bruera Yuan Tao Andrew Anderson Derya Çokal Janosch Haber Massimo Poesio Source Type: research
The N400 is Elicited by Meaning Changes but not Synonym Substitutions: Evidence From Persian Phrasal Verbs
Cogn Sci. 2023 Dec;47(12):e13394. doi: 10.1111/cogs.13394.ABSTRACTWe tested two accounts of the cognitive process underlying the N400 event-related potential component: one that it reflects meaning-based processing and one that it reflects the processing of specific words. The experimental design utilized separable Persian phrasal verbs, which form a strongly probabilistic, long-distance dependency, ideal for the study of probabilistic processing. In sentences strongly constraining for a particular continuation, we show evidence that between two low-probability words, only the word that changed the expected meaning of the ...
Source: Cognitive Science - December 13, 2023 Category: Neuroscience Authors: Kate Stone Naghmeh Khaleghi Milena Rabovsky Source Type: research
The N400 is Elicited by Meaning Changes but not Synonym Substitutions: Evidence From Persian Phrasal Verbs
Cogn Sci. 2023 Dec;47(12):e13394. doi: 10.1111/cogs.13394.ABSTRACTWe tested two accounts of the cognitive process underlying the N400 event-related potential component: one that it reflects meaning-based processing and one that it reflects the processing of specific words. The experimental design utilized separable Persian phrasal verbs, which form a strongly probabilistic, long-distance dependency, ideal for the study of probabilistic processing. In sentences strongly constraining for a particular continuation, we show evidence that between two low-probability words, only the word that changed the expected meaning of the ...
Source: Cognitive Science - December 13, 2023 Category: Neuroscience Authors: Kate Stone Naghmeh Khaleghi Milena Rabovsky Source Type: research
The N400 is Elicited by Meaning Changes but not Synonym Substitutions: Evidence From Persian Phrasal Verbs
Cogn Sci. 2023 Dec;47(12):e13394. doi: 10.1111/cogs.13394.ABSTRACTWe tested two accounts of the cognitive process underlying the N400 event-related potential component: one that it reflects meaning-based processing and one that it reflects the processing of specific words. The experimental design utilized separable Persian phrasal verbs, which form a strongly probabilistic, long-distance dependency, ideal for the study of probabilistic processing. In sentences strongly constraining for a particular continuation, we show evidence that between two low-probability words, only the word that changed the expected meaning of the ...
Source: Cognitive Science - December 13, 2023 Category: Neuroscience Authors: Kate Stone Naghmeh Khaleghi Milena Rabovsky Source Type: research
The N400 is Elicited by Meaning Changes but not Synonym Substitutions: Evidence From Persian Phrasal Verbs
Cogn Sci. 2023 Dec;47(12):e13394. doi: 10.1111/cogs.13394.ABSTRACTWe tested two accounts of the cognitive process underlying the N400 event-related potential component: one that it reflects meaning-based processing and one that it reflects the processing of specific words. The experimental design utilized separable Persian phrasal verbs, which form a strongly probabilistic, long-distance dependency, ideal for the study of probabilistic processing. In sentences strongly constraining for a particular continuation, we show evidence that between two low-probability words, only the word that changed the expected meaning of the ...
Source: Cognitive Science - December 13, 2023 Category: Neuroscience Authors: Kate Stone Naghmeh Khaleghi Milena Rabovsky Source Type: research
Rational Sentence Interpretation in Mandarin Chinese
In this study, we test the noisy-channel model in Mandarin Chinese, a language taxonomically different from English. We present native Mandarin speakers sentences in a written modality (Experiment 1) and an auditory modality (Experiment 2) in three pairs of syntactic alternations. The critical materials are literally implausible but require differing numbers and types of edits in order to form more plausible sentences. Each sentence is followed by a comprehension question that allows us to infer whether the speakers interpreted the item literally, or made an inference toward a more likely meaning. Similar to previous resea...
Source: Cognitive Science - December 11, 2023 Category: Neuroscience Authors: Meilin Zhan Sihan Chen Roger Levy Jiayi Lu Edward Gibson Source Type: research
Perspective Taking Reflects Beliefs About Partner Sophistication: Modern Computer Partners Versus Basic Computer and Human Partners
Cogn Sci. 2023 Dec;47(12):e13385. doi: 10.1111/cogs.13385.ABSTRACTWe investigate partner effects on spatial perspective taking behavior in listeners, comparing behavior with a human versus a computer partner (Experiments 1 and 2), and with computer partners of different perceived capabilities (Experiment 3). Participants responded to spoken instructions from their partner which could be interpreted egocentrically (from their own perspective) or othercentrically (from their partner's perspective). In contrast to earlier work, we found that participants were more egocentric with a computer than a human partner. Participants ...
Source: Cognitive Science - December 11, 2023 Category: Neuroscience Authors: Jia E Loy Vera Demberg Source Type: research
Rational Sentence Interpretation in Mandarin Chinese
In this study, we test the noisy-channel model in Mandarin Chinese, a language taxonomically different from English. We present native Mandarin speakers sentences in a written modality (Experiment 1) and an auditory modality (Experiment 2) in three pairs of syntactic alternations. The critical materials are literally implausible but require differing numbers and types of edits in order to form more plausible sentences. Each sentence is followed by a comprehension question that allows us to infer whether the speakers interpreted the item literally, or made an inference toward a more likely meaning. Similar to previous resea...
Source: Cognitive Science - December 11, 2023 Category: Neuroscience Authors: Meilin Zhan Sihan Chen Roger Levy Jiayi Lu Edward Gibson Source Type: research
