scholarly journals Do we predict upcoming speech content in naturalistic environments?

2018 ◽  
Author(s):  
Evelien Heyselaar ◽  
David Peeters ◽  
Peter Hagoort

AbstractThe ability to predict upcoming actions is a characteristic hallmark of cognition and therefore not surprisingly a central topic in cognitive science. It remains unclear, however, whether the predictive behaviour commonly observed in strictly controlled lab environments generalizes to rich, everyday settings. In four virtual reality experiments, we tested whether a well-established marker of linguistic prediction (i.e. anticipatory eye movements as observed in the visual world paradigm) replicated when increasing the naturalness of the paradigm by means of i) immersing participants in naturalistic everyday scenes, ii) increasing the number of distractor objects present, iii) manipulating the location of referents in central versus peripheral vision, and iv) modifying the proportion of predictable noun-referents in the experiment. Robust anticipatory eye movements were observed, even in the presence of 10 objects (hereby testing working memory) and when only 25% of all sentences contained a visually present referent (hereby testing error-based learning). The anticipatory effect disappeared, however, when referents were placed in peripheral vision. Together, our findings suggest that working memory may play an important role in predictive processing in everyday communication, but only in contexts where upcoming referents have been explicitly attended to prior to encountering the spoken referential act. Methodologically, our study confirms that ecological validity and experimental control may go hand in hand in future studies of human predictive behaviour.

2019 ◽  
Vol 73 (3) ◽  
pp. 458-467
Author(s):  
Florian Hintz ◽  
Antje S Meyer ◽  
Falk Huettig

Contemporary accounts of anticipatory language processing assume that individuals predict upcoming information at multiple levels of representation. Research investigating language-mediated anticipatory eye gaze typically assumes that linguistic input restricts the domain of subsequent reference (visual target objects). Here, we explored the converse case: Can visual input restrict the dynamics of anticipatory language processing? To this end, we recorded participants’ eye movements as they listened to sentences in which an object was predictable based on the verb’s selectional restrictions (“The man peels a banana”). While listening, participants looked at different types of displays: the target object (banana) was either present or it was absent. On target-absent trials, the displays featured objects that had a similar visual shape as the target object (canoe) or objects that were semantically related to the concepts invoked by the target (monkey). Each trial was presented in a long preview version, where participants saw the displays for approximately 1.78 s before the verb was heard (pre-verb condition), and a short preview version, where participants saw the display approximately 1 s after the verb had been heard (post-verb condition), 750 ms prior to the spoken target onset. Participants anticipated the target objects in both conditions. Importantly, robust evidence for predictive looks to objects related to the (absent) target objects in visual shape and semantics was found in the post-verb but not in the pre-verb condition. These results suggest that visual information can restrict language-mediated anticipatory gaze and delineate theoretical accounts of predictive processing in the visual world.


2021 ◽  
Vol 11 (7) ◽  
pp. 915
Author(s):  
Marianna Stella ◽  
Paul E. Engelhardt

In this study, we examined eye movements and comprehension in sentences containing a relative clause. To date, few studies have focused on syntactic processing in dyslexia and so one goal of the study is to contribute to this gap in the experimental literature. A second goal is to contribute to theoretical psycholinguistic debate concerning the cause and the location of the processing difficulty associated with object-relative clauses. We compared dyslexic readers (n = 50) to a group of non-dyslexic controls (n = 50). We also assessed two key individual differences variables (working memory and verbal intelligence), which have been theorised to impact reading times and comprehension of subject- and object-relative clauses. The results showed that dyslexics and controls had similar comprehension accuracy. However, reading times showed participants with dyslexia spent significantly longer reading the sentences compared to controls (i.e., a main effect of dyslexia). In general, sentence type did not interact with dyslexia status. With respect to individual differences and the theoretical debate, we found that processing difficulty between the subject and object relatives was no longer significant when individual differences in working memory were controlled. Thus, our findings support theories, which assume that working memory demands are responsible for the processing difficulty incurred by (1) individuals with dyslexia and (2) object-relative clauses as compared to subject relative clauses.


2020 ◽  
Vol 16 (4) ◽  
pp. e1007438 ◽  
Author(s):  
Chloé Pasturel ◽  
Anna Montagnini ◽  
Laurent Udo Perrinet

i-Perception ◽  
10.1068/ic335 ◽  
2011 ◽  
Vol 2 (4) ◽  
pp. 335-335
Author(s):  
Sheryl Chong ◽  
Neil Mennie

2011 ◽  
Vol 49 (2) ◽  
pp. 92-98 ◽  
Author(s):  
Marcel A. van den Hout ◽  
Iris M. Engelhard ◽  
Marleen M. Rijkeboer ◽  
Jutte Koekebakker ◽  
Hellen Hornsveld ◽  
...  
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document