In 2018, LiI issued an open external Synergy Call to further trigger and reward innovative, interdisciplinary, and more than “business as usual” research. After careful judgement of all submitted proposals by the Assessment Committee based on the preset criteria, one proposal was granted and the project “Communication in Context” submitted by Dr. Arjen Stolk and Dr. Jana Basnakova. The project started in the fall of 2019.
The dedicated website for the Synergy Project can be found here.
Communication in Context
A major challenge of understanding the human language faculty is to account for the extreme flexibility with which humans employ their words and gestures in everyday communicative interactions. We seem to be endowed with a remarkable ability to rapidly find relevant context for understanding and using intrinsically ambiguous communicative behaviours. The Synergy project aims to understand what counts as context and how that context determines the meaning of an utterance.
Across several interrelated projects, we will test the notion that a large portion of the context is contingent on joint knowledge implied by the ongoing interaction between interlocutors, i.e. a flexible and mutually coordinated ‘shared conceptual space’. First, neural mechanisms will be identified critically supporting shared conceptual spaces by having people interact in novel communicative settings minimizing the need for the use of pre-existing shared representations. This is achieved through dual-fMRI and dual-EEG studies in individuals with Autism Spectrum Disorder (ASD) examining the possibility that the poor communication and interaction abilities characteristic of ASD are caused by difficulties in using the conceptual space defined by the ongoing interaction.
Second, neural mechanisms will be identified constraining the meaning of utterances during controlled dialogs. This is achieved through combined eye-tracking and fMRI/EEG studies in ASD individuals quantitatively varying the strength of conflicting semantic constraints on the communicative meaning of verbal and gestural utterances. Overall, using specially designed experimental protocols, the studies aim to provide a new theoretical and empirical foundation for understanding human communication, as well as a new window into understanding and treating disorders of human communication in neurological and neurodevelopmental disorders.
Dr. Saskia Koch
Jordy van Langen
Research Highlights (2022)
On the integration of stereotypes and factual evidence in interpersonal communication*
Team members: Saskia B. J. Koch, Anna Tyborowska , Hannah C. M. Niermann, Antonius H. N. Cillessen, Karin Roelofs, Jana Bašnáková, Ivan Toni & Arjen Stolk
One of the critical features of everyday language use is that it is always adapted to a partner. This project provided an analysis of communicative exchanges of adolescents from the tacit communicative game, in order to elucidate the mechanisms of such communicative adjustments, as well as the neuroanatomical variability and early social life experiences related to this adjustment.
Using precisely quantified communicative exchanges in 95 adolescents followed since infancy, this longitudinal study shows that there are two sources of knowledge informing real-time communicative adjustment: generalizable stereotypical knowledge about the interlocutor and interaction‐based evidence. These make complementary, yet neuroanatomically and developmentally dissociable, contributions to understanding other minds in social interaction. Contributions from stereotypes were prominent at the onset of interactions, and individual variation in stereotype‐driven effects correlated with variation in volume and surface of gray matter in the right anterior cingulate gyrus. Contributions from interaction‐based evidence gradually reduced the influence of stereotypes, and the rate of this modulation was predicted by the degree of exposure to social interactions during the first few years of life, over and above effects of familial environment and late social experience. These findings unify previously disparate theories of human social understanding, and suggest that early‐life social experiences have long‐term consequences on how an understanding of mind is constructed in social interaction.
This study is among the first ones quantifying the relative contribution of two sources of evidence to communicative adjustment during unfolding interaction. In addition, we were able to directly relate the relative contribution of both sources of knowledge to individual difference in early social experience, as well as to neuroanatomical variations in brain structure. The findings lend support to the notion of a sensitive developmental period, showing that early‐life social interactions, particularly those outside of the family environment, are crucial in shaping an individual’s ability to tailor communication to an individual partner.
The findings of this project are built on the interdisciplinary Nijmegen longitudinal study following the development of a cohort of children from 1998 until present. The NLS itself is a collaborative project, with this analysis making a unique contribution to understanding language in interaction.
* This study has been submitted for publication in February 2023. The figure and its caption are part of the submitted manuscript.