Publications

Abstract

When operating on gliomas near critical language regions, surgeons risk either leaving residual tumor or inducing permanent postoperative language deficits (PLDs). Despite the advent of intraoperative mapping techniques, subjective judgments frequently determine important surgical decisions. We aim to inform data-driven surgery by constructing a non-invasive mapping approach that quantitatively predicts the impact of individual surgical decisions on long-term language function. This study included 79consecutive patients undergoing resection of language-eloquent gliomas. Patients underwent preoperative navigated transcranial magnetic stimulation (TMS) language mapping to identify language-positive sites (“TMS points”) and their associated white matter tracts (“TMS tracts”) as well as formal language evaluations pre-and postoperatively. The resection of regions identified by preoperative mapping was correlated with permanent postoperative language deficits (PLDs). Resected tract segments (RTS) were normalized to MNI space for comparison with normative data. The resection of TMS points did not predict PLDs. However, a TMS point subgroup defined by white matter connectivity significantly predicted PLDs (OR = 8.74, p < 0.01) and demonstrated a canonical distribution of cortical language sites at a group level. TMS tracts recapitulated normative patterns of white matter connectivity defined by the Human Connectome Project. Subcortical resection of TMS tracts predicted PLDs independently of cortical resection (OR = 60, p < 0.001). In patients with PLDs, RTS showed significantly stronger co-localization with normative language-associated tracts compared to RTS in patients without PLDs (p < 0.05). Resecting patient-specific co-localizations between TMS tracts and normative tracts in native space predicted PLDs with an accuracy of 94% (OR = 134, p < 0.001). Prospective application of this data in a patient with glioblastoma precisely predicted the results of intraoperative language mapping with direct subcortical stimulation. Long-term postoperative language deficits result from resecting patient-specific white matter segments. We integrate these findings into a personalized tool that uses TMS language mappings, diffusion tractography, and population-level connectivity to preoperatively predict the long-term linguistic impact of individual surgical decisions.

Abstract

By studying communicative interactions between humans, we can investigate the basic processes underlying the evolution of language, including how humans manage to communicate in the first place, how they form novel conventions, how they create grammatical structure, and subsequent changes to their conventions and grammar. Communication experiments, which involve interactions between two or more human participants in artificial settings, are a useful method for addressing these questions within a controlled environment. These experiments can help researchers with teasing apart the effects of different variables on the emergence of language, which are typically confounded in naturalistic settings. In this chapter, we first briefly review the history of communication paradigms. We then summarize the procedures, designs, and typical measures that characterize communication experiments. Finally, we discuss the theoretical limitations and methodological challenges of using such paradigms and propose some ways forward.

Abstract

How do people shape the information they convey when they cannot rely on conventions from the language(s) they know? Silent gesture, a methodology in which hearing participants communicate using only their hands and bodies, has been a productive way to study this. Combined with learning and interaction, silent gesture provides the opportunity to simulate the emergence of artificial miniature sign languages in a laboratory setting, making it possible to closely observe how communicative strategies change and adapt as linguistic structure emerges. This chapter provides an overview of the phenomena investigated using silent gesture. By giving an in-depth example of silent gesture ‘in action’, we demonstrate how the method has been used to study the nature of reversible events, and their influence on word order. Furthermore, we evaluate options regarding stimuli presentation, participant selection, and setup details. Finally, we discuss silent gesture data analysis (manually as well as computationally).

Abstract

Impaired musical rhythm abilities and developmental speech-language related disorders are biologically and clinically intertwined. Prior work examining their relationship has primarily used small samples; here, we studied associations at population-scale by conducting the largest systematic epidemiological investigation to date (total N = 39,358). Based on existing theoretical frameworks, we predicted that rhythm impairment would be a significant risk factor for speech-language disorders in the general adult population. Findings were consistent across multiple independent datasets and rhythm subskills (including beat synchronization and rhythm discrimination), and aggregate meta-analyzed data showed that non-linguistic rhythm impairment is a modest but consistent risk factor for developmental speech, language, and reading disorders (OR = 1.33 [1.18 – 1.49]; p < .0001). Further, cross-trait polygenic score analyses (total N = 7180) indicated shared genetic architecture between musical rhythm and reading abilities, suggesting genetic pleiotropy between musicality and language-related phenotypes.

Abstract

This paper explores image modeling from the frequency space and introduces DCTdiff, an end-to-end diffusion generative paradigm that efficiently models images in the discrete cosine transform (DCT) space. We investigate the design space of DCTdiff and reveal the key design factors. Experiments on different frameworks (UViT, DiT), generation tasks, and various diffusion samplers demonstrate that DCTdiff outperforms pixel-based diffusion models regarding generative quality and training efficiency. Remarkably, DCTdiff can seamlessly scale up to 512×512 resolution without using the latent diffusion paradigm and beats latent diffusion (using SD-VAE) with only 1/4 training cost. Finally, we illustrate several intriguing properties of DCT image modeling. For example, we provide a theoretical proof of why ‘image diffusion can be seen as spectral autoregression’, bridging the gap between diffusion and autoregressive models. The effectiveness of DCTdiff and the introduced properties suggest a promising direction for image modeling in the frequency space. The code is at https://github.com/forever208/DCTdiff.

Abstract

In reply to Magnuson, Crinnion, Luthra, Gaston, and Grubb (2023), we challenge their conclusion that on-line activation feedback improves word recognition. This type of feedback is instantiated in the TRACE model (McClelland & Elman, 1986) as top-down spread of activation from lexical to phoneme nodes. We give two main reasons why Magnuson et al.'s demonstration that activation feedback speeds up word recognition in TRACE is not informative about whether activation feedback helps humans recognize words. First, the same speed-up could be achieved by changing other parameters in TRACE. Second, more fundamentally, there is room for improvement in TRACE's performance only because the model, unlike Bayesian models, is suboptimal. We also challenge Magnuson et al.'s claim that the available empirical data support activation feedback. The data they base this claim on are open to alternative explanations and there are data against activation feedback that they do not discuss. We argue, therefore, that there are no computational or empirical grounds to conclude that activation feedback benefits human spoken-word recognition and indeed no theoretical grounds why activation feedback would exist. Other types of feedback, for example feedback to support perceptual learning, likely do exist, precisely because they can help listeners recognize words.

Abstract

Recent decades have substantiated the understanding that the function of language relies on an elaborate network of not only cortical but also subcortical structures of the human brain. Therefore, efforts have been made in the neurosurgical field to delineate and preserve the synergy of both cortical language hubs and subcortical white matter tracts on a patient-tailored basis. Preferably, this mapping of function is achieved during the preoperative phase, thereby aiding meticulous presurgical planning. In this chapter, we present the techniques enabling this preoperative functional delineation of language: the combination of cortical stimulation mapping with navigated transcranial magnetic stimulation (nTMS) and tractography of white matter bundles for language. We commence in the first part with a stepwise description of nTMS language mapping and an overview of tractography approaches through region of interest placement and the merging of the two methods. In the second part, we depict the applicability of this combined approach by outlining the theory of language and the anatomy behind the intricate language system that these methods aim to preserve. Lastly, we present an illustrative case in order to depict the implementation in the individual. Through discussing the foundational principles of tractography and the cutting-edge applications of nTMS in language mapping, this chapter elucidates how these technologies can maximize surgical outcomes while preserving human language capacity.

Abstract

The study investigated whether the perspective of multimodal input in visuospatial maps predicts children’s spatial performance, particularly verbal recall and direction-following behavior. 5-year-old monolingual Turkish children were engaged in the Directions Task, which included visuospatial maps and videos of a speaker describing routes on maps in three conditions: Speech-Gesture combination with a front-facing view, Speech-Gesture combination with an upper back angle, and Speech-only condition with a front-facing view for control. Children were asked to verbally recall and draw the route described in the videos. They also engaged in perspective-taking, mental rotation, and relational reasoning tasks. Results showed that children’s verbal recall, but not necessarily behavioral recall, was enhanced by receiving multimodal directions. Moreover, children’s relational reasoning and perspective-taking abilities modulate their verbal recall performances. The results of this study underline the importance of multimodal input and presentation perspective in enhancing children’s spatial performance.

Abstract

Gestures express redundant or complementary information to speech they accompany by depicting visual and spatial features of referents. In doing so, they recruit both spatial and verbal cognitive resources that underpin the processing of visual semantic information and its integration with speech. The relation between spatial and verbal skills and gesture comprehension, where gestures may serve different roles in relation to speech is yet to be explored. This study examined the role of spatial and verbal skills in processing gestures that expressed redundant or complementary information to speech during the comprehension of spatial relations between objects. Turkish-speaking adults (N=74) watched videos describing the spatial location of objects that involved perspective-taking (left-right) or not (on-under) with speech and gesture. Gestures either conveyed redundant information to speech (e.g., saying and gesturing “left”) or complemented the accompanying demonstrative in speech (e.g., saying “here,” gesturing “left”). We also measured participants’ spatial (the Corsi block span and the mental rotation tasks) and verbal skills (the digit span task). Our results revealed nuanced interactions between these skills and spatial language comprehension, depending on the modality in which the information was expressed. One insight emerged prominently. Spatial skills, particularly spatial working memory capacity, were related to enhanced comprehension of visual semantic information conveyed through gestures especially when this information was not present in the accompanying speech. This study highlights the critical role of spatial working memory in gesture processing and underscores the importance of examining the interplay among cognitive and contextual factors to understand the complex dynamics of multimodal language.

Abstract

Background

Developmental delay (DD) poses challenges to children's overall development, necessitating early detection and intervention. Existing screening tools in China focus mainly on children with developmental issues in two or more domains, diagnosed as global developmental delay (GDD). However, the recent rise of early childhood development (ECD) concepts has expanded the focus to include not only those with severe brain development impairments but also children who lag in specific domains due to various social-environmental factors, with the aim of promoting positive development through active intervention. To support this approach, corresponding screening tools need to be developed.
Methods

The current study used a two-phase design to develop and validate the Parent-Reported Indicator of Developmental Evaluation for Chinese Children (PRIDE) tool. In Phase 1, age-specific milestone forms for PRIDE were created through a survey conducted in urban and rural primary care clinics across four economic regions in China. In Phase 2, PRIDE was validated in a community-based sample. Sensitivity and specificity of both PRIDE and Ages and Stages Questionnaires (ASQ)-3 were estimated using inverse probability weights (IPW) and multiple imputation (MI) to address planned and unplanned missing data.
Results

In Phase 1 involving a total of 1160 participants aged 1 to 48 months, 63 items were selected from the initial item pool to create 10 age-specific PRIDE forms. Our Phase 2 study included 777 children within the same age range. PRIDE demonstrated an estimated sensitivity and specificity of 83.3% [95% confidence interval (CI): 56.8%–100.0%] and 84.9% (95% CI: 82.8%–86.9%) in the identification of DD.
Conclusion

The findings suggest that PRIDE holds promise as a sensitive tool for detecting DD in community settings.

Abstract

Language is often regarded as a defining trait of our species, but what are its core properties? In 1960, Hockett published ‘The origin of speech’ enumerating 13 design features presumed to be common to all languages, and which, taken together, separate language from other communication systems. Here. we review which features still hold true in light of new evidence from cognitive science, linguistics, animal cognition, and anthropology, and demonstrate how a revised understanding of language highlights three core aspects: that language is inherently multimodal and semiotically diverse; that it functions as a tool for semantic, pragmatic, and social inference, as well as facilitating categorization; and that the processes of interaction and transmission give rise to central design features of language.

Abstract

Language operates within the cognitive machinery of its users. Hence language structure is likely to evolve under the pressure of cognitive constraints (Christiansen & Chater, 2008). The challenge remains, however, in determining precisely how this may have occurred. Hierarchical recursive structures are especially difficult to relate to finite cognitive features. Here, we propose a new cognitive account explaining why Center Embedded recursive structures of relative clauses (as in The boy A1 the dog A2 chases B2 falls B1) (A1A2B2B1) are ubiquitous among thousands of languages, whereas Crossed-Dependent (CD) structures (A1A2B1B2) hardly ever occur. The preponderance of CE grammars is surprising considering they can produce dependent elements at longer distances than CD. We propose that this can be explained by memory retrieval mechanisms combined with linguistic word binding operations (role assignment). Processing CE requires the sequential retrieval of referent words in a backward direction, and CD in a forward direction. We first specify two Retrieval-and-Binding (R&B) functions, from which we derive mathematically that R&B performance under backwards recall (CE) exceeds performance under forward recall (CD). Next, we reanalyze an existing dataset that investigated strategies of recall and review the literature on sequential recall strategies under conditions that mimic sentence processing. The reanalysis verified the predictions of our account and showed that a backwards recall (CE) strategy is superior under conditions relevant to language processing. We suggest that the productive power of recursive embeddings is best conserved in a CE instantiation because memory mechanisms optimally support the processing of this structure, which might explain why CE has prevailed during language evolution.

Abstract

Combining academics and athletics is challenging but important for the psychological and psychosocial development of those involved. However, little is known about how experiences in academics spill over and relate to athletics. Drawing on the enrichment mechanisms proposed by the Work-Home Resources model, we posit that study crafting behaviours are positively related to volatile personal resources, which, in turn, are related to higher athletic achievement. Via structural equation modelling, we examine a path model among 243 student-athletes, incorporating study crafting behaviours and personal resources (i.e., positive affect and study engagement), and self- and coach-rated athletic achievement measured two weeks later. Results show that optimising the academic environment by crafting challenging study demands relates positively to positive affect and study engagement. In turn, positive affect related positively to self-rated athletic achievement, whereas – unexpectedly – study engagement related negatively to coach-rated athletic achievement. Optimising the academic environment through cognitive crafting and crafting social study resources did not relate to athletic outcomes. We discuss how these findings offer new insights into the interplay between academics and athletics.

Abstract

Changes in the activity profile of cortical neurons are due to effects at the scale of local and long-range networks. Accordingly, abrupt transitions in the state of cortical neurons—a phenomenon known as Up-Down states—have been attributed to variation in the activity of afferent neurons. However, cellular physiology and morphology may also play a role in causing Up-Down states. This study examines the impact of dendritic nonlinearities, particularly those mediated by voltage-dependent NMDA receptors, on the response of cortical neurons to balanced excitatory/inhibitory synaptic inputs. Using a neuron model with two segregated dendritic compartments, we compared cells with and without dendritic nonlinearities. NMDA receptors boosted somatic firing in the balanced condition and increased the correlation between membrane potentials across the compartments of the neuron model. Dendritic nonlinearities elicited strong bimodality in the distribution of the somatic potential when the cell was driven with cortical-like input. Moreover, dendritic nonlinearities could detect small input fluctuations and lead to Up-Down states whose statistics and dynamics closely resemble electrophysiological data. Up-Down states also occurred in recurrent networks with oscillatory firing activity, as in anaesthetized animal models, when dendritic NMDA receptors were partially disabled. These findings suggest that there is a dissociation between cellular and network-level features that could both contribute to the emergence of Up-Down states. Our study highlights the complex interplay between dendritic integration and activity-driven dynamics in the origin of cortical bistability.

Abstract

To study patterns in behavior, fitness, and population dynamics, estimating the age of the individuals is often a necessity. Specifically, age estimation of young animals is very important for animal rehabilitation centers because it may determine if the animal should be taken in and, if so, what care is optimal for its rehabilitation. Accurate age estimation is also important to determine the growth pattern of an individual, and it is needed to correctly interpret the influence of early body condition on its growth trajectories. The purpose of our study was to find body measurements that function as good age estimators in young (up to 3 months old) harbor seals (Phoca vitulina vitulina), placing emphasis on noninvasive techniques that can be used in the field. To meet this goal, body mass (BM), dorsal standard length (DSL), upper canine length (CL), body condition (BC), and sex were determined from 45 Harbor Seal pups of known age. Generalized additive mixed models were fitted to find how well these morphometric measures predicted age, and the results from the selected model were used to compute growth curves and to create a practical table to determine the age of young animals in the field. We found that both DSL and CL—and to some extent sex—were useful predictors for estimating age in young harbor seals and that the growth rate of pups raised in captivity is significantly lower than for those raised in the wild. In addition, we found no evidence for compensatory growth, given that animals that arrived at the center with a poor BM or BC continued to show lower BM or BC throughout almost the entire rehabilitation period.

Abstract

The long-standing claim that young children are the main agents of language change is often presented as an established fact, and has tacitly guided research in developmental science and evolutionary linguistics. It rests on the assumption that language change arises from language acquisition errors predominantly committed by children. Here, we review whether arguments in support of this idea stand up to logical and empirical scrutiny. We conclude that while children’s imperfect learning indeed leads them to produce input-divergent linguistic variants, there is no convincing evidence that it is these child-generated innovations that eventually spread through the language community, nor that language change is mainly driven by constraints and biases operating uniquely in children. By exposing the conceptual and empirical shortcomings of overemphasizing children as the agents of language change, we hope to rebalance the field toward a more nuanced understanding of how individual- and population-level processes shape language change.

Abstract

Apolipoprotein E ε4 is a major genetic risk factor for Alzheimer’s disease, and some apolipoprotein E ε4 carriers show Alzheimer’s disease–related neuropathology many years before cognitive changes are apparent. Therefore, studying healthy apolipoprotein E genotyped individuals offers an opportunity to investigate the earliest changes in brain measures that may signal the presence of disease-related processes. For example, subtle changes in functional magnetic resonance imaging functional connectivity, particularly within the default mode network, have been described when comparing healthy ε4 carriers to ε3 carriers. Similarly, very mild impairments of episodic memory have also been documented in healthy apolipoprotein E ε4 carriers. Here, we use a naturalistic activity (movie watching), and a marker of episodic memory encoding (transient changes in functional magnetic resonance imaging activity and functional connectivity around so-called ‘event boundaries’), to investigate potential phenotype differences associated with the apolipoprotein E ε4 genotype in a large sample of healthy adults. Using Bayes factor analyses, we found strong evidence against existence of differences associated with apolipoprotein E allelic status. Similarly, we did not find apolipoprotein E-associated differences when we ran exploratory analyses examining: functional system segregation across the whole brain, and connectivity within the default mode network. We conclude that apolipoprotein E genotype has little or no effect on how ongoing experiences are processed in healthy adults. The mild phenotype differences observed in some studies may reflect early effects of Alzheimer’s disease–related pathology in apolipoprotein E ε4 carriers.

Abstract

Tractography has emerged as a central tool for mapping the cerebral white matter architecture. However, its scientific value continues to be a subject of debate, given its inherent limitations in anatomical accuracy. This concise communication showcases key points of a debate held at the 2024 Tract-Anat Retreat, addressing the trade-offs between the accuracy and utility of tractography. While tractography remains constrained by limitations related to resolution, sensitivity, and validation, its usefulness and utility in areas such as surgical planning, disorder prediction, and the elucidation of brain development are emphasized. These perspectives highlight the necessity of context-specific interpretation, anatomically informed algorithms, and the continuous refinement of tractography workflows to achieve an optimal balance between accuracy and utility.

Abstract

Hemispheric brain asymmetry is a basic organizational principle of the human brain and has been implicated in various psychiatric conditions, including autism spectrum disorder. Brain asymmetry is not a uniquely human feature and is observed in other species such as the mouse. Yet, asymmetry patterns are generally nuanced, and substantial sample sizes are required to detect these patterns. In this pre-registered study, we use a mouse dataset from the Province of Ontario Neurodevelopmental Network, which comprises structural MRI data from over 2000 mice, including genetic models for autism spectrum disorder, to reveal the scope and magnitude of hemispheric asymmetry in the mouse. Our findings demonstrate the presence of robust hemispheric asymmetry in the mouse brain, such as larger right hemispheric volumes towards the anterior pole and larger left hemispheric volumes toward the posterior pole, opposite to what has been shown in humans. This suggests the existence of species-specific traits. Further clustering analysis identified distinct asymmetry patterns in autism spectrum disorder models, a phenomenon that is also seen in atypically developing participants. Our study shows potential for the use of mouse models in studying the biological bases of typical and atypical brain asymmetry but also warrants caution as asymmetry patterns seem to differ between humans and mice.

Abstract

Despite the impact of tractography on human brain mapping, direct validation and biological interpretation remain challenging. This short communication summarizes the key points of a debate held at the 2024 Tract-Anat Retreat on whether animal models are useful for studying human neuroanatomy with diffusion MRI tractography. While recognizing limitations, such as anatomical and biological differences between species, hardware and acquisition considerations and direct translation and interpretation, we identified immense value and utility of animal models for tractography including validation with histology, acquiring high-resolution datasets, exploring disease mechanisms, and advancing comparative neuroanatomy. These perspectives highlight the translational potential of preclinical models to inform tractography methodologies and underscore the need for careful species selection, methodological rigor, and ethical oversight in cross-species neuroimaging research.

Abstract

When talking, speakers naturally produce hand movements (co-speech gestures) that contribute to communication. Evidence in Dutch suggests that the timing of simple up-and-down, non-referential “beat” gestures influences spoken word recognition: the same auditory stimulus was perceived as CONtent (noun, capitalized letters indicate stressed syllables) when a beat gesture occurred on the first syllable, but as conTENT (adjective) when the gesture occurred on the second syllable. However, these findings were based on a small number of minimal pairs in Dutch, limiting the generalizability of the findings. We therefore tested this effect in Spanish, where lexical stress is highly relevant in the verb conjugation system, distinguishing bailo, “I dance” with word-initial stress from bailó, “she danced” with word-final stress. Testing a larger sample (N = 100), we also assessed whether individual differences in working memory capacity modulated how much individuals relied on the gestures in spoken word recognition. The results showed that, similar to Dutch, Spanish participants were biased to perceive lexical stress on the syllable that visually co-occurred with a beat gesture, with the effect being strongest when the acoustic stress cues were most ambiguous. No evidence was found for by-participant effect sizes to be influenced by individual differences in phonological or visuospatial working memory. These findings reveal gestural-speech coordination impacts lexical stress perception in a language where listeners are regularly confronted with such lexical stress contrasts, highlighting the impact of gestures’ timing on prominence perception and spoken word recognition.

Abstract

This book is about social action as it is carried out in everyday life. To some readers, the phrase social action may evoke the idea of people taking the initiative for change at the political and economic level of society; these are social actions that take days, months, or years to accomplish. The kinds of actions this book is concerned with are, instead, much more rapid and minute. They are actions performed on the fly, in the back and forth of ordinary interaction; they are actions like questions, answers, complaints, compliments, and requests. As a species of social action, requests serve a basic function: getting help from others. Every day in a community, people make hundreds of requests of one another, most of which are small requests for mundane things such as passing an item or performing a service around the house. Another way of thinking about requests is as the exercise of social influence in our everyday encounters, the kind of influence with tangible effects on the subsequent conduct of those around us. The book reports on an extensive study of requests “in the wild,” through the methodical observation and analysis of naturally occurring social interactions captured on video. Using the case of everyday requests among speakers of Italian, the book shows that our resources for social action are organized in systems—that is, in coherent sets of interdependent practices. It argues that such systems are part of the social order, as they shape, constrain, and enable interaction between people.

Abstract

A strong predictor of children's language is performance on non-word repetition (NWR) tasks. However, the basis of this relationship remains unknown. Some suggest that NWR tasks measure phonological working memory, which then affects language growth. Others argue that children's knowledge of language/language experience affects NWR performance. A complicating factor is that most studies focus on school-aged children, who have already mastered key language skills. Here, we present a new NWR task for English-learning 2-year-olds, use it to assess the effect of NWR performance on concurrent and later vocabulary development, and compare the children's performance with that of an experience-based computational model (CLASSIC). The new NWR task produced reliable results; replicating wordlikeness effects, word-length effects, and the relationship with concurrent and later language ability we see in older children. The model also simulated all effects, suggesting that the relationship between vocabulary and NWR performance can be explained by language experience-/knowledge-based theories.

Abstract

Emotional facial expressions often take place during communicative face-to-face interactions. Yet little is known as to whether natural spoken processing can be modulated by emotional expressions during online processing. Furthermore, the functional independence of syntactic processing from other cognitive and affective processes remains a long-standing debate in the literature. To address these issues, this study investigated the influence of masked emotional facial expressions on syntactic speech processing. Participants listened to sentences that could contain morphosyntactic anomalies while a masked emotional expression was presented for 16 ms (i.e., subliminally) just preceding the critical word. A larger Left Anterior Negativity (LAN) amplitude was observed for both emotional faces (i.e., happy and angry) compared to neutral ones. Moreover, a larger LAN amplitude was found for angry faces than for happy faces. Finally, a reduced P600 amplitude was observed only for angry faces when compared to neutral faces. Collectively, the results presented here indicate that first-pass syntactic parsing is influenced by emotional visual stimuli even under masked conditions and that this effect extends also to later linguistic processes. These findings constitute evidence in favor of an interactive view of language processing as integrated within a complex and integrated system for human communication.

Abstract

Prior research shows that self-referential information (e.g., seeing one's own face) is prioritized in human cognition. However, the brain signal variability underlying self-processing remains scarcely treated in the literature. Additionally, less is known about whether the processing of self-referential visual content can be modulated by facial expressions of emotion, as these resemble more natural situations than neutral expressions. This study therefore investigated the brain signal variability underlying self-referential visual processing and its possible interaction with emotional facial expressions, as indexed by multiscale entropy analysis (MSE). This metric captures the temporal complexity or variability contained in neural patterns at varying timescales. Thirty-two participants were presented with distinctive facial identities (self, friend, and unknown) displaying different facial expressions (happy, neutral, and angry) and performed an identity recognition task. Our results showed that brain signal variability decreases in response to self-faces compared to other identities. Similarly, brain signal variability also decreases for friend faces relative to unknown faces. This reduction in complexity could be indicative of greater efficiency during the preferential processing of personally relevant stimuli. Furthermore, the data observed here show that self-processing is unaffected by facial expressions of emotion, suggesting an independent processing of identity from more dynamic facial information, particularly when the task demands are focused on identity recognition. These results provide novel evidence of the moment-to-moment brain signal variability involved in the identity of the self and others. The evidence presented here adds to a growing literature highlighting the relevance of neural variability for understanding brain-behavior relationships.

Abstract

Pragmatic phenomena are characterized by extreme variability, which makes it difficult to draw sound generalizations about the role of social cognition in pragmatic language by and large. I introduce cultural evolutionary pragmatics as a new framework for the study of the interdependence between language and social cognition, and point at the study of common-ground management across languages and ages as a way to test the reliance of pragmatic language on social cognition. I illustrate this new research line with three experiments on article use by second language speakers, whose mother tongue lacks articles. These L2 speakers are known to find article use challenging and it is often argued that their difficulties stem from articles being pragmatically redundant. Contrary to this view, the results of this exploratory study support the view that proficient article use requires automatizing basic socio-cognitive processes, offering a window into the interdependence between language and social cognition.

Abstract

How might social cognition help us communicate through language? At what levels does this interaction occur? In classical views, social cognition is independent of language, and integrating the two can be slow, effortful, and error-prone. But new research into word level processes reveals that communication
is brimming with social micro-processes that happen in real time, guiding even the simplest choices like how we use adjectives, articles, and demonstratives. We interpret these findings in the context of advances in theoretical models of social cognition and propose a Communicative Mind-Tracking
framework, where social micro-processes aren’t a secondary process in how we use language—they are fundamental to how communication works.

Abstract

Meta-analyses report small to moderate effect sizes or inconsistent associations (usually around r = -0.10) between wellbeing (WB) and social media use (SMU) and between anxious-depressive symptoms (ADS) and SMU (also around r = 0.10). This study employs the classical twin design, utilizing data from 6492 individuals from the Netherlands Twin Register, including 3369 MZ twins (893 complete twin pairs, 1583 incomplete twin pairs) and 3123 DZ twins (445 complete, 2233 incomplete) to provide insights into the sources of overlap between WB/ADS and SMU. Both hedonic and eudaimonic WB scales were used. SMU was measured by (1) the time spent on different social media platforms (SMUt), (2) the frequency of posting on social media (SMUf), and (3) the number of social media accounts individuals have (SMUn). Our results confirmed the low phenotypic correlations between WB and SMU (between r = -0.09 and 0.04) as well as between ADS and SMU (between r = 0.07 and 0.10). For SMU, heritability estimates between 32 and 72% were obtained. The small but significant phenotypic correlations between WB/ADS and the SMU phenotypes were mainly determined by genetic factors (in the range of 80-90%). For WB and SMU, genetic correlations were between -0.10 and -0.0, and for ADS and SMU genetic correlations were between 0.10 and 0.23. Genetic correlations implied limited but statistically significant sets of genes that affect WB/ADS and SMU levels. Overall, the results indicate that there is evidence that the small associations between WB/ADS and SMU are partly driven by overlapping genetic influences. We encourage researchers and experts to consider more personalized approaches when considering the association between WB and SMU, as well as understanding the reasons for individuals’ observed SMU levels.

Abstract

Sign languages are perceived visually and externalized using a signer's hands, face, and upper body. During sign language comprehension, deaf signers primarily focus their gaze on the face, while hearing non-signers attend more to the hands of a signer. Little is known about whether deaf signers adapt their gaze behaviour when processing unknown signs. Here, we report eye-tracking data from 15 deaf native signers of German Sign Language (DGS) and 15 hearing non-signers who were presented with videos in either DGS or an unknown sign language, all containing no linguistic mouth actions. Our data confirm that deaf signers generally fixate more on the face of a signer than hearing non-signers who attend to the hands in sign space. Moreover, only deaf signers increase their attention to the hands when processing video stimuli consisting of unknown signs compared to familiar signs, suggesting similar adjustment behaviours as observed in spoken languages.

Abstract

Children's ability to share attention with another social partner (joint attention) plays an important role in language development. However, our understanding of the role of joint attention comes mainly from children learning spoken languages, which gives a very narrow, speech-centric impression of the role of joint attention. This study broadens the scope by examining how deaf children learning a sign language achieve joint attention with their caregivers during natural social interaction, and how caregivers provide word learning opportunities. We analyzed naturalistic play sessions of 54 caregiver-child dyads using American Sign Language (ASL), and identified joint attention that surrounded caregivers’ labeling of either familiar or novel objects using a comprehensive multimodal coding scheme. We observed that dyads using ASL establish joint attention using linguistic, visual, and tactile cues, and that most naming events took place in the context of a successful joint attention episode. Key characteristics of these joint attention episodes were significantly correlated with the children's expressive vocabulary size, mirroring the patterns observed for spoken language acquisition. We also found that sign familiarity as well as the order of mention of object labels affected the timing of naming events within joint attention. Our results suggest that caregivers using ASL are highly sensitive to their child's visual attention in interactions and modulate joint attention differently when providing familiar versus novel object labels. These joint attentional episodes facilitate word learning in sign language, just as they do in spoken language interactions.

Abstract

We argue that language learning occurs in triadic interactions, where caregivers and children engage not only with each other but also with objects, actions and non-verbal cues that shape language acquisition. We illustrate this using two studies on real-time interactions in spoken and signed language. The first examines shared book reading, showing how caregivers use speech, gestures and gaze coordination to establish joint attention, facilitating word-object associations. The second study explores joint attention in spoken and signed interactions, demonstrating that signing dyads rely on a wider range of multimodal behaviours – such as touch, vibrations and peripheral gaze – compared to speaking dyads. Our data highlight how different language modalities shape attentional strategies. We advocate for research that fully incorporates the dynamic interplay between language, attention and environment.

Abstract

Brain tumors are classified as rare diseases, with an annual occurrence of 300,000 cases and account for an annual loss of 241,000 lives, highlighting their devastating nature. Recent advancements in diagnosis and treatment have significantly improved the management and care of brain tumors. This chapter provides an overview of the common types of primary brain tumors affecting language functions—gliomas and meningiomas. Techniques for identifying and mapping critical language areas, including the white matter language system, such as awake brain tumor surgery and diffusion-weighted tractography, are pivotal for understanding language localization and informing personalized treatment approaches. Numerous studies have demonstrated that gliomas in the dominant hemisphere can lead to (often subtle) impairments across various cognitive domains, with a particular emphasis on language. Recently, increased attention has been directed toward (nonverbal) cognitive deficits in patients with gliomas in the nondominant hemisphere, as well as cognitive outcomes in patients with meningiomas, a group historically overlooked. A patient-tailored approach to language and cognitive functions across the pre-, intra-, and postoperative phases is mandatory for brain tumor patients to preserve quality of life. Continued follow-up studies, in conjunction with advanced imaging techniques, are crucial for understanding the brain's potential for neuroplasticity and optimizing patient outcomes.

Abstract

Speech is highly variable in rate, challenging the perception of sound contrasts that are dependent on duration. Listeners deal with such variability by perceiving incoming speech relative to the rate in the surrounding context. For instance, the same ambiguous vowel is more likely to be perceived as being long when embedded in a fast sentence, but as short when embedded in a slow sentence. However, it is still debated to what extent domain-general and domain-specific mechanisms (i.e., language- or speech-specific mechanisms) contribute to rate-dependent perception. Here we examined the role of domain-specific mechanisms in an implicit rate-normalization task in which we manipulated linguistic knowledge about how many syllables words have. Dutch participants were presented with lists of Dutch words that were acoustically ambiguous with regard to having one or two syllables (e.g., /k?ˈlɔm/ can be monosyllabic klom, /klɔm/, or bisyllabic kolom, /ko.ˈlɔm/). While being presented with these ambiguous word lists, they saw monosyllabic or bisyllabic transcriptions of the lists on the screen. We predicted that the same acoustic stimulus would be perceived as faster (more syllables per second) when combined with bisyllabic orthography compared to monosyllabic orthography. In turn, this would lead to downstream influences on vowel length perception in target words embedded within the word lists (rate-dependent perception of Dutch /ɑ/ vs./ /aː/). Despite evidence of successful orthographic disambiguation of the ambiguous word lists, we did not find evidence that linguistic knowledge influenced participants’ rate-dependent perception. Our results are best accounted for by a domain-general account of rate-dependent perception.

Abstract

Left-right asymmetry is an important aspect of human brain organization for functions including language and hand motor control, which can be altered in some psychiatric traits. The last five years have seen rapid advances in the identification of specific genes linked to variation in asymmetry of the human brain and/or handedness. These advances have been driven by a new generation of large-scale genome-wide association studies, carried out in samples ranging from roughly 16,000 to over 1.5 million participants. The implicated genes tend to be most active in the embryonic and fetal brain, consistent with early developmental patterning of brain asymmetry. Several of the genes encode components of microtubules, or other microtubule-associated proteins. Microtubules are key elements of the internal cellular skeleton (cytoskeleton). A major challenge remains to understand how these genes affect, or even induce, the brain’s left-right axis. Several of the implicated genes have also been associated with psychiatric or neurological disorders, and polygenic dispositions to autism and schizophrenia have been associated with structural brain asymmetry. Knowledge of developmental mechanisms that lead to hemispheric specialization may ultimately help to define etiologic subtypes of brain disorders.

Abstract

Increasing geographical and cultural diversity in research participation has been a key priority for psychological researchers. In this article, we track changes in participant diversity in developmental science over the past decade. These analyses reveal surprisingly modest shifts in global diversity of research participants over time, calling into question the generalizability of our empirical foundation. We provide examples from the study of early child development of the significant epistemic and ethical costs of a lack of geographical and cultural diversity to demonstrate why greater diversification is essential to a generalizable science of human development. We also discuss strategies for diversification that could be implemented throughout the research ecosystem in the service of a culturally anchored, generalizable, and replicable science.

Abstract

In the computational and experimental psycholinguistic literature, the mechanisms behind syntactic structure building (e.g., combining words into phrases and sentences) are the subject of considerable debate. Much experimental work has shown that surprisal is a good predictor of human behavioral and neural data. These findings have led some authors to model language comprehension in a purely probabilistic way. In this paper, we use simulation to exemplify why surprisal works so well to model human data and to illustrate why exclusive reliance on it can be problematic for the development of mechanistic theories of language comprehension, particularly those with emphasis on meaning composition. Rather than arguing for the importance of structural or probabilistic information to the exclusion or exhaustion of the other, we argue more emphasis should be placed on understanding how the brain leverages both types of information (viz., statistical and structured). We propose that probabilistic information is an important cue to the structure in the message, but is not a substitute for the structure itself—neither computationally, formally, nor conceptually. Surprisal and other probabilistic metrics must play a key role as theoretical objects in any explanatory mechanistic theory of language processing, but that role remains in the service of the brain’s goal of constructing structured meaning from sensory input.

Abstract

A doubly-quantified sentence like Every bear approached a tent is ambiguous: Did every bear approach a different tent, or did they approach the same tent? These two interpretations are assumed to be mentally represented as logical representations, which specify how the different quantifiers are assigned scope with respect to each other. Based on a structural priming study, Feiman and Snedeker (2016) argued that logical representations capture quantifier-specific combinatorial properties (e.g., the specification of every differs from the specification of each in logical representations). We re-examined this conclusion by testing logical representation priming in Dutch. Across four experiments, we observed that priming of logical representations emerged if the same quantifiers are repeated in prime and target, but also if the prime and target contained different quantifiers. However, logical representation priming between quantifiers emerged less consistently than priming within the same quantifier. More specifically, our results suggest that priming between quantifiers emerges more robustly if the participant is presented with quantifier variation in the prime trials. When priming between quantifiers emerged, however, its strength was comparable to priming within the same quantifier. Therefore, we conclude that logical representations do not specify quantifier-specific biases in the assignment of scope.

Abstract

To date, research has reliably shown that language can engage and modify perceptual processes in a top-down manner. However, our understanding of the cognitive and neural mechanisms underlying such top-down influences is still under debate. In this review, we provide an overview of findings from literature investigating the organization of semantic networks in the brain (spontaneous engagement of the visual system while processing linguistic information), and linguistic cueing studies (looking at the immediate effects of language on the perception of a visual target), in an effort to isolate such mechanisms. Additionally, we connect the findings from linguistic cueing studies to those reported in (nonlinguistic) literature on priors in perception, in order to find commonalities in neural processes allowing for top-down influences on perception. In doing so, we discuss the effects of language on perception in the context of broader, general cognitive and neural principles. Finally, we propose a way forward in the study of linguistic influences on perception.

Abstract

Sign languages—the conventional languages of deaf communities—have been considered to provide a window into answering some questions regarding language emergence and evolution. In particular, iconicity, defined as the ‘existence of a structure-preserving mapping between mental models of linguistic form and meaning’, is generally regarded as a precursor to the arbitrary and segmental categorical structures found in spoken languages. However, iconic structures are omnipresent in sign languages at all levels of linguistic organization. Thus, there is a necessity for a more nuanced understanding of iconicity and its trajectory in language evolution. In this chapter, we outline different quantitative and qualitative methods to study iconicity and how one can operationalize them at lexical and discourse levels to investigate the role of iconicity in the evolution of sign languages.

Abstract

Purpose:
This study aimed to identify how a set of predefined factors modulates phoneme articulation time within a speaker.
Method:
We used a custom in-lab system that records lip muscle activity through electromyography signals, aligned with the produced speech, to measure phoneme articulation time. Twenty Spanish-speaking participants (12 females) were evaluated while producing sequences of a consonant–vowel syllable, with each sequence consisting of repeated articulations of either /pa/ or /pu/. Before starting the sequences, participants underwent a priming step with either a fast or slow speech rate. Additionally, the general attentional state level was assessed at the beginning, middle, and end of the protocol. To analyze the variability in the duration of /p/ and vowel articulation, we fitted individual linear mixed-models considering three factors: general attentional state level, priming rate, and coarticulation effects (for /p/, i.e., followed by /a/ or /u/) or phoneme identity (for vowels, i.e., being /a/ or /u/).
Results:
We found that the level of general attentional state positively correlated with production time for both the consonant /p/ and the vowels. Additionally, /p/ production was influenced by the nature of the following vowel (i.e., coarticulation effects), while vowel production time was affected by the primed speech rate.
Conclusions:
Phoneme duration appears to be influenced by both stable, speaker-specific characteristics (idiosyncratic traits) and internal, state-dependent factors related to the speaker's condition at the time of speech production. While some factors affect both consonants and vowels, others specifically modify only one of these types.

Abstract

From early on, infants show a preference for infant-directed speech (IDS) over adult-directed speech (ADS), and exposure to IDS has been correlated with language outcome measures such as vocabulary. The present multi-laboratory study explores this issue by investigating whether there is a link between early preference for IDS and later vocabulary size. Infants’ preference for IDS was tested as part of the ManyBabies 1 project, and follow-up CDI data were collected from a subsample of this dataset at 18 and 24 months. A total of 341 (18 months) and 327 (24 months) infants were tested across 21 laboratories. In neither preregistered analyses with North American and UK English, nor exploratory analyses with a larger sample did we find evidence for a relation between IDS preference and later vocabulary. We discuss implications of this finding in light of recent work suggesting that IDS preference measured in the laboratory has low test-retest reliability.

Abstract

Due to their integrative role in brain function, long-range white matter connections exhibit high individual variability, giving rise to personalised brain circuits. This neurovariability is more evident in the connection patterns of brain areas that have evolved more recently. Diffusion MRI tractography allows unique opportunities for comparative neuroanatomy across species to study evolution and provide unique insights into the phylogeny of brain networks, which we overview in this note, inspired by discussions at the International Society for Tractography (IST) retreat.

Abstract

Studies on negation processing frequently report a polarity-by-truth interaction: False affirmative sentences usually show longer response times and larger N400 amplitudes compared to true affirmative sentences, whereas for negative sentences the effect of truth-value is typically reversed. This interaction has repeatedly been linked to factors such as lexical associations, predictability, or to the need of constructing two subsequent mental representations during the comprehension of negative sentences. In a series of ERP experiments using a picture-sentence verification paradigm, we investigated how sentence polarity, truth-value and predictability interact during sentence processing. Predictability was manipulated by varying the number of alternative sentence continuations provided by the context, similarly for both sentence polarities. For both affirmative and negative sentences, true sentences elicited reduced N400 amplitudes in strongly constraining contexts—where a specific continuation was highly predictable—compared to weakly constraining contexts, where no clear prediction could be made. For false sentences, the effect of context was reversed for both sentence polarities. Crucially, the effect of Truth was dependent on predictability rather than sentence polarity: Both affirmative and negative sentences showed the same direction of the effect of Truth, namely, larger N400s for false rather than true sentences in the strongly constraining context, and the opposite pattern in the weakly constraining context, although the size of these effects differed across the two polarities. In addition, we observe a long-lasting positivity effect for negation, in both context conditions, for both truth-values and across all five experiments. We interpret this effect as reflecting inhibitory mechanisms recruited during negation processing.

Abstract

Coding social interaction has become increasingly attractive for conversation analysts interested in mixed-methods research as a way to demonstrate the robustness of qualitative findings, test relationships between interactional and exogenous variables, and reach a wider audience. However, coding is valuable to conversation analysts only when it is done in a way that attends to participants’ orientations to the phenomenon of study. The puzzle then is how to turn the messy richness of conversational data into codes that are interactionally meaningful and valid. In this article, we draw on the existing literature and our own past projects to discuss opportunities and challenges involved in coding social interaction, with an emphasis on three main aspects of the process: constraining a phenomenon by sequential and formal criteria; transforming behavior into variables; and identifying social actions. Data are in English and Italian.

Abstract

This study investigates the role of action bias in the acquisition of classifier constructions by deaf children acquiring Turkish Sign Language (TİD). While classifier handshapes are morphologically complex and iconic, deaf children (aged 7–9) were found to prefer handling classifiers (reflecting the actions performed by agents) more than signing adults, even in contexts requiring entity classifiers (reflecting the visual properties of their referents). The findings reveal that children’s frequent use of action-based lexical signs for nouns influenced their classifier preferences, suggesting a cognitive bias toward motoric representations. Furthermore, our results suggest the use of handling classifiers in intransitive contexts — even by adult signers — thus indicating a new type of variability in classifier use, which has not been reported for other sign languages before. These results provide new insights into how iconicity and lexical context shape the developmental trajectory of classifier constructions in sign language acquisition.

Abstract

Purpose:
Typical late-onset Alzheimer's disease (AD) compromises episodic memory, the ability to encode new events and recollect past events. Much of the research on episodic memory in AD has relied on lab-based memory tasks (e.g., word lists, short stories). It is unclear how well these tasks characterize the impact of episodic memory impairments across different domains of everyday life, including conversational memory. The goal of the review was to establish what is known about conversational memory in AD, that is, memory for the content of conversations one overhears or in which one participates, such as utterances said and corresponding referents (e.g., “I remember discussing medical decisions with my children and I said […] and they responded […]”).
Method:
In this scoping review, we followed the JBI Manual for Evidence Synthesis and PRISMA Extension for Scoping Reviews guidelines to conduct the scoping review. We retained 121 reports on conversation and three reports on conversational memory out of the 8,351 unique records found on PubMed, CINAHL, PsycINFO, Web of Science, Cochrane, and Embase and in relevant reviews. Included reports had to involve conversation in any format and on any topic, include an AD population, be peer-reviewed, be in English, and be published between 1990 and 2022.
Results:
None of the studies investigated memory for spontaneous conversation. Although most studies on conversation did report on key characteristics of the interactional context (e.g., level of structure, number and category of conversational partners), studies also left several important details unspecified, such as hearing/vision (omitted in 67% studies) and diagnostic process (omitted in 33% studies). Studies described a broad range of behaviors during conversation, with most concerning verbal behaviors (e.g., repetitions, disfluency, ambiguity) and only 29% nonverbal behaviors (e.g., facial expression, head and hand gestures, eye gaze). Given the rarity of studies on conversational memory, we primarily summarized existing knowledge about conversation and methodological considerations to inspire hypotheses for future research on conversational memory in AD and to illuminate decisions regarding study design.
Conclusions:
This review revealed a wide gap in knowledge on conversational memory in AD and offers a path to accelerating research on the topic. Conversational memory may be an important factor in promoting independence, participation in health care, and social well-being.

Abstract

Children’s speech becomes longer and more complex as they develop, but the reasons for this have been insufficiently studied. This study examines how changing linguistic choices in children are linked to interactive factors by analysing Who-question sequences in Japanese child–caregiver conversations. The interactive factors in focus are progressivity and balanced joint activity, which are core aspects of conversational interaction. Our analysis reveals that as children respond to Who-questions, their responses grow in length and multifunctionality. This growth is positively associated with progressivity, namely a quicker completion of the question sequence, and reduced functional load in the interlocutor’s contributions, resulting in more balanced joint activity. These findings suggest that children adapt their linguistic choices by observing and aligning them with their interactive goals in conversational sequences.

Abstract

It is not clear whether the grammatical distinction between nouns and verbs serves as an organizational principle for representation of the lexicon in the brain, or whether semantic differences between the two categories such as imageability account for any cortical segregation between them. In this study, we used repetitive transcranial magnetic stimulation (rTMS) and lexical decision tasks to test whether Broca's area would be associated with verbs and Wernicke's area with nouns, and whether imageability and lexical status (real words versus pseudowords) would modulate representation of nouns and verbs in Broca's area and Wernicke's area. We assumed that if nouns and verbs are dissociated in these regions then their suppression would lead to a selective slowdown in lexical decision times for one or the other word category, which may be modulated by imageability and lexical status. On two different days, Broca's area and Wernicke's area were suppressed using low-frequency rTMS, and lexical decision times on Turkish nouns and verbs were collected before and immediately after the stimulation sessions. Using linear mixed-effects models with item- and trial-level predictors and covariates (imageability, lemma frequency, length in letters and presentation order), we failed to find any evidence for dissociation of nouns and verbs in Broca's area and Wernicke's area, or for an effect of imageability and lexical status on such purported dissociation. The analyses revealed a significant interaction between stimulation session and lexical status (real words versus pseudowords) in Broca's area, but not in Wernicke's area, implicating Broca's area with real words more than pseudowords. In addition, several behavioral effects were observed including the word frequency effect (faster RTs for frequent than infrequent words), word superiority effect (faster RTs for real words than pseudowords) and word category effect (faster RTs for nouns than verbs). In conclusion, our findings on Turkish nouns and verbs do not provide any evidence that grammatical category is a lexical organizational principle in Broca's or Wernicke's areas.

Abstract

In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders’ language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., “type”). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.

Abstract

Language acquisition is multifaceted, relying on cognitive and social abilities in addition to language-specific skills. We hypothesized that executive function (EF) may assist language development by enabling children to revise misinterpretations during online processing, encode language input more accurately and/or learn non-canonical sentence structures like the passive better over time. One hundred and twenty Dutch preschoolers each completed three sessions of testing (pre-test, exposure and post-test). During pre-test and post-test, we measured their comprehension of passive sentences and performance in three EF tasks. In the exposure session, we tracked children’s eye movements as they listened to passive (and other) sentences. Each child was also assessed for short-term memory and receptive language. Multiple regression evaluated the relationship between EF and online processing and longer-term learning. EF predicted online revision accuracy, while controlling for receptive language, prior passive knowledge and short-term memory, consistent with theories linking EF to the revision of misinterpretations. EF was also associated with longer-term learning, but the results could not disentangle EF from receptive language. These findings broadly support a role for EF in language acquisition, including a specific role in revision during sentence processing and potentially other roles that depend on reciprocal interaction between EF and receptive language.

Abstract

Despite the importance of greetings for opening social interactions, their multimodal coordination processes remain poorly understood. We used a naturalistic, lab-based setup where pairs of unacquainted participants approached and greeted each other while unaware their greeting behavior was studied. We measured the prevalence and time course of multimodal behaviors potentially culminating in a handshake, including motor behaviors (e.g., walking, standing up, hand movements like raise, grasp, and retraction), gaze patterns (using eye tracking glasses), and speech (close and distant verbal salutations). We further manipulated the visibility of partners’ eyes to test its effect on gaze. Our findings reveal that gaze to a partner's face increases over the course of a greeting, but is partly averted during approach and is influenced by the visibility of partners’ eyes. Gaze helps coordinate handshakes, by signaling intent and guiding the grasp. The timing of adjacency pairs in verbal salutations is comparable to the precision of floor transitions in the main body of conversations, and varies according to greeting phase, with distant salutation pair parts featuring more gaps and close salutation pair parts featuring more overlap. Gender composition and a range of multimodal behaviors affect whether pairs chose to shake hands or not. These findings fill several gaps in our understanding of greetings and provide avenues for future research, including advancements in social robotics and human−robot interaction.

Abstract

When engaged in spoken conversation, speakers convey meaning using both speech and visual signals, such as facial expressions and manual gestures. An important question is how information is distributed in utterances during face-to-face interaction when information from visual signals is also present. In a corpus of casual Dutch face-to-face conversations, we focus on spoken questions in particular because they occur frequently, thus constituting core building blocks of conversation. We quantified information density (i.e. lexical entropy and surprisal) and the number and relative duration of facial and manual signals. We tested whether lexical information density or the number of visual signals differed between the first and last halves of questions, as well as whether the number of visual signals occurring in the less-predictable portion of a question was associated with the lexical information density of the same portion of the question in a systematic manner. We found that information density, as well as number of visual signals, were higher in the first half of questions, and specifically lexical entropy was associated with fewer, but longer visual signals. The multimodal front-loading of questions and the complementary distribution of visual signals and high entropy words in Dutch casual face-to-face conversations may have implications for the parallel processes of utterance comprehension and response planning during turn-taking.

Abstract

During conversation, speakers coordinate and synergize their behaviors at multiple levels, and in different ways. The extent to which individuals converge or diverge in their behaviors during interaction may relate to interpersonal differences relevant to social interaction, such as empathy as measured by the empathy quotient (EQ). An association between interpersonal difference in empathy and interpersonal entrainment could help to throw light on how interlocutor characteristics influence interpersonal entrainment. We investigated this possibility in a corpus of unconstrained conversation between dyads. We used dynamic time warping to quantify entrainment between interlocutors of head motion, hand motion, and maximum speech f0 during question–response sequences. We additionally calculated interlocutor differences in EQ scores. We found that, for both head and hand motion, greater difference in EQ was associated with higher entrainment. Thus, we consider that people who are dissimilar in EQ may need to “ground” their interaction with low-level movement entrainment. There was no significant relationship between f0 entrainment and EQ score differences.

Abstract

This study investigated a developmental cascade between prosocial and linguistic abilities in a large sample (N = 11,051) from the general youth population in the United Kingdom (50% female, 46% living in disadvantaged neighborhoods, 13% non-White). Cross-lagged panel models showed that verbal ability at age 3 predicted prosociality at age 7, which in turn predicted verbal ability at age 11. Latent growth models also showed that gains in prosociality between 3 and 5 years were associated with increased verbal ability between 5 and 11 years and vice versa. Theory of mind and social competence at age 5 mediated the association between early childhood prosociality and late childhood verbal ability. These results remained robust even after controlling for socioeconomic factors, maternal mental health, parenting microclimate in the home environment, and individual characteristics (sex, ethnicity, and special educational needs). The findings suggest that language skills could be boosted through mentalizing activities and prosocial behaviors.

Abstract

Infants develop complex visual understanding rapidly, even preceding of the acquisition of linguistic skills. As computer vision seeks to replicate the human vision system, understanding infant visual development may offer valuable insights. In this paper, we present an interdisciplinary study exploring this question: can a computational model that imitates the infant learning process develop broader visual concepts that extend beyond the vocabulary it has heard, similar to how infants naturally learn? To investigate this, we analyze a recently published model in Science by Vong et al., which is trained on longitudinal, egocentric images of a single child paired with transcribed parental speech. We perform neuron labeling to identify visual concept neurons hidden in the model’s internal representations. We then demonstrate that these neurons can recognize objects beyond the model’s original vocabulary. Furthermore, we compare the differences in representation between infant models and those in modern computer vision models, such as CLIP and ImageNet pre-trained model. Ultimately, our work bridges cognitive science and computer vision by analyzing the internal representations of a computational model trained on an infant visual and linguistic inputs. Our code is available at https://github.com/Kexueyi/discover_infant_vis.

Abstract

In spoken languages, children acquire locative terms in a cross-linguistically stable order. Terms similar in meaning to in and on emerge earlier than those similar to front and behind, followed by left and right. This order has been attributed to the complexity of the relations expressed by different locative terms. An additional possibility is that children may be delayed in expressing certain spatial meanings partly due to difficulties in discovering the mappings between locative terms in speech and spatial relation they express. We investigate cognitive and mapping difficulties in the domain of spatial language by comparing how children map spatial meanings onto speech versus visually motivated forms in co-speech gesture across different spatial relations. Twenty-four 8-year-old and 23 adult native Turkish-speakers described four-picture displays where the target picture depicted in-on, front-behind, or left-right relations between objects. As the complexity of spatial relations increased, children were more likely to rely on gestures as opposed to speech to informatively express the spatial relation. Adults overwhelmingly relied on speech to informatively express the spatial relation, and this did not change across the complexity of spatial relations. Nevertheless, even when spatial expressions in both speech and co-speech gesture were considered, children lagged behind adults when expressing the most complex left-right relations. These findings suggest that cognitive development and mapping difficulties introduced by the modality of expressions interact in shaping the development of spatial language.

Abstract

Dealing with text is crucial in modern societies. However, not everyone acquires sufficient literacy skills during school education. This systematic review summarizes and synthesizes research on adults with low literacy skills (ALLS) in alphabetic writing systems, includes results from behavioral and neurobiological studies, and compares these findings with those on developmental dyslexia given that this developmental disorder is one possible explanation for low literacy skills in adulthood. Twenty-seven studies focusing on the cognitive profile of ALLS met the three predefined criteria of reading level, age, and education. Results showed that ALLS performed worse than literate adults in various tasks at skill and information processing level, and exhibited structural and functional differences at the neurobiological level. The cognitive profile of ALLS was closer to that of primary school children than of literate adults. However, relative to children, ALLS’ literacy skills relied less on phonological and more on orthographic strategies. A narrative comparison of results with meta-analyses on developmental dyslexia showed large, though not complete, overlap in the cognitive profiles. The present results helps to better understand the literacy skills and reading-related cognitive functions of ALLS and may support the development of tailored interventions directed to the specific cognitive difficulties ALLS have.

Abstract

Bioacoustics is an interdisciplinary science; it concerns aspects of communication through sound in animals, including humans. Within language evolution research, bioacoustics is particularly relevant to address questions about the origins and evolution of speech. Areas of bioacoustics research include the perception and production of acoustic signals, their transmission in the environment, and the neural and anatomical correlates that determine and influence communication. Here, we review the tools needed to conduct bioacoustics research, from initial methodological choices to instrument choice, based on critical features needed for data collection in the field. We discuss key methodological choices in sound recording and processing raw data from a data collection campaign. We provide recommendations for the recording and use of acoustic signals. We discuss analysis techniques, focusing exclusively on rhythm in animal vocalizations. We conclude by stressing the potential for multidisciplinary collaborations, and highlighting key areas where these collaborations could happen.

Abstract

Do aesthetic preferences for images of neatly organized compositions (e.g., images collected on blogs like Things Organized Neatly©) generalize across cultures? In an earlier study, focusing on stimulus and personal properties related to order and complexity, Western participants indicated their preference for one of two simultaneously presented images (100 pairs). In the current study, we compared the data of the native Dutch-speaking participants from this earlier sample (N = 356) to newly collected data from a native Chinese-speaking sample (N = 220). Overall, aesthetic preferences were quite similar across cultures. When relating preferences for each sample to ratings of order, complexity, soothingness, and fascination collected from a Western, mainly Dutch-speaking sample, the results hint at a cross-culturally consistent preference for images that Western participants rate as more ordered, but a cross-culturally diverse relation between preferences and complexity.

Abstract

Humans are keen pattern-seekers and take advantage of regularities present in their environment. In the temporal domain, we may call these patterns rhythms, but what is rhythm? Definitions vary, but all presuppose a categorical distinction between rhythm and randomness. Here, we challenge this view and show that two types of random sound sequences—classically considered arrhythmic by experimenters—differ in the amount of regularity humans reconstruct from them. When asked to synchronize to randomly timed sounds, participants leverage statistics to estimate the underlying tempo of the sequence, similar to linear statistical estimators. Theoretically, our results challenge current definitions of rhythm by showing that rhythmicity and randomness are instances of a continuum. Methodologically, our data and mathematical model show that a common method for creating random timing, namely the jittering of event onsets, introduces an undesirable regularity that humans readily exploit. New experiments should aim to maximize temporal randomness, and past experiments’ outcomes require reconsideration.

Abstract

We performed a genome-wide association meta-analysis (GWAMA) of 290,134 attention-deficit/hyperactivity disorder (ADHD) symptom measures of 70,953 unique individuals from multiple raters, ages and instruments (ADHDSYMP). Next, we meta-analyzed the results with a study of ADHD diagnosis (ADHDOVERALL). ADHDSYMP returned no genome-wide significant variants. We show that the combined ADHDOVERALL GWAMA identified 39 independent loci, of which 17 were new. Using a recently developed gene-mapping method, Fine-mapped Locus Assessment Model of Effector genes, we identified 22 potential ADHD effector genes implicating several new biological processes and pathways. Moderate negative genetic correlations (rg < −0.40) were observed with multiple cognitive traits. In three cohorts, polygenic scores (PGSs) based on ADHDOVERALL outperformed PGSs based on ADHD symptoms and diagnosis alone. Our findings support the notion that clinical ADHD is at the extreme end of a continuous liability that is indexed by ADHD symptoms. We show that including ADHD symptom counts helps to identify new genes implicated in ADHD.

Abstract

Genome-wide association studies (GWAS) have provided valuable insights into the genetic basis of neuropsychiatric disorders and highlighted their complexity. Careful consideration of the polygenicity and complex genetic architecture could aid in the understanding of the underlying brain mechanisms. We introduce an innovative approach to polygenic scoring, utilizing imaging-derived phenotypes (IDPs) to predict a clinical phenotype. We leveraged IDP GWAS data from the UK Biobank, to create polygenic imaging-derived scores (PIDSs). As a proof-of-concept, we assessed genetic variations in brain structure between individuals with ADHD and unaffected controls across three NeuroIMAGE waves (n = 954). Out of the 94 PIDS, 72 exhibited significant associations with their corresponding IDPs in an independent sample. Notably, several global measures, including cerebellum white matter, cerebellum cortex, and cerebral white matter, displayed substantial variance explained for their respective IDPs, ranging from 3% to 5.7%. Conversely, the associations between each IDP and the clinical ADHD phenotype were relatively weak. These findings highlight the growing power of GWAS in structural neuroimaging traits, enabling the construction of polygenic scores that accurately reflect the underlying polygenic architecture. However, to establish robust connections between PIDS and behavioral or clinical traits such as ADHD, larger samples are needed. Our novel approach to polygenic risk scoring offers a valuable tool for researchers in the field of psychiatric genetics.

Abstract

Research with nonnative speech spans many different linguistic branches and topics. Most studies include one or a few well-known features of a particular accent. However, due to a lack of empirical studies, little is known about how common these features are among nonnative speakers or how uncommon they are among native speakers. Moreover, it remains to be seen whether findings from such studies generalize to lesser-known features. Here, we demonstrate a quantitative approach to study nonnative accent features using Dutch-accented English as an example. By analyzing the phonetic distances between transcriptions of speech samples, this approach can identify the features that best distinguish nonnative from native speech. In addition, we describe a method to test hypotheses about accent features by checking whether the prevalence of the features overall varies between native and nonnative speakers. Furthermore, we include English speakers from the United States and United Kingdom and native Dutch speakers from Belgium and The Netherlands to address the issue of regional accent variability in both the native and target language. We discuss the results concerning three observed features. Overall, the results provide empirical support for some well-known features of Dutch-accented English, but suggest that others may be infrequent among nonnatives or in fact frequent among natives. In addition, the findings reveal potentially new accent features, and factors that may modulate the expression of known features. Our study demonstrates a fruitful approach to study nonnative accent features that has the potential to expand our understanding of the phenomenon of accent.

Abstract

Since 1995, the Organization for Human Brain Mapping (OHBM) Annual Meeting has provided a critical platform for sharing the latest developments in brain mapping. OHBM has recorded presentations for over a decade and made them accessible to its members through the OnDemand platform. As of 2024, this content is now openly and freely accessible to brain mapping enthusiasts worldwide—without the need to be a society member. Limited access to cutting-edge scientific content solely to paying members contradicts the longstanding ethos of OHBM, which has championed open science principles and practices for many years. In this paper, we introduce the OHBM Time Machine, a collaborative initiative undertaken by the Program, Education and Communications Committees of OHBM. The project seeks to create a free and permanent archive of all recorded Annual Meeting content, accessible to members and non-members alike. We outline the ongoing efforts to migrate all content dating back to 2015 to the OHBM YouTube channel and provide guidelines to support hosting future Annual Meeting recordings. Additionally, we discuss the benefits and challenges associated with this initiative, explaining why making this content publicly available will not diminish the value of attending the Annual Meetings. Instead, it is expected to enhance interest and awareness of OHBM as a world-leading organization of brain mapping experts. The OHBM Time Machine will provide an unparalleled educational resource, establishing a lasting record of scientific progress and the evolution of critical topics within the field of brain mapping.

Abstract

Different types of germline de novo SETBP1 variants cause clinically distinct and heterogeneous neurodevelopmental disorders: Schinzel-Giedion syn- drome (SGS, via missense variants at a critical degron region) and SETBP1 - haploinsuf fi ciency disorder. However, due to the lack of systematic investi- gation of genotype-phenotype associations of different types of SETBP1 var- iants, and limited understanding of its roles in neurodevelopment, the extent of clinical heterogeneity and how this relates to underlying pathophysiological mechanisms remains elusive. This imposes challenges for diagnosis. Here, we present a comprehensive investigation of the largest cohort to date of indi- viduals carrying SETBP1 missense variants outside the degron region ( n = 18). We performed thorough clinical and speech phenotyping with functional follow-up using cellular assays and transcriptomics. Our fi ndings suggest that such variants cause a clinically and functionally variable developmental syn- drome, showing only partial overlaps with classical SGS and SETBP1- hap- loinsuf fi ciency disorder. We provide evidence of loss-of-function pathophysiological mechanisms impairing ubiquitination, DNA-binding, transcription, and neuronal differentiation capacity and morphologies. In contrast to SGS and SETBP1 haploinsufficiency, these effects are independent of protein abundance. Overall, our study provides important novel insights into diagnosis, patient care, and aetiology of SETBP1-related disorders.

Abstract

Children vary in mathematical skills even before formal schooling. The current study investigated how parental math beliefs, parents’ math anxiety, and children's spontaneous gestures contribute to preschool-aged children’s math performance. Sixty-three Turkish-reared children (33 girls, Mage = 49.9 months, SD = 3.68) were assessed on verbal counting, cardinality, and arithmetic tasks (nonverbal and verbal). Results showed that parental math beliefs were related to children’s verbal counting, cardinality and arithmetic scores. Children whose parents have higher math beliefs along with low math anxiety scored highest in the cardinality task. Children’s gesture use was also related to lower cardinality performance and the relation between parental math beliefs and children’s performance became stronger when child gestures were absent. These findings highlight the importance of parent and child-related contributors in explaining the variability in preschool-aged children’s math skills.

Abstract

How language interacts with metacognitive processes is an understudied area. Earlier research shows that people produce disfluencies (i.e., “uh” s or “um” s) in their speech when they are not sure of their answers, indicating metacognitive monitoring. Gestures have monitoring and predictive roles in language, also implicating metacognitive processes. Further, the rate of speech disfluencies and gestures change as a function of the communicational setting. People produce fewer disfluencies and more gestures when they can see the listener than when the listener is not visible. In the current study, 50 participants (32 women, Mage = 21.16, SD = 1.46) were asked 40 general knowledge questions, either with a visible (n = 25) or nonvisible (n = 25) listener. They provided feelings-of-knowing (FOK) judgment immediately after seeing the question and were asked to think aloud while pondering their answers. Then, they provided retrospective confidence judgments (RCJs). Results showed that gestures and speech disfluencies were not related either to the accuracy or the FOK judgments. However, both gestures and speech disfluencies predicted RCJs uniquely and interactively. Speech disfluencies negatively predicted RCJs. In contrast, hand gestures were positively related to RCJs. Importantly, the use of gestures was more strongly related to RCJs when disfluencies were also higher. No effect of communicational setting on the rate of gestures or speech disfluencies was found. These results highlight the importance of multimodal language cues in the elaboration of metacognitive judgments.

Abstract

Shared book reading is widely acknowledged for its positive impact on language development, as it exposes children to complex linguistic structures not typically encountered in daily conversation. However, the mechanisms through which shared reading supports language acquisition remain less well understood. This study investigates the effects of speech complexity and gesture use on children's real-time word learning from books. Using a dual head-mounted eye-tracking paradigm, we assessed gaze dynamics in 18- to 24-month-old children during naturalistic book reading with their parents. Our findings indicate that while parental speech is rich in linguistic diversity, children at this age exhibit a preference for simpler sentence structures. Simpler sentences and imperatives, particularly when paired with child gestures, appear to capture children's attention most effectively. This study emphasizes the interplay between speech complexity, gesture, visual attention, and word learning, demonstrating that multimodal input plays a critical role in facilitating language acquisition.

Abstract

Although autism has historically been conceptualized as a condition that emerges in early childhood1,2, many autistic people are diagnosed later in life3,4,5. It is unknown whether earlier- and later-diagnosed autism have different developmental trajectories and genetic profiles. Using longitudinal data from four independent birth cohorts, we demonstrate that two different socioemotional and behavioural trajectories are associated with age at diagnosis. In independent cohorts of autistic individuals, common genetic variants account for approximately 11% of the variance in age at autism diagnosis, similar to the contribution of individual sociodemographic and clinical factors, which typically explain less than 15% of this variance. We further demonstrate that the polygenic architecture of autism can be broken down into two modestly genetically correlated (rg = 0.38, s.e. = 0.07) autism polygenic factors. One of these factors is associated with earlier autism diagnosis and lower social and communication abilities in early childhood, but is only moderately genetically correlated with attention deficit–hyperactivity disorder (ADHD) and mental-health conditions. Conversely, the second factor is associated with later autism diagnosis and increased socioemotional and behavioural difficulties in adolescence, and has moderate to high positive genetic correlations with ADHD and mental-health conditions. These findings indicate that earlier- and later-diagnosed autism have different developmental trajectories and genetic profiles. Our findings have important implications for how we conceptualize autism and provide a model to explain some of the diversity found in autism.

Abstract

To learn a word from an everyday context, infants need to be able to link the heard word with the correct object perceived. A prevailing view of the early learning environment is that infants' world is bombarded with objects and words. Therefore, it is difficult to find the named object from many possible candidates. However, building correct word‐referent mappings relies on in‐moment visual selection, it is not clear what infants attend to when learning words in a naturalistic context. Toward this goal, we conducted an eye‐tracking experiment in which 12‐month‐old infants were presented with complex visual scenes extracted from infants' egocentric videos recorded during naturalistic parent‐child toy play. These scenes were selected at naming moments when parents labeled a toy object during free‐flowing play. We selected visual scenes from a mix of more or less ambiguous naming events that contained different visual properties of the named objects and measured infants' real‐time object‐looking behaviors. We found that, despite the different visual properties of infants' egocentric scenes, early visual attention is both selective and variable. Selective visual attention is highly constrained by the visual saliency of the learning scenes, but not influenced by labels or existing word knowledge. Infants are more likely to attend to the named object when it is salient in the egocentric view. Our results suggest that although infants' naturalistic learning environment appears to be messy in terms of the number of possible objects for a heard object name, their selective attention significantly reduces the in‐moment uncertainty associated with object name learning.

Abstract

Background

Very preterm (VPT; <32 weeks) or very low birth weight (VLBW; <1500 g) birth is associated with socioeconomic disadvantages in adulthood; however, the predictors of these outcomes remain underexplored. This study examined socioeconomic disparities and identified neonatal and sociodemographic risk factors among VPT/VLBW individuals.
Methods

A one-stage individual participant data meta-analysis was conducted using 11 birth cohorts from eight countries, comprising 1695 VPT/VLBW and 1620 term-born adults aged 18–30 years.
Results

VPT/VLBW adults had lower odds of higher educational attainment (0.40[0.26–0.59]), remaining in education (0.63[0.47–0.84]) or paid work (0.76[0.59–0.97]), and higher odds of receiving social benefits (3.93[2.63–5.68]) than term-borns. Disparities in education and social benefits persisted after adjusting for age, sex, and maternal education, even among those without neurosensory impairments (NSI). Among VPT/VLBW adults, NSI significantly impacted all socioeconomic outcomes, increasing the odds of receiving social benefits 6.7-fold. Additional risk factors included medical complications, lower gestational age and birth weight, lower maternal education, younger maternal age, and non-white ethnicity.
Conclusions

NSI is the strongest risk factor for adulthood socioeconomic challenges in the VPT/VLBW population. Mitigating these disparities may require improved neonatal care to reduce NSI prevalence and targeted social and educational support for VPT/VLBW individuals.

Abstract

Prosody underpins various linguistic domains ranging from semantics and syntax to discourse. For instance, prosodic information in the form of lexical stress modifies meanings and, as such, syntactic contexts of words as in Turkish kaz-má "pickaxe" (noun) versus káz-ma "do not dig" (imperative). Likewise, prosody indicates the focused constituent of an utterance as the noun phrase filling the wh-spot in a dialogue like What did you eat? I ate----. In the present study, we investigated the relevance of such prosodic variations for discourse comprehension in Turkish. We aimed at answering how lexical stress and prosodic focus mismatches on critical noun phrases-resulting in grammatical anomalies involving both semantics and syntax and discourse-level anomalies, respectively-affect the perceived correctness of an answer to a question in a given context. To that end, 80 native speakers of Turkish, 40 participating in a psychometric experiment and 40 participating in an EEG experiment, were asked to judge the acceptability of prosodic mismatches that occur either separately or concurrently. Psychometric results indicated that lexical stress mismatch led to a lower correctness score than prosodic focus mismatch, and combined mismatch received the lowest score. Consistent with the psychometric data, EEG results revealed an N400 effect to combined mismatch, and this effect was followed by a P600 response to lexical stress mismatch. Conjointly, these results suggest that every source of prosodic information is immediately available and codetermines the interpretation of an utterance; however, semantically and syntactically relevant lexical stress information is assigned more significance by the language comprehension system compared with prosodic focus information.

Abstract

Prosody not only distinguishes “lexical” meaning but also plays a key role in information packaging by highlighting the most relevant constituent of the discourse, namely, “focus” information. The present study investigated the role of lexical and focus functions of prosody in the coherent interpretation of linguistic input. To this end, we manipulated the correctness of prosodic markers in the context and scrutinized how listeners evaluate these violations—whether they result in lexical or focus anomalies—using psychometric and EEG measures. Psychometric data from 40 participants indicated that prosodic violations were judged as incorrect by the listeners both at the lexical and focus levels, with focus level violations leading to lower correctness scores than lexical level violations, and combined violations receiving the lowest scores. EEG data from 20 participants documented a strong N400 effect (350–550 msec) in response to combined violations, and a late posterior negativity (600–900 msec) present only for combined violations and focus-level violations. Consistent with the psychometric data, the EEG data suggest that prosodic violations at the focus level result in higher costs for comprehension than prosodic violations at the lexical level, whereas combined prosodic violations most significantly disrupt the interpretation. Taken together, these findings suggest that the language comprehension system is sensitive to accurate representations of both lexical and information structure prosody, and benefits from the interaction between them; however, they are weighted differently based on their relevance for a functioning spoken communication.

Abstract

In Swedish, words are associated with either of two pitch contours labelled as Accent 1 and Accent 2. At least one of them is taken to be phonologically and cognitively marked. Besides encoding lexical tonal distinctions, these accents reflect intonational prominence. Drawing on data from psychometric and electroencephalographic (EEG) measures, we scrutinized the functional load of the accents for the processing of linguistic input, and explored any potential processing differences between Accent 1 and Accent 2. Experimental stimuli consisted of one hundred sets of auditory dialogues, where test words were accented either appropriately or inappropriately within their respective contexts. Native speakers of Central Swedish were tasked with judging the correctness of sentences containing the test words, actively in the psychometric paradigm and passively in the EEG paradigm. Psychometric data from forty participants revealed that accent violations exerted a statistically significant negative impact on correctness judgements. Both Accent 1 and Accent 2 violations were deemed as incorrect by the listeners, indicating that listeners use both of them to arrive at the correct interpretation of the linguistic input. Moreover, there was a statistically significant difference in the perceived correctness of violations depending on the accent pattern. Accent 2 violations received a lower rating for correctness in comparison to Accent 1 violations, suggesting that listeners show more sensitivity to accent violations in Accent 2 words than in Accent 1 words. EEG data from twenty participants were in accordance with the psychometric data, and documented larger negative ERP responses, observed at both early and later latencies, to Accent 2 violations compared to Accent 1 violations, reflecting neurocognitive difficulty associated with the processing of linguistic input. Put differently, the application of wrong accent pattern for Accent 2 words resulted in higher costs for spoken communication than Accent 1 words, which is in line with the notion that Accent 2 is marked both phonologically and cognitively in Central Swedish. This pattern of results provides evidence that the brain not only extracts and utilizes pitch accents for a coherent interpretation of the linguistic input but also treats them differently depending on their phonological and cognitive markedness.

Abstract

How do bilingual speakers represent the information that guides the assembly of words into sentences for their two languages? The shared-syntax account argues that bilinguals have a single, shared representation of the sentence structures that exist in both languages. Structural priming has been shown to be equal within and across languages, providing support for the shared-syntax account. However, equivalent levels of structural priming within and across languages could be observed even if structural representations are separate and connected, due to frequent switches between languages, which is a property of standard structural priming paradigms. Here, we investigated whether cumulative structural priming (i.e., structural priming across blocks rather than trial-by-trial), which does not involve frequent switches between languages, also shows equivalent levels of structural priming within- and cross-languages. Mixed results point towards a possibility that cumulative structural priming can be more persistent within- compared to cross-languages, suggesting a separate-and-connected account of bilingual structural representations. We discuss these results in terms of the current literature on bilingual structural representations and highlight the value of diversity in paradigms and less-studied languages.

Abstract

Knowing the sentence structures (i.e., information that guides the assembly of words into sentences) is crucial in language knowledge. This knowledge must be stable for successful communication, but when learning another language that uses different structures, speakers must adjust their structural knowledge. Here, we examine how newly acquired second language (L2) knowledge influences first language (L1) structure knowledge. We compared two groups of Korean speakers: Korean-immersed speakers living in Korea (with little English exposure) versus English-immersed speakers who acquired English late and were living in the US (with more English exposure). We used acceptability judgment and sentence production tasks on Korean sentences in English and Korean word orders. Results suggest that acceptability and structural usage in L1 change after exposure to L2, but not in a way that matches L2 structures. Instead, L2 exposure might lead to increased difficulties in the selection and retrieval of word orders while using L1.

Abstract

When we communicate with others, we often repeat aspects of each other's communicative behavior such as sentence structures and words. Such behavioral alignment has been mostly studied for speech or text. Yet, language use is mostly multimodal, flexibly using speech and gestures to convey messages. Here, we explore the use of alignment in speech (words) and co-speech gestures (iconic gestures) in a referential communication task aimed at finding labels for novel objects in interaction. In particular, we investigate how people flexibly use lexical and gestural alignment to create shared labels for novel objects and whether alignment in speech and gesture are related over time. The present study shows that interlocutors establish shared labels multimodally, and alignment in words and iconic gestures are used throughout the interaction. We also show that the amount of lexical alignment positively associates with the amount of gestural alignment over time, suggesting a close relationship between alignment in the vocal and manual modalities.

Abstract

Accommodating talker variability is a complex and multi-layered cognitive process. It involves shifting attention to the vocal characteristics of the talker as well as the linguistic content of their speech. Due to an interdependence between voice and phonological processing, multi-talker
environments typically incur additional processing costs compared to single-talker environments. A failure or inability to efficiently distribute attention over multiple acoustic cues in the speech signal
may have detrimental language learning consequences. Yet, no studies have examined effects of multi-talker processing in populations with atypical perceptual, social and language processing for communication, including autistic people. Employing a classic word-monitoring task, we investigated
effects of talker variability in Australian English autistic (n = 24) and non-autistic (n = 28) adults.
Listeners responded to target words (e.g., apple, duck, corn) in randomised sequences of words. Half of the sequences were spoken by a single talker and the other half by multiple talkers. Results revealed that autistic participants’ sensitivity scores to accurately-spotted target words did not differ to those
of non-autistic participants, regardless of whether they were spoken by a single or multiple talkers. As expected, the non-autistic group showed the well-established processing cost associated with talker
variability (e.g., slower response times). Remarkably, autistic listeners’ response times did not differ across single- or multi-talker conditions, indicating they did not show perceptual processing costs
when accommodating talker variability. The present findings have implications for theories of autistic perception and speech and language processing.

Abstract

Comparative neurobiology allows us to investigate relationships between phylogeny and the brain and understand the evolution of traits. Bats constitute an attractive group of mammalian species for comparative studies, given their large diversity in behavioural phenotypes, brain morphology, and array of specialised traits. Currently, the order Chiroptera contains over 1,450 species within 21 families and spans ca. 65 million years of evolution. To date, 194 Neotropical bat species (ca. 13% of the total number of species around the world) have been recorded in Central America. This study includes qualitative and quantitative macromorphological descriptions of the brains of 12 species from six families of Neotropical bats. These analyses, which include histological neuronal staining of two species from different families (Phyllostomus hastatus and Saccopteryx bilineata), show substantial diversity in brain macromorphology including brain shape and size, exposure of mesencephalic regions, and cortical and cerebellar fissure depth. Brain macromorphology can in part be explained by phylogeny as species within the same family are more similar to each other. However, macromorphology cannot be explained by evolutionary time alone as brain differences between some phyllostomid bats are larger than between species from the family Emballonuridae despite being of comparable diverging distances in the phylogenetic tree. This suggests that faster evolutionary changes in brain morphology occurred in phyllostomids — although a larger number of species needs to be studied to confirm this. Our results show the rich diversity in brain morphology that bats provide for comparative and evolutionary studies.

Abstract

We present a reference genome assembly from an individual male Rhynchonycteris naso (Chordata; Mammalia; Chiroptera; Emballonuridae). The genome sequence is 2.46 Gb in span. The majority of the assembly is scaffolded into 22 chromosomal pseudomolecules, with the Y sex chromosome assembled.

Abstract

Language is supported by a distributed network of brain regions with a particular contribution from the left hemisphere. A multi-level understanding of this network requires studying the genetic architecture of its functional connectivity and hemispheric asymmetry. We used resting state functional imaging data from 29,681 participants from the UK Biobank to measure functional connectivity between 18 left-hemisphere regions implicated in multimodal sentence-level processing, as well as their homotopic regions in the right-hemisphere, and interhemispheric connections. Multivariate genome-wide association analysis of this total network, based on common genetic variants (with population frequencies above 1%), identified 14 loci associated with network functional connectivity. Three of these loci were also associated with hemispheric differences of intrahemispheric connectivity. Polygenic dispositions to lower language-related abilities, dyslexia and left-handedness were associated with generally reduced leftward asymmetry of functional connectivity, but with some trait- and connection-specific exceptions. Exome-wide association analysis based on rare, protein-altering variants (frequencies < 1%) suggested 7 additional genes. These findings shed new light on the genetic contributions to language network connectivity and its asymmetry based on both common and rare genetic variants, and reveal genetic links to language-related traits and hemispheric dominance for hand preference.

Abstract

In recent years, brain research has indisputably entered a new epoch, driven by substantial methodological advances and digitally enabled data integration and modelling at multiple scales—from molecules to the whole brain. Major advances are emerging at the intersection of neuroscience with technology and computing. This new science of the brain combines high-quality research, data integration across multiple scales, a new culture of multidisciplinary large-scale collaboration, and translation into applications. As pioneered in Europe’s Human Brain Project (HBP), a systematic approach will be essential for meeting the coming decade’s pressing medical and technological challenges. The aims of this paper are to: develop a concept for the coming decade of digital brain research, discuss this new concept with the research community at large, identify points of convergence, and derive therefrom scientific common goals; provide a scientific framework for the current and future development of EBRAINS, a research infrastructure resulting from the HBP’s work; inform and engage stakeholders, funding organisations and research institutions regarding future digital brain research; identify and address the transformational potential of comprehensive brain models for artificial intelligence, including machine learning and deep learning; outline a collaborative approach that integrates reflection, dialogues, and societal engagement on ethical and societal opportunities and challenges as part of future neuroscience research.

Abstract

Interhemispheric anatomical asymmetries have long been thought to be related to language lateralisation. Previous studies have explored whether asymmetries in the diffusion characteristics of white matter language tracts are consistent with language lateralisation. These studies, typically with smaller cohorts, yielded mixed results. This study investigated whether connectomic analysis of quantitative anisotropy (QA) and shape features of white matter tracts across the whole brain are associated with language lateralisation. We analysed 1040 healthy individuals from the Human Connectome Project database. Hemispheric language dominance for each participant was quantified using a laterality quotient (LQ) derived from fMRI activation in regions of interest (ROIs) associated with a language comprehension task compared against a math task. A linear regression model was used to examine the relationship between structural asymmetry and functional lateralisation. Connectometry revealed that LQs were significantly negatively correlated with QA of corpus callosum tracts, including forceps minor, body, tapetum, and forceps major, indicating that reduced language dominance (more bilateral language representation) is associated with increased QA in these regions. The QA of the left arcuate fasciculus, cingulum, and right cerebellar tracts was positively associated with LQ, suggesting that stronger structural asymmetry in these tracts may identify left language dominance. Language lateralisation was not significantly associated with the shape metrics (including length, span, curl, elongation, diameter, volume, and surface area) of all white matter tracts. These results suggest that diffusion measures of microstructural architecture, and not the geometric features of reconstructed white matter tracts, are associated with lateralisation of language comprehension functions. People with increased dependence on both cerebral hemispheres for language processing may have more developed commissural fibres, which may support more efficient interhemispheric communication.

Abstract

When perceiving the world around us, we are constantly integrating pieces of information. The integrated experience consists of more than just the sum of its parts. For example, visual scenes are defined by a collection of objects as well as the spatial relations amongst them and sentence meaning is computed based on individual word semantic but also syntactic configuration. Having quantitative models of such integrated representations can help evaluate cognitive models of both language and scene perception. Here, we focus on language, and use a behavioral measure of perceived similarity as an approximation of integrated meaning representations. We collected similarity judgments of 200 subjects rating nouns or transitive sentences through an online multiple arrangement task. We find that perceived similarity between sentences is most strongly modulated by the semantic action category of the main verb. In addition, we show how non-negative matrix factorization of similarity judgment data can reveal multiple underlying dimensions reflecting both semantic as well as relational role information. Finally, we provide an example of how similarity judgments on sentence stimuli can serve as a point of comparison for artificial neural networks models (ANNs) by comparing our behavioral data against sentence similarity extracted from three state-of-the-art ANNs. Overall, our method combining the multiple arrangement task on sentence stimuli with matrix factorization can capture relational information emerging from integration of multiple words in a sentence even in the presence of strong focus on the verb.

Abstract

Recent artificial neural networks that process natural language achieve unprecedented performance in tasks requiring sentence-level understanding. As such, they could be interesting models of the integration of linguistic information in the human brain. We review works that compare these artificial language models with human brain activity and we assess the extent to which this approach has improved our understanding of the neural processes involved in natural language comprehension. Two main results emerge. First, the neural representation of word meaning aligns with the context-dependent, dense word vectors used by the artificial neural networks. Second, the processing hierarchy that emerges within artificial neural networks broadly matches the brain, but is surprisingly inconsistent across studies. We discuss current challenges in establishing artificial neural networks as process models of natural language comprehension. We suggest exploiting the highly structured representational geometry of artificial neural networks when mapping representations to brain data.

Abstract

With a long-term aim of empowering researchers everywhere to contribute to work on language development, we organized the First Truly Global /L+/ International Summer/ Winter School on Language Acquisition, a free 5-day virtual school for early career researchers. In this paper, we describe the school, our experience organizing it, and lessons learned. The school had a diverse organizer team, composed of 26 researchers (17 from under represented areas: Subsaharan Africa, South and Southeast Asia, and Central and South America); and a diverse volunteer team, with a total of 95 volunteers from 35 different countries, nearly half from under represented areas. This helped world-wide Page 5 of 5 promotion of the school, leading to 958 registrations from 88 different countries, with 300 registrants (based in 63 countries, 80% from under represented areas) selected to participate in the synchronous aspects of the event. The school employed asynchronous (pre-recorded lectures, which were close-captioned) and synchronous elements (e.g., discussions to place the recorded lectures into participants' context; networking events) across three time zones. A post-school questionnaire revealed that 99% of participants enjoyed taking part in the school. Not with standing these positive quantitative outcomes, qualitative comments suggested we fell short in several areas, including the geographic diversity among lecturers and greater customization of contents to the participants’ contexts. Although much remains to be done to promote inclusivity in linguistic research, we hope our school will contribute to empowering researchers to investigate and publish on language acquisition in their home languages, to eventually result in more representative theories and empirical generalizations

Abstract

Traditionally, the frontotemporal arcuate fasciculus (AF) is viewed as a single entity in anatomo-clinical models. However, it is unclear if distinct cortical origin and termination patterns within this bundle correspond to specific language functions. We use track-weighted dynamic functional connectivity, a hybrid imaging technique, to study the AF structure and function in two distinct datasets of healthy subjects. Here we show that the AF can be subdivided based on dynamic changes in functional connectivity at the streamline endpoints. An unsupervised parcellation algorithm reveals spatially segregated subunits, which are then functionally quantified through meta-analysis. This approach identifies three distinct clusters within the AF - ventral, middle, and dorsal frontotemporal AF - each linked to different frontal and temporal termination regions and likely involved in various language production and comprehension aspects. Our findings may have relevant implications for the understanding of the functional anatomy of the AF as well as its contribution to linguistic and non-linguistic functions.

Abstract

Previous studies, using the Continuous Flash Suppression (CFS) paradigm, observed that (Western) university students are better able to detect otherwise invisible pictures of objects when they are presented with the corresponding spoken word shortly before the picture appears. Here we attempted to replicate this effect with non-Western university students in Goa (India). A second aim was to explore the performance of (non-Western) meditators practicing Sudarshan Kriya Yoga in Goa in the same task. Some previous literature suggests that meditators may excel in some tasks that tap visual attention, for example by exercising better endogenous and exogenous control of visual awareness than non-meditators. The present study replicated the finding that congruent spoken cue words lead to significantly higher detection sensitivity than incongruent cue words in non-Western university students. Our exploratory meditator group also showed this detection effect but both frequentist and Bayesian analyses suggest that the practice of meditation did not modulate it. Overall, our results provide further support for the notion that spoken words can activate low-level category-specific visual features that boost the basic capacity to detect the presence of a visual stimulus that has those features. Further research is required to conclusively test whether meditation can modulate visual detection abilities in CFS and similar tasks.