Publications

Abstract

The emergence of linguistic structure is shaped by interaction and cultural transmission as well as cognitive biases and social conventions. An important aspect of linguistic structure is reference distinction or “who did what to whom.” This paper explores how cross-cultural differences in the conceptualization of space may influence the development of strategies for referent distinction in this domain. We conducted a silent gesture experiment employing dyadic interaction and iterated learning with participants from two cultural groups that differ in their predominant conceptualization of space: Balinese and Dutch. Focusing on silent gestures produced by hearing participants naïve to sign languages, we examined the effect of culturally embedded biases on the use of space and body, the resources of manual communication. Our findings reveal the emergence of various strategies that are equally successful but differ in their use of space and body. While the Dutch participants developed multiple different strategy types, the Balinese largely followed one strategy type. Crucially, they did not employ an abstract or grammaticalized conception of space. We argue that, rather than reflecting a developmental shift, this pattern stems from the geocentric conceptualization predominant in Balinese culture that inhibits grammatical use of space and favors alternative strategies, such as capitalizing on the iconic affordances of the body to represent grammatical relationships. Our findings thus provide evidence for how cultural conventions such as the conceptualization of space can influence the evolution of linguistic structure.

Abstract

Cognitive control supports flexible goal maintenance and conflict resolution. Although bilingual experience has been proposed to enhance its efficiency through sustained language control, emerging evidence suggests these effects reflect adaptive recalibration driven by individual language use rather than domain-general transfer. Here we examined how individual differences in bilingual experience modulate behavioral and neural indices of adaptive attentional control during conflict processing, as indexed by an adaptive Flanker task. Fifty participants (M = 19.6 years) completed the Language and Social Background Questionnaire and an electroencephalography adaptive Flanker task. Event-related potentials in the N100, N200 and P300 windows indexed attentional allocation, conflict detection, and monitoring. Behaviorally, participants showed the expected Flanker interference effect, with no modulation by bilingual experience. In contrast, greater Non-English Social Use, but not overall bilingualism or home use, was associated with attenuated N100s and N200s, suggesting reduced early attentional demands. These neural effects, in the absence of behavioral differences, suggest experience-dependent efficiency in control recruitment rather than enhanced control.

Abstract

In this paper, we present a controlled comparative study of storytelling delivered by a virtual robot (virtual agent) and a physically embodied robot, with oral human narration serving as the baseline. The storytelling conditions for both artificial agents (virtual and robotic) were implemented using the Furhat robot platform. A bilingual large language model (LLM)-based interactive storytelling system was developed to enable emotionally expressive narration and structured interaction within a unified experimental environment. To evaluate usability and user preferences, engagement, emotional connection, social presence, and narrative comprehension were compared across the two modalities. Quantitative analysis using paired-samples t-tests revealed significant differences between the virtual and physically embodied robotic systems. Results from a user study with N=20 participants demonstrate a substantial increase in perceived engagement and overall experience with the physically embodied robot compared to the virtual agent in narrative-based human-robot interaction. These findings provide empirical insights for the design of socially intelligent storytelling systems that integrate LLM-driven dialogue capabilities.

Abstract

A central challenge in systems neuroscience is to understand how distributed brain networks organize activity during naturalistic cognition. Here, we investigate whether transient, high-amplitude bursts of high-gamma activity, referred to as neuronal avalanches, provide a compact and functionally informative description of large-scale neural dynamics during auditory processing. Using intracranial stereotactic intracranial electroencephalography (sEEG) recordings from epileptic patients, we analyzed brain activity during speech listening, music listening, and rest. We show that high-amplitude bursts, defined as the top 1% of high-gamma activations, are strongly stimulus-driven: they synchronize across participants exposed to the same auditory input, exhibit condition-specific spatial topographies, and display distinct propagation patterns across cortical networks. Notably, although these events represent only a small fraction of the signal, they preserve substantial stimulus-related information. Temporal response function analyses reveal that avalanche activity reliably encodes both speech and music stimuli, even under extreme data sparsification. Together, these findings demonstrate that neuronal avalanches capture stimulus-relevant, large-scale neural dynamics and provide a computationally efficient framework for studying cognition in naturalistic settings.

Abstract

Sensory feedback is essential for the fine-tuning of motor actions, and speech production is no exception. It depends on continuous self-monitoring to ensure that produced sounds match intended targets. Delaying auditory feedback (DAF) disrupts this alignment and impairs fluency, providing a powerful tool to investigate sensorimotor control. We combined functional and diffusion-weighted MRI in 31 participants performing a word-production task under delayed (DAF) and immediate (no-DAF) auditory feedback. While all participants slowed their speech under DAF, the extent of this effect varied across individuals and was quantified using a susceptibility index. At the group level, DAF > no-DAF elicited increased activation in a right-lateralized network encompassing the superior temporal gyrus, supramarginal gyrus, inferior frontal gyrus, supplementary motor area, and left cerebellum. Incorporating individual differences revealed that higher susceptibility was associated with greater activation in left-hemisphere speech motor homologues and larger volume of the right long segment of the arcuate fasciculus, a whitematter pathway connecting auditory and motor speech regions. This pattern suggests that susceptibility reflects increased recruitment of neural resources and a stronger reliance on auditory-motor coupling. In contrast, resilience was associated with greater engagement of the bilateral angular gyrus and higher fiber density in the right posterior AF, which connects auditory and somatosensory speech regions. This finding indicates that resilience is supported by a posterior temporo-parietal circuit that efficiently integrates multimodal sensory feedback. Together, these findings link functional dynamics with underlying structural connectivity to reveal how a right-lateralized network supports speech control, while accounting for individual differences in susceptibility to fluency disruption.

Abstract

Speakers sometimes produce lexical errors, such as saying “salt” instead of “pepper.” This study aimed to better understand the origin of lexical errors by assessing whether they arise from a hasty selection and premature decision to speak (premature selection hypothesis) or from momentary attentional disengagement from the task (attentional lapse hypothesis). We analyzed data from a speeded picture naming task (Lampe et al., 2023) and investigated whether lexical errors are produced as fast as target (i.e., correct) responses, thus arising from premature selection, or whether they are produced more slowly than target responses, thus arising from lapses of attention. Using ex-Gaussian analyses, we found that lexical errors were slower than targets in the tail, but not in the normal part of the response time distribution, with the tail effect primarily resulting from errors that were not coordinates, that is, members of the target’s semantic category. Moreover, we compared the coordinate errors and target responses in terms of their word-intrinsic properties and found that they were overall more frequent, shorter, and acquired earlier than targets. Given the present findings, we conclude that coordinate errors occur due to a premature selection but in the context of intact attentional control, following the same lexical constraints as targets, while other errors, given the variability in their nature, may vary in their origin, with one potential source being lapses of attention.

Abstract

This article reports on a research project that we built around a dance theatre work to (1) bring bodily affectivity concerning the Dutch colonial slavery past into focal awareness; (2) survey the entanglement of mind, body, and world; and (3) explore dance/movement arts’ potential as ‘social medicine’. Farida Nabibaks’ Margaretha brings together a Euro-Western and an Africana (African and African-Caribbean diaspora) lineage of dance practice and philosophy. Performed at Castle Cannenburch (Gelderland) and combined with a guided movement workshop, the performance and accompanying exercises generated an understanding among the recruited volunteer participants of how the colonial past endures within bodies while creating a sense of what healing might feel like through attention to the body and bodily affectivity. Facilitating the exploration of the incorporations and (bodily) manifestations of a traumatic historical past, dance/movement arts, we submit, is a dynamic of shared enactment that may assist in healing the colonial wound.

Abstract

Languages are complex adaptive systems that culturally evolve under different pressures and conditions. Social structure, and in particular population size, network connectivity, and heterogeneity, play an important role in shaping human language across multiple levels of analysis. These factors impact evolutionary and communicative dynamics such as the degree of variability versus uniformity in the linguistic community, and the rate at which innovations spread and languages change. They also influence the very structure of languages by shaping the degree of systematicity and transparency of grammars. Synthesizing observational, experimental, and computational approaches, we shed light on the complex relationship between language evolution and network structure.

Abstract

Language is often regarded as a defining trait of our species, but what are its core properties? In 1960, Hockett published ‘The origin of speech’ enumerating 13 design features presumed to be common to all languages, and which, taken together, separate language from other communication systems. Here. we review which features still hold true in light of new evidence from cognitive science, linguistics, animal cognition, and anthropology, and demonstrate how a revised understanding of language highlights three core aspects: that language is inherently multimodal and semiotically diverse; that it functions as a tool for semantic, pragmatic, and social inference, as well as facilitating categorization; and that the processes of interaction and transmission give rise to central design features of language.

Abstract

Little is known about how or when language and visuospatial processing lateralise in the brain, and if individual differences in lateralisation are related to early language or visuospatial abilities. We explored if patterns of language and visuospatial lateralisation are related to cognitive skills in young children. A large sample of 3-year-olds (n = 136) attempted two functional transcranial Doppler ultrasound (fTCD) tasks to estimate language and visuospatial lateralisation. At the group level, language was lateralised to the left hemisphere, but visuospatial processing was weakly lateralised to the right hemisphere. The relationship between patterns of lateralisation and cognitive skills was investigated using regression analyses with novel calculations of how typical a child’s lateralisation pattern was, the degree of crowding of both functions to one hemisphere, or how strongly both functions were lateralised. Language and visuospatial abilities were not predicted by any of these measures. Degree of visuospatial lateralisation, and not language lateralisation, was associated with higher language ability. Future research should investigate if patterns of lateralisation are related to cognitive skills in older children, when lateralisation is more established.

Abstract

Vocal individuality has important biological functions in mammals: at crucial stages of development, it ensures feeding and is a prerequisite for auditory-based mother–pup recognition. Is vocal individuality only shaped by maturation or also by the degree of conspecific acoustic input? Here, we test how the neonatal auditory environment shapes development and individualization of calls in harbour seal pups (Phoca vitulina). To simulate low- versus high-conspecific acoustic density, 18 pups heard playbacks of calls from either 2 or 30 conspecifics. We recorded calls before and after playback exposure and extracted 12 acoustic parameters. Supervised machine learning and discriminant function analyses showed greater individual distinctiveness in both groups after playback, indicating a developmental trend toward individualization. Notably, pups exposed to less-variable input showed higher individuality. Euclidean distances on call parameters showed that both groups diverged from the playback signals. Distances on within-pup and between-pups housed together revealed opposite trajectories in the two groups: after the exposure, less-variable auditory input determined steadier individual calls, while more-variable auditory input scattered calls across the acoustic space. Altogether, our findings indicate that auditory input modulates vocal development in pups, making harbour seals a promising model for unravelling how neonatal environment affects vocal plasticity in a non-human mammal.

Abstract

* = Joint first authorship I risultati evidenziano l’utilità e l’adattabilità dei materiali nella pratica clinica logopedica (con alcune differenze in funzione del setting di impiego e della popolazione coinvolta) e incoraggia la prosecuzione del progetto e l’implementazione dei materiali, con l’obiettivo di favorire la partecipazione sociale delle PcA.

Abstract

This study examines actions that are not directly articulated by speakers but are nonetheless oriented to by participants. Specifically, we examine situations in which a speaker is launching a request project, approaching a request indirectly, with a preliminary, or with further “upstream work,” but without ever making an actual request. Prior literature has argued that indirectness and preliminaries afford speakers with deniability and thus allow them to avoid accountability for requesting. We argue that, although these ways of approaching and projecting a request create greater opportunities for alignment and affiliation, they do not allow speakers to evade accountability. Data are in English and Italian.

Abstract

Bilingualism research sits at the intersection of linguistics, cognitive neuroscience, and psychology, yet these disciplines often operate in relative isolation, limiting explanatory power and theoretical progress. This paper argues that deeper, more purposeful cross-fertilization among these fields is both possible and necessary to address some of the most pressing questions in the study of bilingualism. After establishing a shared foundation through a concise history of mind–brain–language inquiry, we outline the componential architecture of language — spanning phonology, syntax, morphology, semantics, and pragmatics — to underscore the linguistic sophistication required for meaningful neuroscientific investigation. We then review the neuroanatomical substrates of language representation, processing, and cognitive control, emphasizing distributed network models over classical localizationist accounts. The contribution of electroencephalography (EEG) is examined, including event-related potentials, oscillatory dynamics, and resting-state measures, highlighting their capacity to capture how bilingual experience reshapes linguistic processing and neural function over time and at the individual level. Two exemplars operationalize our convergence argument. Exemplar 1 demonstrates how early brain states measured via EEG can predict individual differences in bilingual linguistic developmental trajectories, offering prospective, mechanistic insights that retrospective adult studies cannot. Exemplar 2 illustrates how linguistically principled formalization of relative linguistic typological distance (RLTD) is indispensable for studies seeking to link cross-language structural differences to bilingualism-induced neurocognitive adaptations. Together, these cases show that linguistics needs neuroscience to ground its constructs in neural mechanisms, while neuroscience needs linguistics to properly characterize what is being processed. Genuine interdisciplinary integration, not parallel inquiry, is the path forward for bilingualism research.

Abstract

Explaining how children build a language system is a central goal of research in language acquisition, with broad implications for language evolution, adult language processing, and artificial intelligence (AI). Here, we propose a constructivist framework for future theory-building in language acquisition. We describe four components of constructivism, drawing on wide-ranging evidence to argue that theories based on these components will be well suited to explaining developmental change. We show how adopting a constructivist framework both provides plausible answers to old questions (e.g., how children build linguistic representations from their input) and generates new questions (e.g., how children adapt to the affordances provided by different cultures and languages).

Abstract

Our goal in this chapter was to test a usage-based computational model of vocabulary learning (CLASSIC). CLASSIC simulates variation in vocabulary growth as a product of interactions between linguistic input quantity and the child’s current knowledge state, using an associative learning mechanism with a fixed capacity limited processing window. We directly compared the model’s results to those from children taking part in a number of empirical tasks and showed that, simply by varying the amount of input received by the model, we can successfully simulate a number of effects that we see in the children’s performance: individual differences in the rate of vocabulary growth between 19 and 30 months of age; correlations between vocabulary size, familiar word processing speed (as measured by Looking-While-Listening tasks) and phonological working memory capacity (as measured by non-word repetition tasks), and the effect of processing speed and non-word repetition performance on subsequent vocabulary growth. The results suggest that exposure to linguistic input, read through a fixed capacity processing constraint, leads learners to store phonological knowledge in chunks of information of varying size, and it is this stored knowledge that, at least partially, determines familiar word processing speed, non-word repetition performance, and vocabulary growth.

Abstract

Common ground is the information that the participants in a conversation treat as background information for the purposes of their interaction. We review two traditions of research on common ground. The formal tradition, consisting mainly of theoretical linguists and philosophers of language, has developed increasingly sophisticated formal models of common ground to generate predictions about an expanding range of empirical phenomena. Meanwhile, the psycholinguistic tradition has focused on a narrower range of phenomena while developing more realistic theories of the psychological mechanisms that allow us to select and represent common ground. After summarizing these two traditions, we consider several reasons why they should be reintegrated, and we argue that the best way to bring them back together would be to adopt a cognitive-pluralist approach, whereby language users have access to a variety of mechanisms for managing background information, which are more or less available and efficient depending on the communicative situation and the kind of information mentally represented as well as the cognitive demands of each mechanism.

Abstract

All languages in the world have demonstrative terms such as ‘this’ and ‘that’ in English, which have traditionally been treated as spatial words. Here we aim to provide experimental evidence that demonstrative choice is jointly determined by spatial considerations (e.g., whether the referent is near or far) and socio-cognitive factors (e.g.,the listener’s attention focus). We also test whether demonstrative choice varies depending on the speaker’s use of pointing, to provide evidence for a multimodal account of demonstrative systems. We focus on the Turkish system and compare it with the Spanish one to better understand the cross-linguistic variability of 3-term demonstrative systems. Corpus studies have suggested that the Turkish proximal ‘bu’ and distal ‘o’ mark a spatial contrast between near and far space, whereas the medial ‘s¸u’ is used to direct the listener’s attention to a new referent. Supporting this analysis, an online experiment using a picture-based demonstrative-choice task revealed that the medial form ‘s¸u’ was preferred when the listener was looking at the wrong object. The results of a second experiment using video stimuli further showed that the medial ‘s¸u’ was preferred when the speaker pointed to the referent to direct the listener’s attention, whereas the proximal demonstrative was used in near space and the distal in far space, mostly in joint attention and without pointing. The results of a third experiment in Spanish showed radically different patterns of demonstrative-pointing use. The medial ‘ese’ was preferred in joint attention, whereas the proximal ‘este’ and distal ‘aquel’ were selected to direct the listener’s attention towards the intended referent but without an effect of pointing. Our results confirm that demonstrative choice within a given system is determined by both spatial and socio-cognitive factors, interacting with pointing patterns and varying across languages. Leveraging recent experimental work in several languages, we interpret these findings as further evidence for the weighted parameters framework (e.g., referent position and listener attention), which explains demonstrative choice beyond previous categorical analyses.

Abstract

In challenging the common ground theory of speech acts, Levinson poses a further, cognitive challenge: How can interlocutors keep track of all the conversa- tional elements that must be stored in common ground, given the taxing demands of producing and understanding language in the naturally fast pace of conversation? In response to this challenge, I propose to adopt a cognitive-pluralist approach to common ground, which I illustrate with three pragmatic phenomena that require more or less effi cient mechanisms for epistemic reasoning.

Abstract

The study of great ape cognition offers insights into the evolutionary origins of human intelligence, but is hindered by small sample sizes and restricted access to data. To address this, we present the EVApeCognition Dataset, a publicly available resource comprising 262 experimental datasets from 150 scientific publications from the Wolfgang Köhler Primate Research Center (2004–2021) in Leipzig, Germany. Eighty-one apes participated in 150 studies, with a majority (N = 78) participating in more than one study. Publication of the dataset aims to make these unique datasets accessible for future meta-analyses and correlational analyses, helping us better understand how our great ape relatives think, learn, and behave.

Abstract

Joint attention (JA), the shared focus between a caregiver and their child on an object or event, has been shown to be crucial for language development and other early cognitive processes. However, JA research is often only measured in cross-sectional samples, which do not allow the differentiation between intra- and inter-individual differences. In addition, most studies focus on narrow participant groups, and sign language users represent one understudied group. However, signers offer a particularly valuable perspective for JA research, as the use of a visual-manual language may uniquely influence gaze and JA. This longitudinal study investigates the developmental trajectory of gaze and multimodal JA behaviours in seven native signing deaf-caregiver-hearing-child dyads between 12 and 24 months of child age during naturalistic interactions. Results show that while gaze and general JA properties remain stable across the second year of life, significant changes emerge in how children initiate JA. Over time, the native signing children in this study increasingly take on an active role in their interactions, being more frequently and more successfully initiators of JA and exploring different multimodal behaviours. These findings suggest that modality-specific experiences may shape developmental pathways and emphasise the importance of studying JA in diverse populations. Further longitudinal research is needed to disentangle the effect of language modality and individual differences in JA development.

Abstract

Despite decades of research, we still know less than we would like about the association between joint attention (JA) and language acquisition. One reason for this is that we still have not agreed how to define, operationalize, and measure joint attention. The goal of this study is to examine the impact of applying two different joint attention operationalization schemes—reflecting distinct theoretical perspectives—to the same dataset of video-recordings of semi-naturalistic toy-play interactions between 12-month-old children and their caregivers (N = 39). We identified joint attention around relevant naming events to determine how these choices affect interpretations of the role of joint attention in vocabulary acquisition. We compared a gaze-based coding scheme, consistent with associative accounts of joint attention, with a socially coordinated joint attention coding scheme, based on social-pragmatic theories that require, in addition to gaze overlap, evidence of shared awareness. We then extracted two measures from each scheme: average joint attention event duration and the temporal overlap between joint attention events and naming events (JA overlap). We found that while measures of joint attention were predictive of later expressive vocabulary above and beyond language-based measures in both coding schemes, model comparison based on AIC/BIC indicated that joint attention defined as coordinated JA was preferred over joint attention defined as gaze overlap. Furthermore, the best fitting model predicting later vocabulary favored predictors based on the coordinated JA scheme. Our results suggest that a social operationalization of joint attention leads to better predictors of later vocabulary size than a gaze-based operationalization of joint attention. In addition, the current study emphasizes the critical role of methodological choices in understanding how and why joint attention is associated with vocabulary size.

Abstract

The human brain is thought to constantly predict future words during language processing. Recently, a new approach emerged that aims to capture neural prediction directly by using vector representations of words (embeddings) to predict brain activity prior to word onset. Two findings have been proposed as hallmarks of neural next-word prediction: (i) significant encoding prior to word onset and (ii) its modulation by word predictability. However, natural language is rife with temporal correlations, where upcoming words share statistical information with preceding ones. This raises a critical question: do these these hallmarks emerge from the brain actively predicting future content, or might they be equally well explained by the regression model exploiting these inherent stimulus dependencies? To distinguish between these alternatives, we applied the same encoding analysis to passive control systems, i.e., representational systems that encode the stimulus but cannot predict upcoming words. We show that both hallmarks emerge in two such control systems, namely in word embeddings themselves and in speech acoustics. We further show that proposed methods to correct for these dependencies are insufficient, as the effects persist even after such corrections. Together, these results suggests that pre-onset prediction of brain activity might reflect dependencies in natural language rather than predictive computations. This questions the extent to which this new encoding-based method can be used to study prediction in the brain.

Abstract

Autistic individuals often show differential sensory perception, including hypo- or hypersensitivities to sound. Previous research also suggests that autistic individuals often have difficulty processing intentional and affective cues in speech acoustics. However, general speech processing difficulties remain underexplored. We investigated self-reported auditory perception using the Speech, Spatial, and Qualities of Hearing Questionnaire among autistic (self-identifying (n = 18) and clinically diagnosed (n = 45)) and non-autistic adults (N = 66). The study was conducted in the Netherlands, but the questionnaire and call for participation were in English and open to anyone regardless of country of residence. Both clinically diagnosed and self-identifying individuals with autism reported significantly lower scores on the Speech, Spatial, and Qualities of Hearing Questionnaire score and on the Speech subscale compared with non-autistic individuals, indicating challenges in overall quality of auditory perception, speech comprehension. Clinically diagnosed individuals also showed lower scores on the quality and spatial subscales compared with non-autistic individuals. Post hoc analysis further suggested that speech hearing is particularly challenging for many autistic individuals. In addition, our finding that self-identifying and clinically diagnosed autistic individuals show similar patterns of hearing difficulties emphasizes the need for more inclusive research practices that collect the experiences of all the individuals in the autistic community in the study of sensory perception in autism.

Abstract

Language comprehension requires the integration of information from a wide variety of sources, including sensory input and memory. The present study contributes to a growing literature examining how probability and uncertainty shape language comprehension in close collaboration with grammatical knowledge, wherein the specifics of when and how these sources of information come together during sentence processing remain opaque. Here we asked how morphosyntax and lexical surprisal impact subject-verb agreement in Dutch: an online self-paced reading experiment tested whether lexical surprisal affects the use of grammatical information. Using a combination of model-comparison and permutation testing, we showed that reading times cannot be explained by a dichotomous interactive, nor by a purely additive account. While both factors must be modeled in order to best describe reading time data, the data provided evidence that lexical surprisal is leveraged more reliably when the constraints placed by the grammar are obeyed. We propose a novel “structure bottleneck”, where the use of probabilistic cues is conditionalized on grammatical status of a subject-verb agreement relation. Viewed in the context of previous findings, the results are consistent with an account of language comprehension wherein grammatical and contextual probabilistic cues are weighted based on their reliability.

Abstract

Quantifiers specify semantic relations between sentence constituents. Due to their abstract meanings, they form a learning challenge for children. This challenge is made more difficult by the fact that different universal quantifiers instantiate slightly different meanings. We investigated what evidence is available in the input that might help children learn the meaning of universal quantifiers by exploring the use of these words in naturalistic child-ambient language in English and Dutch. The cross-linguistic component in this analysis is relevant because languages differ in how they carve up the space of universal quantification. Our analysis revealed language- and quantifier-specific patterns in frequency, variability, and contexts of use. We discuss how these quantifier-specific usage patterns lead to quantifier-specific developmental trajectories and challenges.

Abstract

Simultaneous constructions present a unique linguistic property in sign languages where multiple body articulators (hands, torso, head, facial expression, and eye gaze) are used to structure linguistic information not only linearly, as is done in speech, but also simultaneously. Simultaneous constructions allow a more direct encoding of scenes and events by using various iconic strategies to depict multiple event elements (e.g. referents and their actions), their spatial relations and temporal overlap, mirroring how they are perceived in the world; that is, simultaneously. The chapter provides an overview of how iconicity is operationalized in simultaneous constructions and the methods used to study their function, and discusses the history and future directions of the study of iconicity as a structuring principle in sign languages.

Abstract

According to relevance theory, communication relies on speakers’ ability to signal relevant information, which addressees use to infer meaning efficiently. Most research within the relevance theoretic framework has examined how relevance is marked in speech, treating it as the primary channel for signaling informative content. Yet, little is known about whether, how, and in what contexts speakers highlight information in co-speech gestures. Here, we investigate how speakers use ostensive cues—specifically, visual and verbal deixis (e.g. gaze toward a gesture, demonstratives like “this,” “that,” or “here”)—to highlight the communicative relevance of iconic gestures in child- versus adult-directed communication and whether addressees show sensitivity to these cues. Sixteen Italian adults explained the rules of two logic puzzles to a child and another adult. Results show that speakers highlight more gestures for children than for adults, primarily by using visual deixis. Furthermore, addressees of both age groups, adults and children, were more likely to shift their gaze to highlighted than to non-highlighted gestures. These findings demonstrate that speakers dynamically adapt multimodal cues to highlight iconic gestures for addressees, providing empirical support for extending relevance theory to a multimodal view of language.

Abstract

Gaze is a key non-verbal cue in face-to-face interaction, yet we know relatively little about how people visually explore a robot’s face during conversation. In human-human interactions (HHI), gaze allocation is shaped by conversational role and task demands: speakers typically avert their gaze from their partner’s face more than listeners do, and listeners often shift gaze from the eyes to the mouth to support speech understanding. In human-robot interactions (HRI), it is often implicitly assumed that gaze to humanoid robots follows similar patterns, but this has rarely been tested quantitatively at the level of specific facial regions. In this late-breaking report, we report a secondary analysis of an existing HRI dataset with usable eye-tracking data from 31 participants who took part in semi-structured interviews with a social robot (Furhat). Using MediaPipe Face Mesh on participant’s egocentric video from eye tracking glasses, we segmented the robot’s face into eye, mouth, and full-face regions of interest (ROI), and quantified how participants distributed their gaze at each ROI over the entire interaction, and separately for speaking and listening. Participants spent most of the interaction looking at the robot’s face; within the face, the eyes and mouth were the main targets, and gaze to these regions increased during listening, especially for the mouth. This pattern aligns with the central findings from HHI and offers empirical evidence for assumed similarities in gaze allocation between HHI and HRI. In an exploratory analysis, we additionally examined how the robot’s own gaze behaviour, with or without human-like gaze aversions, shaped gaze to the eyes and mouth. We discuss how these findings inform the interpretation of gaze as an implicit engagement cue in HRI. Finally, we provide baseline references and show how ROI-based analyses can enrich future gaze studies in HRI.

Abstract

Children are active learners: They selectively attend to important information. Rhythmic neural tracking of speech is central to active language learning. This chapter evaluates recent research showing that neural oscillations in the infant brain synchronize with the rhythm of speech, tracking it at different frequencies. This process predicts word segmentation and later language abilities. We argue that rhythmic neural speech tracking reflects infants’ attention to specific parts of the speech signal (e.g., stressed syllables), and simultaneously acts as a core mechanism for maximizing temporal attention onto those parts. Rhythmic neural tracking of speech puts a constraint on neural processing, which maximizes the uptake of relevant information from the noisy multimodal environment. We hypothesize this to be influenced by neural maturation. We end by evaluating the implications of this proposal for language acquisition research, and discuss how differences in neural maturation relate to variance in language development in autism.

Abstract

Language neuroscience has historically relied on highly controlled experimental paradigms that differ markedly from the conditions of real-world communication. Although such approaches have yielded important insights, they often fail to capture the integrative processes required for discourse and connected language. Here, we treat discourse as language extending beyond a single simple clause and used for a specific purpose. Recent advances in computational modeling, natural language processing, and neurophysiological measurement now make it possible to study language in more naturalistic, temporally extended, and ecologically valid contexts. In this closing editorial for a special issue of Cortex, we synthesize contributions that collectively argue for a discourse-centered neuroscience: the view that the neural basis of language becomes most fully visible when language is studied in its connected, purposeful form. We organize the issue around four broad themes—cortical topography and continuous integration, structural connectivity, large-scale network dynamics, and clinical mapping of language, thought, and interaction—and show how each reveals aspects of language organization that remain difficult to detect in isolated word- and sentence-level paradigms. We conclude by considering the implications of this work for basic and clinical science and by outlining future directions for the neurocognitive study of discourse.

Abstract

Previous studies have evaluated the role of the microRNA-137 (miRNA137) regulatory pathway in schizophrenia by using in silico or in vitro predicted target genes. These approaches do not capture the dynamic spatiotemporal nature of the miRNA137 regulatory pathway or tend to overestimate direct miRNA binding sites. To provide a more accurate representation of the miRNA137 pathway during human brain development, we evaluated the biological functionality of direct ex vivo miRNA137 targets previously documented in the early prenatal and adult brain. We studied the role of differential expression and genetic predisposing variation to schizophrenia and related disorders within these miRNA137 targets by gene set enrichment analyses (GSEA) and gene-set based polygenic score predictions in an independent schizophrenia case-control cohort. All results were compared to those from in silico or in vitro predicted targets. Only direct miRNA137 targets at prenatal and adult human brain displayed significant enrichments in synaptic and neuronal functions and captured the transcriptomic and genetic predisposing variation to schizophrenia. Furthermore, while adult target genes showed a more consistent enrichment in predisposing variation to schizophrenia and bipolar disorder in case/control polygenic models, prenatal target genes predicted negative symptomatology in schizophrenia patients. Our results suggest that using direct, temporally specific miRNA137 targets significantly improved the detection of biological mechanisms underlying its relationship with psychosis, clarified the association between schizophrenia and related conditions, and suggested association with specific symptomatology domains at different developmental stages of the disorder.

Abstract

This study explored kanji handwriting behavior of Vietnamese learners of Japanese as a Foreign Language (JFL), focusing on single-kanji words with Kun-readings to minimize phonological overlap between Japanese and Vietnamese. Participants completed a real-time handwriting task using a stylus and tablet. The study analyzed writing latency, duration, and accuracy, examining how these were influenced by lexical knowledge, kanji frequency, visual complexity, and difficulty level. Results showed that higher lexical proficiency and more frequent kanji led to faster initiation times. Writing duration increased with visual complexity, as kanji with more strokes took longer to execute. Accuracy decreased for complex and difficult kanji (e.g., N2 level), especially among lower proficiency learners. Notably, learners with stronger lexical knowledge could better compensate for complexity during writing. These findings highlight the distinct cognitive and motor demands of kanji production and underscore the value of combining vocabulary exposure with structured handwriting practice in JFL instruction.

Abstract

This study examined the enduring influence of societal Spanish dominance on the indigenous Kaqchikel Mayan heritage language through three experiments with native Kaqchikel speakers. The experiments assessed word production and the processing of transitive and interrogative sentences in both Kaqchikel and Spanish. In Experiment 1, Kaqchikel speakers produced more words in Spanish than in their heritage language, indicating Spanish dominance in lexical access and suggesting a possible shift in language dominance. Given Kaqchikel’s traditional VOS (verb–object–subject) order and Spanish’s predominant SVO (subject–verb–object) order, Experiment 2a showed that in Kaqchikel, SVO sentences were processed with slightly higher accuracy than VOS sentences. In Experiment 2b for Spanish, SVO sentences were processed significantly faster than VOS sentences. Experiment 3 investigated subject (who, SquestVO) and object (whom, OquestVS) questions. In Kaqchikel (Experiment 3a), no significant differences were found in accuracy or reaction time between the two structures. In Spanish (Experiment 3b), SquestVO sentences were processed more accurately and quickly than OquestVS sentences. Overall, Kaqchikel appears to be influenced by Spanish with a general reduction in the VOS advantage and becoming more sensitive to SVO instead. These findings highlight the strong influence of Spanish on language processing among Kaqchikel speakers and reveal clear disparities between the two languages.

Abstract

Recent cognitive neuroscience research has uncovered some similarities and some differences between general semantic memory (GS; e.g., knowledge about family in general) and personal semantic memory (PS; e.g., knowledge about my family in particular). To better understand the representational content and cognitive processes of PS and their relation to general semantics, we adapted a staple of General semantic memory research, the Property Generation task. In a first study, we randomly assigned 240 adult participants to a traditional General semantics perspective (e.g., listing the properties of families and bedrooms in general) or to a PS perspective (e.g., my family, my bedroom) in a between-subjects design. In a second, replication study, 124 participants completed the task in a within-subject design, taking each perspective for different concepts. Relative to the General semantics condition, the PS condition was associated with more features; these were more semantically distant from each other, and included adjectives more frequently and nouns less frequently. However, the two conditions had substantial (~46%) overlap in the frequency of their features. The findings contribute to the identification of the cognitive differences (e.g., semantic richness) and similarities (e.g., correspondence in semantic features) between personal and general semantic memory.

Abstract

Children’s speech becomes longer and more complex as they develop, but the reasons for this have been insufficiently studied. This study examines how changing linguistic choices in children are linked to interactive factors by analysing Who-question sequences in Japanese child–caregiver conversations. The interactive factors in focus are progressivity and balanced joint activity, which are core aspects of conversational interaction. Our analysis reveals that as children respond to Who-questions, their responses grow in length and multifunctionality. This growth is positively associated with progressivity, namely a quicker completion of the question sequence, and reduced functional load in the interlocutor’s contributions, resulting in more balanced joint activity. These findings suggest that children adapt their linguistic choices by observing and aligning them with their interactive goals in conversational sequences.

Abstract

In face-to-face conversation, people convey meaning multimodally, including speech and hand gestures. Previous work showed that comprehenders can use gestures to predict utterance content, but it is unknown how much of a gesture comprehenders need to see for this. Here, we test whether the gesture preparation phase – traditionally deemed to be a mere prelude to the meaning-bearing part of a gesture – does in fact contain semantic information that can be used for prediction. Participants watched videos of speakers from a conversational corpus up to the end of a gesture preparation and predicted how the speaker would continue. Crucially, the preparation was either shown or obscured. Seeing the preparations did not lead to participants more frequently predicting the exact speech of the original utterance, but it did make the meaning of predictions more accurate. This suggests that even early gestural information can contribute to shaping comprehenders’ predictions, which may facilitate rapid conversational turn-taking.

Abstract

How does the brain turn a physical signal like speech into meaning? It draws on two key sources: linguistic structure (e.g., phonemes, syntax) and statistical regularities from experience. Yet how these jointly shape neural representations of language remains unclear. We used MEG to track phonemic and acoustic encoding during spoken language comprehension in native Dutch, Mandarin-Chinese, and Turkish speakers. Phoneme-level encoding is stronger during sentence comprehension than in word lists, and more robust within words than random syllables. Surprisingly, similar encoding emerges even in an uncomprehended language but only with prior exposure. In contrast, acoustic edges are briefly suppressed early in comprehension. This suggests that the brain’s alignment to speech (in phase and power) is robustly tuned by structure and by learned statistical patterns. Our findings show how structured knowledge and experience-based learning interact to shape neural responses to language, offering insight into how the brain processes complex, meaningful signals.

Abstract

Human memory is fleeting. As words are processed, the exact wordforms that make up incoming sentences are rapidly lost. Cognitive scientists have long believed that this limitation of working memory may, paradoxically, help in learning language – an idea supported by classic connectionist modelling work. The rise of Transformers appears to challenge this idea, as these models can learn language effectively, despite lacking working memory limitations or other architectural recency biases. Here, we investigate the hypothesized benefit of fleeting memory for language learning in tightly controlled experiments on transformer language models. Training transformers with and without fleeting memory on a developmentally realistic training set, we find that fleeting memory consistently improves language learning (as quantified by both overall language modelling performance and targeted syntactic evaluation) but, unexpectedly, impairs surprisal-based prediction of human reading times. Interestingly, follow up analyses revealed that this discrepancy – better language modeling, yet worse reading time prediction – could not be accounted for by prior explanations of why better language models sometimes fit human reading time worse. Together, these results support a benefit of memory limitations on neural network language learning – but not on predicting behavior.

Abstract

To navigate in and communicate about the continuous world we experience, our minds segment this experience into discrete event units. Yet, languages differ in how they package core aspects of events into linguistic units. Here, we ask how event units in language and cognition relate to each other, and how this relation might change during language acquisition. To do so, we focus on motion events and compare child and adult speakers of Turkish—a verb-framed language encoding motion events in multiple linguistic units with distinct units for each path segment. In a linguistic task, there were systematic differences in the number of linguistic units used for expressing motion paths when describing events with versus without direction changes in adults and to a lesser extent in 5-year-olds but not in 4-year-olds. In a non-linguistic eye-tracked dwell-time task, both children and adults had similar visual attention profiles for events with and without direction changes. These findings indicate that although linguistic event units become increasingly language-specific with age, cognitive event units remain stable and independent of linguistic encoding. These findings show that people flexibly shift between different levels of granularity when segmenting events in language and cognition. Further, this flexibility seems to emerge in children as young as 4 to 5 years old.

Abstract

Background

Facial emotion processing deficits and atypical eye gaze are often described in individuals with autism spectrum disorder (ASD) and those with conduct disorder (CD) and high callous unemotional (CU) traits. Yet, the underlying neural mechanisms of these deficits are still unclear. The aim of this study was to investigate if eye gaze can partially account for the differences in brain activation in youth with ASD, with CD, and typically developing youth (TD).

Methods

In total, 105 adolescent participants (NCD = 39, NASD = 27, NTD = 39; mean age = 15.59 years) underwent a brain functional imaging session including eye tracking during an implicit emotion processing task while parents/caregivers completed questionnaires. Group differences in gaze behavior (number of fixations to the eye and mouth regions) for different facial expressions (neutral, fearful, angry) presented in the task were investigated using Bayesian analyses. Full-factorial models were used to investigate group differences in brain activation with and without including gaze behavior parameters and focusing on brain regions underlying facial emotion processing (insula, amygdala, and medial prefrontal cortex).

Results

Youth with ASD showed increased fixations on the mouth compared to TD and CD groups. CD participants with high CU traits tended to show fewer fixations to the eye region compared to TD for all emotions. Brain imaging results show higher right anterior insula activation in the ASD compared with the CD group when angry faces were presented. The inclusion of gaze behavior parameters in the model reduced the size of that cluster.

Conclusions

Differences in insula activation may be partially explained by gaze behavior. This implies an important role of gaze behavior in facial emotion processing, which should be considered for future brain imaging studies. In addition, our results suggest that targeting gaze behavior in interventions might be potentially beneficial for disorders showing impairments associated with the processing of emotional faces. The relation between eye gaze, CU traits, and neural function in different diagnoses needs further clarification in larger samples.

Abstract

Infants show a preference for infant-directed speech (IDS) over adult-directed speech (ADS). This preference has been linked to infants' language processing and word learning in experimental settings, and also correlates with later language outcomes. Recently, the cross-cultural consistency of infants' IDS preference has been confirmed by large-scale, multisite replication studies, but conclusions from these studies were primarily based on participants from North America and Europe. The current study addressed this sampling bias via a large-scale, multisite study of infants (3–15 months) across communities in Africa. We investigated whether participants showed a preference for IDS over ADS, and if so, whether the magnitude of their preference differs from effects documented in other populations of infants. Across six sites (total N = 200), we observed a preference for IDS over ADS (̂B IDSvs.ADS = 0.06), suggesting that infants look on average 6% longer on the IDS trials than the ADS trials. There was no significant difference between African infants in this study and a method-matched subsample of infants from prior studies of IDS preference. This study provides new evidence on the generalizability of IDS preference and looking-time methods more broadly, while also highlighting some of the challenges of global big team science.

Abstract

Listeners use information in the speech signal as well as linguistic and real-world knowledge to tackle the immense variability of speech. Here, we focus on the use of contextual and talker-bound fundamental frequency (F0) cues during the perception of voiceless fricatives’ center of gravity (CoG). In Experiment 1, Dutch participants heard the sentence Nu komt het woord ?ok (“Now comes the word ?ok”) where “?” denotes a fricative from a synthetic /s-ʃ/ continuum in three carrier F0 conditions (low, mid, high), and indicated whether they heard the high-CoG /sɔk/ “sock” or the low-CoG /ʃɔk/ “(to) trudge.” We found a contrastive effect of context F0 on CoG perception whereby hearing a high F0 carrier sentence led to a lower fricative CoG perception. In Experiments 2a and b, an exposure phase was added where participants either heard a low or a high F0-shifted talker. At test, all participants heard fixed-F0 words /?ɔk/ and indicated whether they heard sok or sjok. Talker F0 guided participants’ responses in both experiments, but across more trials in Experiment 2b than in Experiment 2a. In Experiment 3, combining context and talker manipulations, two groups of participants heard either a low or a high F0 talker in exposure, and both low and high F0-shifted carrier sentences at test. There was a large context F0 effect, but crucially, no talker F0 effect. Overall, we found evidence that both contextual and talker-bound F0 cues have contrastive effects on fricative perception, and that contextual cues, when present and sufficiently reliable, can outweigh talker cues.

Abstract

The nature of the link between speech perception and production is extensively debated. One question in this debate concerns the possible use of shared representations. Talker representations encode information about particular talkers’ speech and are formed through perception. We present three experiments that investigate the potential role of talker representations in speech production as measured by their impact on phonetic convergence to voice fundamental frequency (F0). In Experiment 1, female native Dutch speakers (N = 32) performed a baseline reading task, followed by a synchronous speech task where they were instructed to synchronize (temporally) to a pre-recorded model talker. The model talker’s voice was pitch-shifted to have high or low F0, and half of the sample performed the task in each F0 condition. Participants’ F0 values converged toward that of the model talker. In Experiment 2, we added an exposure task before synchronous speech, during which participants (N = 32) were familiarized with the model talker at high or low F0. At test, they heard the model talker at the familiar F0. Finally, in Experiment 3, we reversed the F0 manipulation between exposure and test. Thus, participants (N = 32) were familiarized with either high or low F0, but heard the opposite F0 condition during synchronous speech. The data revealed that while congruent and conflicting talker information both diminish convergence magnitude, only conflicting talker information reduces the probability of convergence. These results indicate that talker information acquired exclusively through perception is used during production, suggesting shared representations across perception and production.

Abstract

How do children allocate visual attention to scenes as they prepare to describe them multimodally in speech and co-speech gesture? In an eye-tracking study, Turkish-speaking 8-year-old children viewed four-picture displays depicting the same two objects in different spatial relations as they prepared to describe target pictures depicting left-right relations. Children's visual attention was sustained on the target picture when they were planning descriptions that expressed the spatial relation multimodally in speech and gesture, but not unimodally in speech only. This pattern persisted regardless of the semantic relation between speech and gesture (i.e., for both complementary gestures that disambiguated speech and redundant gestures that supplemented already unambiguous speech). Importantly, visual attention patterns did not differ across description types while children were previewing the displays before message preparation. These results indicate that multimodal message preparation might place different demands on visual attention than unimodal message preparation, possibly due to the affordances of gestures for expressing spatial relations.

Abstract

While events can be identified based on both perceptual and higher-level information, the contribution of language-related factors remains unclear. Here, we examine whether recent linguistic experience modulates event role identification scenes by asking whether verbs with different argument and thematic structures cue abstract event representations that guide subsequent event cognition. Participants briefly viewed agent–patient events (for 300ms) preceded by a transitive verb, an intransitive verb, or a nonsense word control, and then completed a probe-based role identification task. Transitive verb primes facilitated recognition of event roles, yielding faster responses in role-matching trials relative to intransitive and control conditions. These findings show that linguistic cues influence event role identification, especially when their argument and thematic structure aligns with event structures.

Abstract

Listeners vary in the perception and interpretation of speech prosody (the variations in intonation, loudness, and rhythm of spoken language). The source of this variability is unknown. We investigated whether the ability to recognise and classify prosodic structure is related to working memory (WM) capacity. This hypothesis stems from the tight connection between prosodic and syntactic (grammatical) structure, while processing syntax is known to relate to WN capacity. Healthy adult speakers of Dutch judged prosodic structures in a gating paradigm. The phrases contained early and late intonational cues that signalled whether the phrases contained an internal grouping or not. Listeners also took part in WM (digit span) and processing speed (letter comparison) tasks. There was an interaction between performance in the prosody judgement and WM tasks: high-WM listeners were better at classifying prosodic structure and required less prosodic information to detect the correct structure. The results demonstrate a close relationship between prosody processing and WM abilities, implying that WM is an important component of prosody processing.

Abstract

The philosopher G.E. Moore first observed that making a statement and then denying that one knows or believes that statement is unacceptable. For example, "It is raining, but I don’t think that" is defective. Across six experiments (n = 600), this study investigates the nature and extent of this unacceptability as a way to adjudicate between alternative theoretical explanations of this defectiveness. Results confirm that Moorean conjunctions are judged more acceptable than semantic contradictions (e.g., "It is raining, but it isn’t") but less so than felicitous conjunctions (e.g., "It is raining, but it’s okay"), and this is so regardless of whether Moorean conjunctions are produced by a person or by an artificial agent such as ChatGPT. However, if the first conjunct is anchored on a perspective other than the speaker’s, Moorean conjunctions increase in acceptability (e.g., "The train arrives at noon, but I think it won’t"). Several features can drive this perspective-shift, yet the acceptability of Moorean conjunctions did not match that of felicitous sentences in our sample. Our findings support the view that the unacceptability is a byproduct of mindreading, a key part of the social cognition that is crucial to using and understanding language.

Abstract

Background Systematic reviews are essential for evidence-based decision-making, but the screening stage is often labor-intensive and susceptible to human error. Machine learning (ML) approaches, including active learning (AL), have increasingly been used to support title and abstract screening. One such approach is the SAFE procedure, which has been proposed to guide the use of AL-assisted screening in systematic reviews. However, evidence on how well this procedure performs in large, heterogeneous datasets generated by broad search strategies remains limited. This study therefore evaluates the effectiveness and reliability of AL-assisted screening with particular focus on the SAFE procedure. Specifically, it examines the comprehensiveness and necessity of the recommended SAFE procedure, assesses the influence of different labeling strategies, and investigates whether AL-assisted screening can help reduce manual screening errors. Methods Screening of four large, heterogeneous datasets from medication management systematic reviews was simulated using ASReview. The datasets ranged from 3475 to 16218 records. For these datasets 0.08 to 1% of records were included in the final systematic review. Our simulations systematically varied all parameters defined by the SAFE procedure. Recall versus sampling behavior was analyzed, with a focus on the impact of parameter choices on retrieving records selected for full text inclusions and on reducing the number of records to be screened. Results AL-assisted screening can effectively reduce the number of records to screen by almost 90% without increasing the risk of missing relevant records in comparison to manual screening. For three of the four datasets, the best performance was achieved with the SAFE procedure combined with the elas-u4 and elas-h3 models and full-text labeling. Under these conditions, ASReview identified all studies included after full-text review and reduced the screening workload by 89–90%. In practical terms, this means that screening only 10–11% of the original records was sufficient to identify all final included studies in these datasets. This parameter combination identified 87% of the studies ultimately included after full-text review in the remaining dataset (16,218 records; 0.6% included at title/abstract screening and 0.08% included after full-text review). For this dataset, the best performance, identifying all studies included after full-text review while reducing the screening workload by 90%, was achieved when using the SAFE procedure with the simpler Naive Bayes model, the TF-IDF feature extractor, and title/abstract labeling. Conclusions AL-assisted screening can safely and effectively reduce the workload needed to screen the large, heterogeneous datasets common in medication management systematic reviews. We recommend the modified SAFE procedure using full-text labels and the elas models. If the estimated ratio of full text includes is very low, it may be more appropriate to use the original SAFE procedure with title/abstract labeling.

Abstract

Background

Mastering gross motor abilities in early infancy and culturally defined actions (e.g. self-care routines) in late infancy can initiate cascading developmental changes that affect language learning. Here, we adopt a genetic perspective to investigate underlying processes, implicating either shared or “gateway” mechanisms, where the latter enable children to interact with their environment.
Methods

Selecting heritable traits (h2, heritability), we studied infant gross motor (6 months) and self-care/symbolic (15 months) skills as predictors of 10 language outcomes (15–38 months) in genotyped children from the Avon Longitudinal Study of Parents and Children (N ≤ 7,017). Language measures were combined into three interrelated language factors (LF) using structural equation modeling (SEM), corresponding to largely different age windows (LF15M, LF24M, LF38M, 51.3% total explained variance). Developmental genomic and non-genomic relationships across measures were dissected with Cholesky decompositions using genetic-relationship-matrix structural equation modeling (GRM-SEM) as part of a multivariate approach.
Results

Gross motor abilities at 6 months (h2 = 0.18 (SE = .06)) and self-care/symbolic actions at 15 months (h2 = 0.18 (SE = .06)) were modestly heritable, as well as the three derived language factor scores (LFS15M-h2 = 0.12 (SE = .05), LFS24M-h2 = 0.21 (SE = .06), LFS38M-h2 = 0.17 (SE = .05)), enabling genetic analyses. Developmental genetic models (GRM-SEM) showed that gross motor abilities (6 months) share genetic influences with self-care/symbolic actions (15 months, factor loading λ; λ = 0.22 (SE = .09)), but not with language performance (p ≥ .05). In contrast, genetic influences underlying self-care/symbolic actions, independent of early gross motor skills, were related to all three language factors (LFS15M-λ = 0.26 (SE = .09), LFS24M-λ = 0.28 (SE = .10), LFS38M-λ = 0.30 (SE = .10)). Multivariate models studying individual language outcomes provided consistent results, both for genomic and non-genomic influences.
Conclusions

Genetically encoded processes linking gross motor behaviour in young infants to self-care/symbolic actions in older infants are different from those linking self-care/symbolic actions to emerging language abilities. These findings are consistent with a developmental cascade where motor control enables children to engage in novel social interactions, but children's social learning abilities foster language development.

Abstract

What makes some stimuli more memorable than others? Recent work has shown that image memorability is predicted by the magnitude of population responses in both monkey inferotemporal cortex and convolutional neural networks, suggesting that stimuli that more strongly activate distributed feature representations are more likely to be remembered. However, it remains unclear whether this effect is specific to the visual domain or reflects a more general property of distributed representations. Here, we show that representational magnitude predicts memorability beyond the visual domain: the effect not only replicates for images in an independent dataset, but extends to lexical memory. Across three large-scale word datasets, word embedding magnitude reliably predicts recognition memorability, independent of word frequency, valence, or length. However, the effect did not extend to a recently published voice memorability dataset, possibly reflecting distinct features driving auditory memory. Together, the cross-domain generalization suggests that the representational magnitude effect is a general property of distributed representations. Memorability, on this view, is inherent to encoding: stimuli that activate more features, and activate them more strongly – whether in brains or artificial neural networks – leave a larger representational footprint, and therefore a more lasting memory trace.

Abstract

This workshop proposes looking at errors in humans and robots. The workshop will focus along three axes: Human, Robot and Interaction induced errors. Errors in Human-Robot Interaction (HRI) pose a crucial challenge for the deployment of robots. Errors can affect the safety and trust of users, therefore it is important for empowering society that these robots can handle errors robustly. The workshop intends to foster interdisciplinary discussion among researchers in robotics, HCI, cognitive science, and social sciences, to encourage the development of robust, user-centered, and socially responsible HRI systems. The invited speakers, paper presentations and discussions will focus around topics of detecting errors, handling errors, adapting to errors, restoring trust, using intentional errors, communication strategies, issues of expectation as well as look at design, interdisciplinary and ethical approaches to research. In this way we will help inform research into errors, and develop robotic systems capable of robust interaction and collaboration.

Abstract

Various aspects of brain organization differ between the left and right hemispheres. Clues to the developmental origins of these asymmetries may be gained through associations with situs inversus totalis (SIT), a rare condition in which visceral organs are reversed on the left-right axis. In the largest previous brain imaging analyses of SIT (38 cases, 38 controls from Belgium), typical functional asymmetries such as left-hemisphere language dominance were mostly unaltered, but various aspects of asymmetrical cerebral structure - petalia, bending, and posterior venous anatomy – were often reversed in this condition. SIT can be a monogenic trait that arises from rare genetic variants, usually affecting motile cilia which help to create the embryonic left-right body axis. However, most SIT cases do not have obvious genetic causes and may arise from environmental or random effects during embryogenesis. We sequenced the genomes of 23 SIT cases and 23 controls from the Belgian brain imaging dataset and pooled with prior data from 15 cases and 15 controls. We aimed to discover whether there are altered brain asymmetries in SIT cases with disruptive DNA variants in ciliary genes, or in other types of genes, as compared to genetically unsolved cases. In total, 19 cases had likely causal variants affecting ciliary function, while 19 cases remained genetically unsolved. Functional and structural brain asymmetries were not significantly different in genetically solved versus unsolved SIT cases. Therefore, functional brain asymmetries seem largely independent of known mechanisms of visceral situs formation, while structural brain torque is altered in SIT regardless of the presence or absence of overt genetic causes.

Abstract

Aims and objectives:
Masked priming lexical decision research involving relatively high-proficient Japanese–English bilinguals suggests that past-tense and present-tense morphological connections (e.g., fell-FALL and looked-LOOK) are represented in their L2 (English) lexicons in a way that is similar to how they are represented in L1 (English) lexicons. The goal of the present research was to determine whether the same is true for low-proficient Japanese–English bilinguals.

Methodology:
Seventy-seven low-proficient Japanese–English bilinguals were tested in the masked priming lexical decision task. We manipulated the morphological or orthographic similarity between L2 English prime-target pairs.

Data and analysis:
We analyzed response latencies and error rates using (generalized) linear mixed-effects models.

Findings:
Although participants responded significantly faster to targets preceded by past-tense primes (e.g., fell-FALL and looked-LOOK) when compared to unrelated primes (e.g., slow-FALL and danger-LOOK), those priming effects were the same size as priming effects produced by orthographically similar primes (e.g., fill-FALL and lonely-LOOK), suggesting that the facilitation from past-tense primes is likely orthographic in nature. Nevertheless, the low-proficient bilinguals showed significant L2-L2 repetition priming (e.g., fall-FALL and look-LOOK), suggesting that, for those individuals, L2 (English) words are at least represented at the lexical level.

Originality:
The present study empirically confirmed a prediction, derived from a post hoc exploratory analysis in our previous research, that masked morphological priming effects are no larger than orthographic priming effects in low-proficient bilinguals. This indicates that a certain level of functional proficiency is required to observe morphological priming effects for Japanese–English bilinguals.

Implications:
Our results suggest that morphological connections in L2 are not yet established for low-proficient bilinguals, even when L2 words are lexically represented in their mental lexicon.

Abstract

Bilinguals use languages strategically and make decisions differently depending on the language context. Here, we explored whether verbal feedback modulates language use and risk-taking in bilinguals engaged in a coin-drawing game that incentivises lying. In the game, participants announced bets in Chinese or English, and feedback on the outcome of the current bet was given in the same language. They selected Chinese over English after receiving positive feedback in Chinese, and no language difference was found when feedback was provided in English. They also tended to take more risks after receiving positive than negative feedback. Furthermore, participants were more likely to switch from one language to the other following negative feedback as compared to positive feedback, and when telling the truth, they were faster after negative than positive feedback. Thus, the language in which bilinguals receive feedback constrains language use, which may have implications for understanding interactions in multilingual communities.

Abstract

Growing up bilingual has a remarkable influence on language processing and brain development in children, yet a systematic neurobiological overview remains elusive. The current review addresses this gap by collecting, summarising, and critically examining findings on the effect of bilingual experience(s) on brain development and language processing in infants, toddlers, and children, with a focus on neurobiological methodologies. In this review, we scrutinise the developmental (neural) trajectories of early and late bilingual children, based on 94 peer-reviewed articles. In early-immersive bilinguals, dual-language input influences various aspects of early language development and processing. For instance, they initially demonstrate delayed perceptual narrowing compared to monolinguals. Subsequently, during semantic and syntactic processing, bilinguals often demonstrate behavioural performance comparable to monolinguals; however, neuroimaging studies consistently reveal additional recruitment of executive function regions beyond the canonical language network. Furthermore, early bilinguals and monolinguals exhibit numerous differences in brain structure and function, indicating ongoing neural refinement and potentially more efficient language processing. Regarding second-language learning children (L2 learners), the focus is on the interaction between neural adaptation and language input. As input and proficiency increase, L2 learners demonstrate more mature ERP responses and greater activation within language-specific brain regions. In sum, this review highlights the dynamic neuroplasticity and distinct neural mechanisms linked to the bilingual experience from infancy onward. Finally, this review provides a comprehensive literature overview of the developing bilingual brain, emphasising the substantial impact of bilingualism on both language-specific and general cognitive networks, and highlighting possible future directions.

Abstract

This study investigates whether and, if so, how cognates facilitate lexical–semantic processing during early bilingual development. Additionally, we examine the interaction between the cognate facilitation effect (CFE) and bilingual experience factors, such as language proficiency, exposure, and age. We investigated language backgrounds and recorded event-related potentials during a semantic priming task in Dutch–German bilingual children. Most participants were Dutch-dominant, characterized by higher exposure and proficiency in Dutch. We compared the N400 response to target words preceded by semantically related cognate versus non-cognate primes. We found a reduced N400 effect (indexing cognate facilitation) only in the non-dominant language (nDL; German). Individual difference analyses further revealed that higher proficiency of nDL and increasing age attenuated the CFE. In contrast, higher cumulative exposure was associated with an amplified CFE. These findings suggest that cross-linguistic activation in lexical–semantic processing may benefit younger children with either lower proficiency or higher exposure to their non-dominant language during language processing. Together, the study offers direct neural evidence for bilingual cognate facilitation effects and highlights the importance of investigating interactions with external factors in early bilingualism. Future longitudinal research should examine whether cognate reliance serves as a temporary scaffolding mechanism for the acquisition of the non-dominant language.

Abstract

The present intervention study examines how parents' use of gestures changes the way they provide math talk to their children, and whether increased use of parental gestures promotes children's math skills. In this parent-administered book reading intervention study, three- to four-year old Turkish-speaking children (N = 56, Mage = 49.8 months, SD = 3.6) and their parents were randomly assigned to one of the following conditions: parents asked to use gestures while reading a numerical language book (NL + G, n = 19), parents asked not to use gestures while reading a numerical language book (NL-G, n = 18), no specific instruction on gesture use to parents while reading a book without numerical language (L, n = 19). Children were assessed on four math tasks (verbal counting, cardinality, nonverbal, and verbal arithmetic) before and after the intervention phase. Parents also read their assigned book to children in both the pre- and post-intervention sessions. Results showed that parents provided more math talk when they were assigned to NL + G and NL-G compared to L in the post-intervention reading session. Moreover, parents in the NL + G group provided more math talk than those in the NL-G group. Children assigned to the NL + G group showed better improvement in their verbal arithmetic skills than those in the NL-G group. No other significant improvements in child performance were found. These results suggest that parental gesture use was associated with higher levels of math input and children's math skills exclusively in the context of the verbal arithmetic task. The possible mechanisms and contributions of providing math talk to children through different modalities are discussed.

Abstract

While bilingual studies have extensively explored crosslinguistic transfer across various domains, prosody remains relatively underexplored. This study addresses the gap by contributing experimental data on prosodic transfer at lexical and pragmatic levels in heritage speakers of Turkish in Germany. Given typological differences between Turkish and German prosody, this population is ideal for examining whether the heritage language (Turkish) is influenced by the majority language (German) in processing prosodic information across linguistic levels. In a recent study, Zora et al. examined how majority language speakers of Turkish interpret prosodic cues, specifically lexical stress and prosodic focus, when assessing sentence acceptability. Forty participants rated sentences containing prosodic violations, revealing that lexical stress violations elicited lower acceptability than prosodic focus violations. This suggests that lexical-level prosody, rather than pragmatic-level prosody, plays a more central role in spoken comprehension for majority language speakers of Turkish. Building on these findings, this study applies the same paradigm to 40 heritage Turkish speakers in Germany. Results show the reverse pattern, such that prosodic focus violations were rated less acceptable than lexical stress violations. Typologically, this aligns with Germanic languages, where prosodic focus holds greater weight in interpretation under the same experimental paradigm. The results further revealed that proficiency modulated sensitivity to prosodic information, such that high-proficiency speakers of Turkish judged both stress and focus violations as incorrect, whereas low-proficiency speakers judged only focus violations as incorrect. These findings highlight the dynamic nature of prosodic transfer, potentially from German to Turkish, and the significant role of language dominance and proficiency in shaping bilingual prosodic processing.

Abstract

Negation is a fundamental aspect of human cognition and grammar, expressed across different modalities. Yet, little is known about multimodal processing of negation, especially grammatical negation (e.g., “I did not sleep”), and the contribution of gestures and prosodic markers to its neural processing remains unexplored. This study investigates the neurocognition of multimodal negation in Turkish, a verb-final language where standard verbal negation is expressed morphologically with a postverbal suffix (-mA). Notably, this negation suffix shifts stress onto the verb stem, deviating from the default final-stress pattern of Turkish. In Turkish, standard verbal negation is also frequently accompanied by conventional negation gestures (backward hand flips), occurring on the verb stem preceding the negation suffix. Since both gestures and prosodic markers precede the negation suffix, we examined whether and how their presence affects the postverbal negation processing using electroencephalography. Gestures elicited an N100 effect driven by their inherent perceptual salience. Gestures also reduced the N400 amplitude in anticipation of the postverbal negation suffix, pointing to a facilitative role of negation gestures in negation processing. Prosody likewise strengthened this N400 reduction, but only when gestures were present. These findings demonstrate that gestures—and to a lesser extent prosody—reduce the cognitive effort involved in processing the morphosyntactic marker of verbal negation. Overall, the results provide neurophysiological evidence that multimodal information supports not only semantic processing, as shown before, but also core grammatical operations in language.

Abstract

Rhythm and language-related traits are phenotypically correlated, but their genetic overlap is largely unknown. Here, we leveraged two large-scale genome-wide association studies performed to shed light on the shared genetics of rhythm (N=606,825) and dyslexia (N=1,138,870). Our results reveal an intricate shared genetic and neurobiological architecture, and lay groundwork for resolving longstanding debates about the potential co-evolution of human language and musical traits.

Abstract

Introduction

Children's early language and communication skills are efficiently measured using parent report, for example, communicative development inventories (CDIs). These have scalable potential to determine risk of later language delay, and associations between delay and risk factors such as prematurity and poverty. However, there may be measurement difficulties in parent reports, including anomalous directions of association between child age/socioeconomic status and reported language. Findings vary on whether parents may report older infants as having smaller vocabularies than younger infants, for example.

Methods

We analysed data from the UK Communicative Development Inventory (Words and Gestures); UK-CDI (W&G) to determine whether anomalous associations would be replicated in this population, and/or with gesture. In total 1204 families of children aged 8–18 months (598 girls, matched to UK population for income, parental education and ethnicity as far as possible) completed Vocabulary and Gesture scales of the UK-CDI (W&G).

Results

Overall scores on the Gesture scale showed more significant relationships with biological risk factors including prematurity than did Vocabulary scores. Gesture also showed more straightforward relationships with social risk factors including income. Relationships between vocabulary and social risk factors were less straightforward; some at-risk groups reported higher vocabulary scores than other groups.

Discussion

We conclude that vocabulary report may be less accurate than gesture for this age. Parents have greater knowledge of language than gesture milestones, hence may report expectations for vocabulary, not observed vocabulary. We also conclude that gesture should be included in early language scales partly because of its greater, more straightforward association with many risk factors for language delay.

Abstract

Prediction in language is often about objects in the language users’ visual surroundings. Previous research suggests that linguistic working memory limitations in such task environments constrain language-mediated anticipatory eye movements. In this study, we investigated the effects of visuospatial cognitive load on language-mediated predictive eye gaze behaviour in a diverse group of L2 English speakers using the visual-world paradigm. Participants completed three levels of an increasingly difficult visuospatial working memory task before hearing either semantically constraining or unconstraining sentences, choosing an object best fitting the sentence, and completing the working memory task. Evidence of L2 anticipatory eye gaze was observed in all conditions. Importantly, a significant effect of difficulty, especially in the higher-load condition, suggests that increasing visuospatial working memory reduces anticipatory eye gaze. We close by discussing the importance of (visual) working memory in visual world studies and highlight the inherently integrative nature of predictive processing during language-vision interactions.

Abstract

Semantic knowledge is a defining property of human cognition, profoundly influenced by cultural experiences. In this study, we investigated whether literacy enhances lexical-semantic processing independently of schooling. Three groups of neurotypical adults - unschooled illiterates, unschooled ex-illiterates, and schooled literates - from the same residential and socioeconomic background in Portugal were tested on serial rapid automatized naming (RAN) and on discrete naming of everyday objects (concrete concepts) and basic color patches (abstract concepts). The performance of readers, whether schooled literate or unschooled exilliterate, was not affected by stimulus category, whereas illiterates were much slower on color than object naming, irrespective of task. This naming advantage promoted by literacy was not significantly mediated by vocabulary size. We conclude that literacy per se, regardless of schooling, contributes to faster naming of depicted concepts, particularly those of more abstract categories. Our findings provide further evidence that literacy influences cognition beyond the mere accumulation of knowledge: Literacy enhances the quality and efficiency of lexical-semantic representations and processing.

Abstract

Following Ariel (2021. Why it’s hard to construct ad hoc number concepts. In Caterina Mauri, Ilaria Fiorentini, & Eugenio Goria (eds.), Building categories in interaction: Linguistic resources at work, 439–462. Amsterdam: John Benjamins), we argue that number words manifest distinct distributional patterns from open-class lexical items. When modified, open-class words typically take selectors (as in kinda table), which select a subset of their potential denotations (e.g., “nonprototypical table”). They are typically not modified by loosening operators (e.g., approximately), since even if bare, typical lexemes can broaden their interpretation (e.g., table referring to a rock used as a table). Number words, on the other hand, have a single, precise meaning and denotation and cannot take a selector, which would need to select a subset of their (single) denotation (??kinda seven). However, they are often overtly broadened (approximately seven), creating a range of values around N. First, we extend Ariel’s empirical examination to the larger COCA and to Hebrew (HeTenTen). Second, we propose that open-class and number words belong to sparse versus dense lexical domains, respectively, because the former exhibit prototypicality effects, but the latter do not. Third, we further support the contrast between sparse and dense domains by reference to: synchronic word2vec models of sparse and dense lexemes, which testify to their differential distributions, numeral use in noncounting communities, and different renewal rates for the two lexical types.

Abstract

Explaining the origins of language is a key challenge in understanding ourselves as a species. We present an empirical framework that draws on synergies across fields to facilitate robust studies of language evolution. The approach is multifaceted, seeing language emergence as dependent on the convergence of multiple capacities, each with their own evolutionary trajectories. It is explicitly biocultural, recognizing and incorporating the importance of both biological preparedness and cultural transmission as well as interactions between them. We demonstrate this approach through three case studies that examine the evolution of different facets involved in human language (vocal production learning, linguistic structure, and social underpinnings).

Abstract

Children's emotional development is linked to language development for typically developing children and deaf children with native sign language exposure. However, approximately 90% of deaf children are born to hearing parents who are not familiar with sign language. These deaf children begin learning a sign language when they attend a school for the deaf. Late sign language exposure has negative consequences on several aspects of language development. We investigate whether acquiring sign language late affects children's emotion recall and channel of emotion expression. After watching a silent video depicting emotions, late- and native-signing deaf children retold the story in Turkish Sign Language. Results showed that late signers recalled fewer emotions and used fewer signs and facial expressions compared to native signers. Manual gestures (non-sign hand movements), head and body movements did not differ across groups. The findings suggest that late sign language acquisition negatively impacts deaf children's ability to recall and express emotions, highlighting the importance of early language exposure for the development of emotion recall.

Abstract

Selective serotonin reuptake inhibitors (SSRIs) are commonly prescribed to pregnant women due to their efficacy and safety profile, leading to potential exposure of the developing fetus and infant. Serotonin, which acts as a neurotransmitter in adults and is crucial for regulating male sexual behavior, also serves as a neurotrophic factor during early brain development. Yet, the long-term consequences of perinatal SSRI exposure on adult sexual functioning remain poorly understood. This study investigates the long-term effects of perinatal SSRI exposure on the sexual behavior of adult male rats in a seminatural environment. During pregnancy and lactating, mother rats were administered either fluoxetine (FLX, 10 mg/kg) or a control solution (CTR, 1 % Methylcellulose) daily via oral gavage. Upon reaching adulthood, male offspring were assessed for sexual performance in a semi-natural setting, where they lived in mixed-sex groups for eight days. Comprehensive observations of sexual, social, and conflict behaviors were scoring from the first to the last copulatory behavior during the period in which female rats were sexually receptive. Our findings reveal that perinatal FLX exposure significantly increases sexual behavior in adult male rats, as evidenced by a higher total number of copulatory behaviors. This suggests that elevated serotonin levels during early development have enduring consequences for male rat sexual behavior in adulthood, potentially enhancing reproductive strategies and success in naturalistic environments.

Abstract

Thematic roles in language (Agents, Patients) are considered to be hierarchically organized in terms of their salience, and this hierarchy is rooted in their counterparts as event participants in cognition. Here, we examine the relative salience of Agents over Patients in two-participant causative events in Turkish-speaking 3- to 5-year-old children. We also test if this asymmetry is modulated by the animacy of the Patient (human vs. inanimate object) and specific to the presence of a coherent event. In an eye-tracked change detection task, changes to Agents were detected more accurately (and after fewer fixations) than changes to inanimate Patients when there was a coherent event. This asymmetry disappeared when the Patient was animate (for accuracy) and when event coherence was disrupted (for both accuracy and fixations). These findings suggest an interplay of event roles and animacy in Agent preference.

Abstract

Many people have flipped coins but few have stopped to ponder the statistical and physical intricacies of the process. We collected 350,757 coin flips to test the counterintuitive prediction from a physics model of human coin tossing developed by Diaconis, Holmes, and Montgomery (DHM; 2007). The model asserts that when people flip an ordinary coin, it tends to land on the same side it started. Our data support this prediction: the coins landed on the same side more often than not, Pr⁡(same side)=0.508, 95% credible interval (CI) [0.506, 0.509], BFsame‐side bias=2359. Furthermore, the data revealed considerable between-people variation in the degree of this same-side bias. Our data also confirmed the generic prediction that when people flip an ordinary coin—with the initial side-up randomly determined—it is equally likely to land heads or tails:Pr⁡(heads)=0.500, 95% CI [0.498, 0.502], BFheads‐tails bias=0.182. Additional analyses revealed that the within-people same-side bias decreased as more coins were flipped, an effect that is consistent with the possibility that practice makes people flip coins in a less wobbly fashion. Our data therefore provide strong evidence that when some (but not all) people flip a fair coin, it tends to land on the same side it started. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Abstract

There is an increasing trend towards evaluating NLP models with LLMs instead of human judgments, raising questions about the validity of these evaluations, as well as their reproducibility in the case of proprietary models. We provide JUDGE-BENCH, an extensible collection of 20 NLP datasets with human annotations covering a broad range of evaluated properties and types of data, and comprehensively evaluate 11 current LLMs, covering both open-weight and proprietary models, for their ability to replicate the annotations. Our evaluations show substantial variance across models and datasets. Models are reliable evaluators on some tasks, but overall display substantial variability depending on the property being evaluated, the expertise level of the human judges, and whether the language is human or model-generated. We conclude that LLMs should be carefully validated against human judgments before being used as evaluators.

Abstract

Humans acquire word knowledge through producing and comprehending spoken and written language. Word learning continues into adulthood and knowledge accumulates across the lifespan. Therefore, receptive vocabulary size is often conceived of as a proxy for linguistic experience and plays a central role in assessing individuals’ language proficiency. There is currently no valid open access test available for assessing receptive vocabulary size in German-speaking adults. We addressed this gap and developed the German Auditory and Image Vocabulary Test (GAudI). In the GAudI, participants are presented with spoken test words and have to indicate their meanings by selecting the corresponding picture from a set of four alternatives. Here we describe the development of the test and provide evidence for its validity. Specifically, we report a study in which 168 German-speaking participants completed the GAudI and five other tests tapping into linguistic experience: one test measuring print exposure, two tests measuring productive vocabulary, one test assessing knowledge of book language grammar, and a test of receptive vocabulary that was normed in adolescents. The psychometric properties of the GAudI and its relationships to the other tests demonstrate that it is a suitable tool for measuring receptive vocabulary size. We offer an open-access digital test environment that can be used for research purposes, accessible via https://ems13.mpi.nl/bq4_customizable_de/researchers_welcome.php.

Abstract

Individuals vary substantially in their language skills. The Individual Differences in Language Skills Test Battery (IDLaS) is a tool to assess variability in (1) linguistic experience, (2) general cognitive skills implicated in language, including nonverbal processing speed, working memory, and nonverbal reasoning, and (3) linguistic processing skills, including word- and sentence-level production and comprehension. The test battery was initially developed for Dutch language users. Building on this work, we recently developed a German version (IDLaS-DE). IDLaS-DE consists of 30 behavioral tests that have been validated in a large group of German speakers, aged between 18 and 30 years. In addition, we have developed a web platform that researchers interested in assessing language and general cognitive skills can use for their research purposes. Here, we provide a guide for creating and running customized studies online via this platform. The IDLaS-DE web platform and all its services are free of charge and accessible at https://www.mpi.nl/idlas-de.

Abstract

This chapter explores the fundamentals and recent advancements of diffusion-weighted imaging (DWI) and its primary application, tractography. Both have become indispensable in the research arena and are currently being integrated into the clinical world, especially for neurosurgery. These technologies provide rapid, in vivo mapping of white matter tracts, greatly assisting surgeons in pre-surgical planning and enabling them to offer patients more precise prognostic information, thereby enhancing the process of informed decision-making. Despite nearly three decades of use in research and the development of sophisticated mapping techniques, the adoption of contemporary tractography methods in clinical settings has been slow. Here, we aim to provide a comprehensive understanding of DWI’s basic principles, shed light on advanced methodologies that surpass the traditional diffusion tensor model, and discuss the clinical integration of tractography. Our objective is to advocate for incorporating newer tractography techniques into standard clinical practice.

Abstract

Literacy is a significant predictor of important life outcomes, such as attained education and income (Ritchie and Bates in Psychol Sci 24(7):1301–1308, 2013. 10.1177/0956797612466268) yet difficulties in reading and spelling are common. Both genetic and environmental factors account for individual differences in reading and spelling abilities (Little et al. in Behav Genet 47:52–76, 2017. 10.1007/s10519-016-9810-6), but there is some evidence that genetic factors can be moderated by environmental factors, many of which relate to differences in socio-economic status (SES). Studies in the US indicate that the heritability of reading and spelling abilities is higher in higher SES environments (Hart et al. in J Child Psychol Psychiatry 54(10):1047–1055, 2013. 10.1111/jcpp.12083; Friend et al. in Psychol Sci 19(11), 2008. 10.1111/j.1467-9280.2008.02213.x). Because countries differ in terms of factors such as education access and social mobility, the genetics (or simply gene) x SES interaction may or may not be present in other populations. Here, we utilise summary statistics from a well-powered genome-wide association study on dyslexia (Doust et al. in Nat Genet 54:1621–1629, 2022. 10.1038/s41588-022-01192-y) to construct polygenic indices in two cohorts of children/adolescents in Australia (N = 1315) and the United Kingdom (N = 5461 at age 7; N = 4306 at age 16), and test whether the effect of measured genes on variation in reading ability is moderated by family SES. While polygenic indices and SES both showed statistically significant effects on reading and spelling performance, no interaction effect was found. These results are contrary to results of some twin studies in the United States that have found an interaction effect. Yet, these findings support the broader literature on gene x SES interaction that mostly report no such interaction in other cognitive traits outside the United States suggesting country differences in how strongly SES relates to education quality.

Abstract

Humans engage with music for various reasons that range from emotional regulation and relaxation to social bonding. While there are large inter-individual differences in how much humans enjoy music, little is known about the origins of those differences. Here, we disentangle the genetic factors underlying such variation. We collect data on several facets of music reward sensitivity, as measured by the Barcelona Music Reward Questionnaire, plus music perceptual abilities and general reward sensitivity from a large sample of Swedish twins (N = 9169; 2305 complete pairs). We estimate that genetic effects contribute up to 54% of the variability in music reward sensitivity, with 70% of these effects being independent of music perceptual abilities and general reward sensitivity. Furthermore, multivariate analyses show that genetic and environmental influences on the different facets of music reward sensitivity are partly distinct, uncovering distinct pathways to music enjoyment and different patterns of genetic associations with objectively assessed music perceptual abilities. These results paint a complex picture in which partially distinct sources of variation contribute to different aspects of musical enjoyment.

Abstract

Coding the accuracy of typed transcripts from experiments testing speech intelligibility is an arduous endeavour. A recent study in this journal [Herrmann, B. 2025. Leveraging natural language processing models to automate speech-intelligibility scoring. Speech, Language and Hearing, 28(1)] presents a novel approach for automating the scoring of such listener transcripts, leveraging Natural Language Processing (NLP) models. It involves the calculation of the semantic similarity between transcripts and target sentences using high-dimensional vectors, generated by such NLP models as ADA2, GPT2, BERT, and USE. This approach demonstrates exceptional accuracy, with negligible underestimation of intelligibility scores (by about 2-4%), numerically outperforming simpler computational tools like Autoscore and TSR. The method uniquely relies on semantic representations generated by large language models. At the same time, these models also form the Achilles heel of the technique: the transparency, accessibility, data security, ethical framework, and cost of the selected model directly impact the suitability of the NLP-based scoring method. Hence, working with such models can raise serious risks regarding the reproducibility of scientific findings. This in turn emphasises the need for fair, ethical, and evidence-based open source models. With such models, Herrmann’s new tool represents a valuable addition to the speech scientist’s toolbox.

Abstract

When faced with an ambiguous novel word such as ‘ranana’, how do listeners decide whether they heard a mispronunciation of a familiar target (‘banana’) or a label for an unfamiliar novel item? We examined this question by combining visual-world eye-tracking with an offline forced-choice judgment paradigm. In two studies, we show evidence that participants entertain repair and novel label interpretations of novel words that were created by editing a familiar target word in multiple phonetic features (Experiment 1) or a single phonetic feature (Experiment 2). Repair (‘ranana’ = a banana) and learning (‘ranana’ = a novel referent) were both common interpretation strategies, and learning was strongly associated with visual attention to the novel image after it was referred to in a sentence. This indicates that repair and learning are both valid strategies for understanding novel words that depend upon a set of similar mechanisms, and suggests that attention during listening is causally related to whether one learns or repairs.

Abstract

Language processing is rapidly incremental, but evidence bearing upon this assumption comes from very few languages. In this paper we report on a study of incremental processing in Murrinhpatha, a polysynthetic Australian language, which expresses complex sentence-level meanings in a single verb, the full meaning of which is not clear until the final morph. Forty native Murrinhpatha speakers participated in a visual world eyetracking experiment in which they viewed two complex scenes as they heard a verb describing one of the scenes. The scenes were selected so that the verb describing the target scene had either no overlap with a possible description of the competitor image, or overlapped from the start (onset overlap) or at the end of the verb (rhyme overlap). The results showed that, despite meaning only being clear at the end of the verb, Murrinhpatha speakers made incremental predictions that differed across conditions. The findings demonstrate that processing in polysynthetic languages is rapid and incremental, yet unlike in commonly studied languages like English, speakers make parsing predictions based on information associated with bound morphs rather than discrete words.

Abstract

Human communication is inherently multimodal. Auditory speech, but also visual cues can be used to understand another talker. Most studies of audiovisual speech perception have focused on the perception of speech segments (i.e., speech sounds). However, less is known about the influence of visual information on the perception of suprasegmental aspects of speech like lexical stress. In two experiments, we investigated the influence of different visual cues (e.g., facial articulatory cues and beat gestures) on the audiovisual perception of lexical stress. We presented auditory lexical stress continua of disyllabic Dutch stress pairs together with videos of a speaker producing stress on the first or second syllable (e.g., articulating VOORnaam or voorNAAM). Moreover, we combined and fully crossed the face of the speaker producing lexical stress on either syllable with a gesturing body producing a beat gesture on either the first or second syllable. Results showed that people successfully used visual articulatory cues to stress in muted videos. However, in audiovisual conditions, we were not able to find an effect of visual articulatory cues. In contrast, we found that the temporal alignment of beat gestures with speech robustly influenced participants' perception of lexical stress. These results highlight the importance of considering suprasegmental aspects of language in multimodal contexts.

Abstract

Speech is inherently variable, requiring listeners to apply adaptation mechanisms to deal with the variability. A proposed perceptual adaptation mechanism is recalibration, whereby listeners learn to adjust cognitive representations of speech sounds based on disambiguating contextual information. Most studies on the role of recalibration in speech perception have focused on variability in particular speech segments (e.g., consonants/vowels), and speech has mostly been studied with a focus on talking heads. However, speech is often accompanied by visual bodily signals like hand gestures, and is thus multimodal. Moreover, variability in speech extends beyond segmental aspects alone and also affects prosodic aspects, like lexical stress. We currently do not understand well how listeners adjust their representations of lexical stress patterns to different speakers. In four experiments, we investigated recalibration of lexical stress perception, driven by lexico-orthographical information (Experiment 1) and by manual beat gestures (Experiments 2–4). Across experiments, we observed that these two types of disambiguating information (presented in an audiovisual exposure phase) led listeners to adjust their representations of lexical stress, with lasting consequences for subsequent spoken word recognition (in an audio-only test phase). However, evidence for generalization of this recalibration to new words was only found in the third experiment, suggesting that generalization may be limited. These results highlight that recalibration is a plausible mechanism for suprasegmental speech adaption in everyday communication and show that even the timing of simple hand gestures can have a lasting effect on auditory speech perception.

Abstract

We present an exploratory cross-linguistic analysis of the quantity of target-child-directed speech and adult-directed speech in North American English (US & Canadian), United Kingdom English, Argentinian Spanish, Tseltal (Tenejapa, Mayan), and Yélî Dnye (Rossel Island, Papuan), using annotations from 69 children aged 2–36 months. Using a novel methodological approach, our cross-linguistic and cross-cultural findings support prior work suggesting that target-child-directed speech quantities are stable across early development, while adult-directed speech decreases. A preponderance of speech from women was found to a similar degree across groups, with less target-child-directed speech from men and children in the North American samples than elsewhere. Consistently across groups, children also heard more adult-directed than target-child-directed speech. Finally, the numbers of talkers present in any given clip strongly impacted children’s moment-to-moment input quantities. These findings illustrate how the structure of home life impacts patterns of early language exposure across diverse developmental contexts.

Abstract

To produce a word, speakers need to decide which concept to express, select an appropriate item from the mental lexicon and spell out its phonological form. The temporal dynamics of these processes remain a subject of debate. We investigated the time course of lexical access in picture naming with electroencephalography (EEG). Thirty participants (23 female) named pictures using simple nouns. The pictures varied in conceptual category (animate or inanimate), stress pattern (first or second syllable), and the structure of the first syllable (open or closed). Using time-resolved multivariate pattern analysis (MVPA), we decoded the time course in which each dimension was available during speech preparation. The results demonstrated above-chance decoding of animacy within 100 ms after picture onset, confirming early access to conceptual information. This was followed by stress pattern and syllable structure, at around 150 and 250 ms after picture onset, respectively. These results suggest that a word’s stress pattern can be retrieved before syllable structure information becomes available. An exploratory analysis demonstrated the availability of the word-initial phoneme within 100 ms after picture onset. This result hints at the possibility that during picture naming conceptual, phonological and phonetic information may be accessed rapidly and in parallel.

Abstract

Developmental psychology focuses on how psychological constructs change with age. In cognitive development research, however, the specifics of this emergence is often underspecified. Researchers often provisionally assume linear growth by including chronological age as a predictor in regression models. In this work, we aim to evaluate this assumption by examining the functional form of age trajectories across 25 phenomena in early linguistic and cognitive development by combining the results of multiple meta-analyses in Metalab, an open database. Surprisingly, for most meta-analyses, the effect size for the phenomenon did not change meaningfully across age. We investigated four possible hypotheses explaining this pattern: (1) age-related selection bias against younger infants; (2) methodological adaptation for older infants; (3) change in only a subset of conditions; and (4) positive growth only after infancy. None of these explained the lack of age-related growth in most datasets. Our work challenges the assumption of linear growth in early cognitive development and suggests the importance of uniform measurement across children of different ages.