Publications

Abstract

Lateralization is a defining characteristic of the human brain, often studied through localized approaches that focus on interhemispheric differences between homologous pairs of regions. It is also important to emphasize an integrative perspective of global brain asymmetry, in which hemispheric differences are understood through global patterns across the entire brain.

Abstract

Finding and facilitating commonalities between the linguistic behaviors of large language models and humans could lead to major breakthroughs in our understanding of the acquisition, processing, and evolution of language. However, most findings on human–LLM similarity can be attributed to training on human data. The field of emergent machine-to-machine communication provides an ideal testbed for discovering which pressures are neural agents naturally exposed to when learning to communicate in isolation, without any human language to start with. Here, we review three cases where mismatches between the emergent linguistic behavior of neural agents and humans were resolved thanks to introducing theoretically-motivated inductive biases. By contrasting humans, large language models, and emergent communication agents, we then identify key pressures at play for language learning and emergence: communicative success, production effort, learnability, and other psycho-/sociolinguistic factors. We discuss their implications and relevance to the field of language evolution and acquisition. By mapping out the necessary inductive biases that make agents' emergent languages more human-like, we not only shed light on the underlying principles of human cognition and communication, but also inform and improve the very use of these models as valuable scientific tools for studying language learning, processing, use, and representation more broadly.

Abstract

In the current paper, we examined the extent to which cross-linguistic structural priming effects can be found in genetically-unrelated languages, assessing the sensitivity of priming to varying degrees of overlap between the prime and target languages. In three experiments (Ns = 59, 57, 52), we tested the priming of L2 English passive sentences in response to patient-initial prime sentences in Tagalog (Experiments 1, 2) and Indonesian (Experiment 3). The linguistic properties of Tagalog and Indonesian allowed us to manipulate prime-target overlap in thematic role order, syntactic-thematic role mapping, and constituent order. Cross-linguistic priming effects were moderated by the degree of linguistic overlap between prime and target: priming effects were stronger given an overlap in syntactic-thematic role mapping, and strongest for shared constituent order. The results suggest that cross-linguistic priming effects can have different loci, and that each one has an additive effect on priming magnitude.

Abstract

The COVID-19 pandemic has massively limited how linguists can collect data, and out of necessity, researchers across several disciplines have moved data collection online. Here we argue that the rising popularity of remote web-based experiments also provides an opportunity for widening the context of linguistic research by facilitating data collection from understudied populations. We discuss collecting production data from adult native speakers of Tagalog using an unsupervised web-based experiment. Compared to equivalent lab experiments, data collection went quicker, and the sample was more diverse, without compromising data quality. However, there were also technical and human issues that come with this method. We discuss these challenges and provide suggestions on how to overcome them.

Abstract

Background
Rapid population-level identification of language disorders could help provide care to young children to improve their outcomes. Two previous studies identified and replicated up to six parent-reported items that predicted 11-year language outcome with ≥71 % sensitivity and specificity. Here, we assess whether including genetic propensity for toddlerhood vocabulary improves predictive accuracy.
Method
The Early Language in Victoria Study (ELVS) recruited 1910 8-month-olds in Melbourne in 2003–2004. The Longitudinal Study of Australian Children (LSAC) recruited 5107 0–1-year-olds across Australia in 2004. Both collected parent-reported items at 2–3 years, a comparable 11-year language outcome: the Clinical Evaluation of Language Fundamentals (CELF-4) Core Language score or Recalling Sentences subtest, and biospecimens for genotyping. We derived polygenic scores capturing participants’ genetic propensity for parent-reported 24–38-month vocabulary. We calculated univariate associations with continuous language outcomes. We used ensemble method SuperLearner to estimate how accurately the parent-reported predictors and polygenic scores predict low 11-year language outcome (>1.5 standard deviations below the mean) in each cohort.
Results
Language outcome was available for 839 ELVS and 1441 LSAC participants. Polygenic scores accounted for little variance in continuous language outcomes (R2 < 1.3 %). Adding polygenic scores to the predictor sets increased accuracy of predicting language outcome by up to 7 %, but inconsistently between analyses.
Conclusions
Polygenic scores derived for toddlerhood vocabulary did not meaningfully improve predictive accuracy of individuals’ language outcome when added to the phenotypic predictor set. Presently, parent-reported measures or clinician observation appear best for predicting language outcome at this age.

Abstract

The human brain must add information to the acoustic speech signal in order to understand language. Many accounts propose that the prosodic structure of utterances (including their syllabic rhythm and speech melody), in combination with stored lexical knowledge, cue and interact with higher order abstract semantic and syntactic information. While cortical rhythms, particularly in the delta and theta band, synchronize to quasi-rhythmic low-level acoustic speech features, it remains unclear how the human brain encodes abstract speech properties in neural rhythms in the absence of an acoustic signal, i.e. when speakers hold planned sentences in working memory. This study disentangles the contributions of prosodic and syntactic features in cortical rhythms during delayed sentence repetition. Using high-resolution ECoG during awake tumor surgery in the left perisylvian cortex in nine patients (five female), we show that the phase of neural rhythms with frequencies ranging from 1-48 Hz and the broadband gamma power envelope code both low-level acoustic and abstract syntactic speech features during sentence processing and retention. Syntax and prosody coding occurred in the same frequency bands, which argues against the assumption of different frequency channels for processing and representing these speech features. Our data suggest the brain leverages the phase of various neural rhythms to code both acoustic and abstract linguistic features.

Abstract

In face-to-face interaction, we use multiple modalities, including speech and gestures, to communicate information and resolve references to objects. However, how representational co-speech gestures refer to objects remains understudied from a computational perspective. In this work, we address this gap by introducing a multimodal reference resolution task centred on representational gestures, while simultaneously tackling the challenge of learning robust gesture embeddings. We propose a self-supervised pre-training approach to gesture representation learning that grounds body movements in spoken language. Our experiments show that the learned embeddings align with expert annotations and have significant predictive power. Moreover, reference resolution accuracy further improves when (1) using multimodal gesture representations, even when speech is unavailable at inference time, and (2) leveraging dialogue history. Overall, our findings highlight the complementary roles of gesture and speech in reference resolution, offering a step towards more naturalistic models of human-machine interaction.

Abstract

When speakers refer to objects in the world, they often overinform: provide their listener with redundant adjectival information. Contrary to classical theories in linguistics, recent theories have framed overinformativeness as an efficient means of grounding reference in perceptual information of high discriminability to facilitate listener comprehension. However, the generalisability of such theories is constrained by the methodological challenge associated with reliably manipulating the perceptual discriminability of naturalistic stimuli. Here, we overcome these methodological challenges, using methods from psychophysics to manipulate the perceptual discriminability of colour and material attributes in a reference-production experiment. We provide a robust validation of the view that overinformative reference is driven by speakers grounding expressions in attributes of high discriminability. However, we also find that colour information is privileged above and beyond such factors of discriminability.

Abstract

Children need to learn the demands of their native language in the early vocabulary development phase. In this dynamic process, parental multimodal input may shape neurodevelopmental trajectories while also being tailored by child-related factors. Moving beyond typically characterized group profiles, in this article, we synthesize growing evidence on the effects of parental multimodal input (amount, quality, or absence), domain-specific input (space and math), and language-specific input (causal verbs and sound symbols) on preterm, full-term, and deaf children's early vocabulary development, focusing primarily on research with children learning Turkish and Turkish Sign Language. We advocate for a theoretical perspective, integrating neonatal characteristics and parental input, and acknowledging the unique constraints of languages.

Abstract

When language abilities in aphasia are assessed in clinical and research settings, the standard practice is to examine each language of a multilingual person separately. But many multilingual individuals, with and without aphasia, mix their languages regularly when they communicate with other speakers who share their languages. We applied a novel approach to scoring language production of a multilingual person with aphasia. Our aim was to discover whether the assessment outcome would differ meaningfully when we count accurate responses in only the target language of the assessment session versus when we apply a translanguaging framework, that is, count all accurate responses, regardless of the language in which they were produced. The participant is a Farsi-German-English speaking woman with chronic moderate aphasia. We examined the participant’s performance on two picture-naming tasks, an answering wh-question task, and an elicited narrative task. The results demonstrated that scores in English, the participant’s third-learned and least-impaired language did not differ between the two scoring methods. Performance in German, the participant’s moderately impaired second language benefited from translanguaging-based scoring across the board. In Farsi, her weakest language post-CVA, the participant’s scores were higher under the translanguaging-based scoring approach in some but not all of the tasks. Our findings suggest that whether a translanguaging-based scoring makes a difference in the results obtained depends on relative language abilities and on pragmatic constraints, with additional influence of the linguistic distances between the languages in question.

Abstract

Contemporary artificial intelligence models owe much of their success and discontents to connectionism, a framework in cognitive science that has been (and continues to be) highly influential. Herein, we analyze artificial neural networks: (a) when used as scientific instruments of study and (b) when functioning as emergent arbiters of the zeitgeist in the cognitive, computational, and neural sciences. Building on our previous work with respect to analogizing between artificial neural networks and cognition, brains, or behavior (Guest & Martin, 2023), we use metatheoretical analysis techniques (Guest, 2024), including formal logic, to characterize two distinct tendencies within connectionism that we dub classical and modern, with divergent properties, for example, goals, mechanisms, and scientific questions. We also demonstrate how we, as a field, often fail to follow important lines of argument to their end—this results in a paradoxical praxis. By engaging more deeply with (meta)theory surrounding artificial neural networks, our field can obviate the cycle of artificial intelligence winters and summers, which need not be inevitable

Abstract

Age at onset of walking is an important early childhood milestone which is used clinically and in public health screening. In this genome-wide association study meta-analysis of age at onset of walking (N = 70,560 European-ancestry infants), we identified 11 independent genome-wide significant loci. SNP-based heritability was 24.13% (95% confidence intervals = 21.86–26.40) with ~11,900 variants accounting for about 90% of it, suggesting high polygenicity. One of these loci, in gene RBL2, co-localized with an expression quantitative trait locus (eQTL) in the brain. Age at onset of walking (in months) was negatively genetically correlated with ADHD and body-mass index, and positively genetically correlated with brain gyrification in both infant and adult brains. The polygenic score showed out-of-sample prediction of 3–5.6%, confirmed as largely due to direct effects in sib-pair analyses, and was separately associated with volume of neonatal brain structures involved in motor control. This study offers biological insights into a key behavioural marker of neurodevelopment.

Abstract

Language is inherently multimodal. In spoken languages, combined spoken and visual signals (e.g., co-speech gestures) are an integral part of linguistic structure and language representation. This requires an extension of the parallel architecture, which needs to include the visual signals concomitant to speech. We present the evidence for the multimodality of language. In addition, we propose that distributional semantics might provide a format for integrating speech and co-speech gestures in a common semantic representation.

Abstract

This article presents an in-depth conversation with Peter Hagoort, a leading cognitive neuroscientist and director of the Max Planck Institute for Psycholinguistics. The interview explores the contrasting paradigms of Jerry Fodor and Jerome Bruner, focusing on their differing conceptions of the mind, including modularity, perception, and the role of cognitive processes. Hagoort reflects on Fodor’s modularity theory and Bruner’s New Look in Perception, examining their influence on his own research, particularly the language marker hypothesis, which highlights the symbolic and flexible nature of human internal models shaped by language. The discussion further addresses Fodor’s critique of relativism, his scepticism about cognitive neuroscience, and the relevance of these foundational ideas to contemporary questions in cognitive science and artificial intelligence, including the distinctions between human cognition and large language models. Through this dialogue, the article revisits key debates in cognitive science while situating them within current research and theoretical developments.

Abstract

Background

Neurodevelopmental conditions are highly heritable. Recent studies have shown that genomic heritability estimates can be confounded by genetic effects mediated via the environment (indirect genetic effects). However, the relative importance of direct versus indirect genetic effects on early variability in traits related to neurodevelopmental conditions is unknown.

Methods

The sample included up to 24,692 parent-offspring trios from the Norwegian MoBa cohort. We use Trio-GCTA to estimate latent direct and indirect genetic effects on mother-reported neurodevelopmental traits at age of 3 years (restricted and repetitive behaviors and interests, inattention, hyperactivity, language, social, and motor development). Further, we investigate to what extent direct and indirect effects are attributable to common genetic variants associated with autism, ADHD, developmental dyslexia, educational attainment, and cognitive ability using polygenic scores (PGS) in regression modeling.

Results

We find evidence for contributions of direct and indirect latent common genetic effects to inattention (direct: explaining 4.8% of variance, indirect: 6.7%) hyperactivity (direct: 1.3%, indirect: 9.6%), and restricted and repetitive behaviors (direct: 0.8%, indirect: 7.3%). Direct effects best explained variation in social and communication, language, and motor development (5.1%–5.7%). Direct genetic effects on inattention were captured by PGS for ADHD, educational attainment, and cognitive ability, whereas direct genetic effects on language development were captured by cognitive ability, educational attainment, and autism PGS. Indirect genetic effects on neurodevelopmental traits were primarily captured by educational attainment and/or cognitive ability PGS.

Conclusions

Results were consistent with differential contributions to neurodevelopmental traits in early childhood from direct and indirect genetic effects. Indirect effects were particularly important for hyperactivity and restricted and repetitive behaviors and interests and may be linked to genetic variation associated with cognition and educational attainment. Our findings illustrate the importance of within-family methods for disentangling genetic processes that influence early neurodevelopmental traits, even when identifiable associations are small.

Abstract

Our ability to predict upcoming events is a fundamental component of human cognition. One way in which we do so is by exploiting temporal regularities in sensory signals: the ticking of a clock, falling of footsteps and the motion of waves each provide a structure that may facilitate anticipation. But how strong is the effect of rhythmic anticipation on perception? And to what degree do people vary in their ability to capitalize on these regularities? In 2015, Hickok et al. introduced a behavioural paradigm to assess how a rhythmic auditory stimulus affects perception of subsequent targets (Hickok G, Farahbod H, Saberi K. 2015 The rhythm of perception: entrainment to acoustic rhythms induces subsequent perceptual oscillation. Psychol. Sci. 26, 1006–1013. (doi:10.1177/0956797615576533)). They tested five listeners and found that perception (target detection accuracy) fluctuated rhythmically just like the sound rhythm. Here, we replicate the original finding, assess how likely the finding is to be observed for any individual, and quantify effect size in a large sample of adult listeners (n = 149). We introduce a model-based analysis approach that allows separate estimates of amplitude and phase information in target detection responses, and quantifies effect size for individual listeners. Together our results strongly support the presence of oscillatory influences on target detection accuracy, as well as substantial variability in the magnitude of this effect across listeners.

Abstract

Many species produce rhythmic sound sequences. Some purportedly speed up their vocalizations throughout a display, reminiscent of—but not necessarily equivalent to—accelerando in human music. This phenomenon has been frequently reported but rarely quantified, which limits our ability to understand its mechanism, function, and evolution. Here, we use a suite of rhythm analyses to quantify temporal and acoustic features in the ecstatic display songs of male African penguins (Spheniscus demersus). We show that songs get faster (i.e., accelerando) and louder (i.e., crescendo) as they progress. The accelerando occurs because the intersyllable silences, not the syllables themselves, predictably shorten over time. This rhythmicity is maintained even when individuals take audible breaths. Individuals also show plasticity: when they start with a slow tempo, they speed up more strongly than when they start with a fast tempo. We hypothesize that this well-timed accelerando may stem from arousal-based mechanisms, biomechanical constraints, or more complex rhythmic control. Future work should test the mechanisms behind this intra-individual rhythmic variation since nonpasserine birds are thought to have limited vocal plasticity. By integrating a rich empirical dataset with cutting-edge rhythm analyses, we establish the necessary foundation to determine how such features evolved and their role(s) across communication systems.

Abstract

Individual differences in using language are prevalent in our daily lives. Language skills are often assessed in vocational (predominantly written language) and diagnostic contexts. Not much is known, however, about individual differences in spoken language skills. The lack of research is in part due to the lack of suitable test instruments. We introduce the Individual Differences in Language Skills (IDLaS-NL) test battery, a set of 31 behavioural tests that can be used to capture variability in language and relevant general cognitive skills in adult speakers of Dutch. The battery was designed to measure word and sentence production and comprehension skills, linguistic knowledge, nonverbal processing speed, working memory, and nonverbal reasoning. The present article outlines the structure of the battery, describes the materials and procedure of each test, and evaluates the battery’s factor structure based on the results of a sample of 748 Dutch adults, aged between 18 and 30 years, most of them students. The analyses demonstrate that the battery has good construct validity and can be reliably administered both in the lab and via the internet. We therefore recommend the battery as a valuable new tool to assess individual differences in language knowledge and skills; this future work may include linking language skills to other aspects of human cognition and life outcomes.

Abstract

It has long been known that we use words to perform speech acts foundational to everyday conversation, such as requesting, informing, proposing, or complaining. However, the natural environment of human language is face-to-face interaction where we use words and an abundance of visual signals to communicate. The multimodal nature of human language is increasingly recognised in the language and cognitive sciences. In line with this turn of the tide, findings demonstrate that facial signals significantly contribute to communicating intentions and that they may facilitate pragmatically appropriate responding in the fast-paced environment of conversation. In light of this, the notion of speech acts no longer seems appropriate, highlighting the need for a modality-neutral conception, such as social action.

Abstract

Repair is a core building block of human communication, allowing us to address problems of understanding in conversation. Past research has uncovered the basic mechanisms by which interactants signal and solve such problems. However, the focus has been on verbal interaction, neglecting the fact that human communication is inherently multimodal. Here, we focus on a visual signal particularly prevalent in signalling problems of understanding: eyebrow furrows and raises. We present, first, a corpus study showing that differences in eyebrow actions (furrows versus raises) were systematically associated with differences in the format of verbal repair initiations. Second, we present a follow-up study using an avatar that allowed us to test the causal consequences of addressee eyebrow movements, zooming into the effect of eyebrow furrows as signals of trouble in understanding in particular. The results revealed that addressees’ eyebrow furrows have a striking effect on speakers’ speech, leading speakers to produce answers to questions several seconds longer than when not perceiving addressee eyebrow furrows while speaking. Together, the findings demonstrate that eyebrow movements play a communicative role in initiating repair during conversation rather than being merely epiphenomenal and that their occurrence can critically influence linguistic behaviour. Thus, eyebrow movements should be considered core coordination devices in human conversational interaction.

Abstract

Early-life abilities involved in perceiving, producing and engaging with music (musicality) may shape later (social) communication and language abilities. Here, we investigate phenotypic and genetic relationships linking musicality and communication abilities by studying information from preschool and school-aged children of the Avon Longitudinal Study of Parents and Children (N = 4169–6737 per measure, age 0.5–17 years). Using structural models, we identified relationships between latent musicality and speech- and cognition-related variables (r > 0.30). Consistently, polygenic scores for rhythmicity in adulthood (PGSrhythmicity) showed associations with preschool and school-age musicality (incremental-Nagelkerke-R2 = 0.006-0.011, p < 0.0025), as well as school-age communication and cognition-related measures (incremental-R2 = 0.04–1%, p < 0.0025). Studying the directionality of genetic effects using a mediation framework, we found evidence supporting a developmental pathway linking preschool musicality to school-age speech-/syntax-related abilities, as captured by PGSrhythmicity (shared effect: β = 0.0051(SE = 0.0021), p = 0.015). Associations were found conditional on general cognition and genetically unrelated to educational attainment, suggesting robust developmental links between early musicality and later speech-related communication performance.

Abstract

We introduce a new method for measuring prediction and language-vision interactions: tracking the trajectories of hand-reaching movements in Virtual Reality (VR) environments. Spatiotemporal trajectory tracking of hand-reaching movements in VR offers an ecologically valid yet controlled medium for conducting experiments in an environment that mirrors characteristics of real-world behaviors. Importantly, it enables tracking the continuous dynamics of processing on a single-trial level. In an exploratory experiment L2 speakers heard predictive or non-predictive sentences (e.g., “The barber cuts the hair” vs. “The coach remembers the hair”). Participants’ task was to move their hands as quickly and as accurately as possible towards the object most relevant to the sentence. We measured reaction times (RTs) and hand-reaching trajectories as indicators of predictive behavior. There was a main effect of predictability: Predictable items were touched faster than unpredictable ones. Importantly, uncertainty was captured using spatiotemporal survival analysis by prolonged fluctuations in upward and downward vertical hand movements before making a final move to target or distractor. Self-correction of prediction errors was revealed by participants switching the direction of hand-reaching movements mid-trial. We conclude that the Virtual Hand Paradigm enables measuring the onset and dynamics of predictive behavior in real time in single and averaged trial data and captures (un)certainty about target objects and the self-correction of prediction error online in ‘close to real-world’ experimental settings. The new method has great potential to provide additional insights about time-course and intermediate states of processing, provisional interpretations and partial target commitments that go beyond other state-of-the-art methods.

Abstract

Although the term Visual World Paradigm (henceforth VWP) is used to refer to the broad class of studies in which participants eye movements are measured as they listen to language, that is about a circumscribed visual display (henceforth the visual world), there are, in fact, two broadly used variants of the paradigm. The first, introduced by researchers at Rochester in the mid-1990s, typically used the visual world as a type of workspace that participants interact with, for example following instructions to perform an action or sequence of actions (e.g., “Put the apple on the towel in the box”; “Put the big candle into the trash. Now put the small tie into the blue square.”). The second, introduced by Gerry Altmann and colleagues, typically narrates an event or sequence of events, using a display with depicted objects and people (e.g., “The boy will eat the cake.”; “Donald is bringing some mail to Mickey while a violent storm is beginning. He's carrying an umbrella…”) without asking participants to perform an accompanying action. While the approaches are often used to address similar questions, there are some, often implicit, differences between the assumptions that motivate the different approaches. But what are these assumptions? Are there types of questions for which one of the approaches is better suited than the other? Does the choice of approach affect linking hypotheses? We address these issues in a paper that takes the form of a dialogue, with MKT making the case for including tasks with actions and FH making the case for experiments without an additional action. After responding to each other’s arguments, we conclude by: (1) separating principled differences from associations that are tied to the types of questions that were first addressed in some of the foundational studies; (2) making suggestions for factors that should guide researchers’ choice of approach; and (3) proposing new avenues of research.

Abstract

In the present paper we describe the Enhanced Literate Mind (ELM) hypothesis. As individuals learn to read and write, they are, from then on, exposed to extensive written-language input and become literate. We propose that acquisition and proficient processing of written language (‘literacy’) leads to, both, increased language knowledge as well as enhanced language and non-language (perceptual and cognitive) skills. We also suggest that all neurotypical native language users, including illiterate, low literate, and high literate individuals, share a Basic Language Cognition (BLC) in the domain of oral informal language. Finally, we discuss the possibility that the acquisition of ELM leads to some degree of ‘knowledge parallelism’ between BLC and ELM in literate language users, which has implications for empirical research on individual and situational differences in spoken language processing.

Abstract

Driven by the transformative idea that the brain operates as a predictive engine, this book offers a rigorous yet accessible introduction to predictive processing's core concepts while navigating major theories with depth and critical evaluation. Huettig incorporates historical contexts and maintains a critical stance, shedding light on the pros and cons of various approaches across the many academic disciplines that investigate future-oriented behavior. Looking Ahead is indispensable reading for early students of the science of prediction in psychology, cognitive science, neuroscience, linguistics, artificial intelligence and computer science, experts in related fields, and for anyone who has ever wondered why, as a species, we take so much interest in what lies ahead.

Abstract

Interlocutors often use the semantics of comprehended speech to inform the semantics of planned speech. Do representations of the comprehension and planning stimuli interact? In this EEG study, we used rapid invisible frequency tagging (RIFT) to better understand the attentional distribution to representations of comprehension and speech planning stimuli, and how they interact in the neural signal. To do this, we leveraged the picture-word interference (PWI) paradigm with delayed naming, where participants simultaneously comprehend auditory distractors (auditory [f1]; tagged at 54 Hz) while preparing to name related or unrelated target pictures (visual [f2]; tagged at 68 Hz). RIFT elicits steady-state evoked potentials, which reflect allocation of attention to the tagged stimuli. When representations of the tagged stimuli interact, increased power has been observed at the intermodulation frequency resulting from an interaction of the base frequencies (f2 ± f1; Drijvers et al., 2021). Our results showed clear power increases at 54 Hz and 68 Hz during the tagging window, but no power difference between the related and unrelated condition. Interestingly, we observed a larger power difference in the intermodulation frequency (compared to baseline) in the unrelated compared to the related condition (68 Hz − 54 Hz: 14 Hz), indicating stronger interaction between unrelated auditory and visual representations. Our results go beyond standard PWI results by showing that participants’ difficulties in the related condition do not arise from allocating attention to the pictures or distractors. Instead, processing difficulties arise during interaction of the concepts or lemmas invoked by the two stimuli, thus, we conclude, that interaction might be downregulated in the related condition.

Abstract

In conversation, future speakers often plan speech simultaneously with comprehension, which means that they must divide attentional resources between these processes. In this EEG study, we used responses to linguistic attention probes (i.e., syllable “BA” presented during spoken sentences) to track temporal variations in attention to comprehension. Participants were asked to listen to prerecorded sentences with expected or unexpected sentence-final words. Each sentence was presented twice, once with and once without the attention probe starting 100 msec after the target word onset. Participants saw a picture 50 msec before the target word. Depending on the test block (picture naming or button press), participants either named the picture or pressed the space bar, both after an 850-msec delay. The probes elicited a negative potential approximately 100 msec after probe onset (i.e., an attention probe effect) in all probe conditions. Unexpectedly, neither word expectancy nor speech planning influenced the timing or strength of the attention probe effect. This indicates that expectancy of words in Dutch does not affect the allocation of attention toward these words 100 msec after their onset (i.e., the time of the probe presentation). Interestingly, engaging in speech planning does not seem to divert attentional resources away from comprehension at the moment of probe presentation. These findings imply that listeners are able to effectively distribute their attentional resources between comprehension and speech planning and carry out these processes at the same time. Considering these unexpected findings, using attention probes might not be the best approach to capture variations in temporal attention in dual-task paradigms.

Abstract

Animal acoustic communication contains many structural features. Among these, temporal structure, or rhythmicity, is increasingly tested empirically and modelled quantitatively. Accelerando is a rhythmic structure which consists of temporal intervals increasing in rate over a sequence. Why this particular vocal behaviour is widespread in many different animal lineages, and how it evolved, is so far unknown. Here, we use evolutionary game theory and computer simulations to link two rhythmic aspects of animal communication, acceleration and overlap: We test whether rhythmic accelerando could evolve under a pressure for acoustic overlap in time. Our models show that higher acceleration values result in a higher payoff, driven by the higher relative overlap between sequences. The addition of a cost to the payoff matrix models a physiological disadvantage to high acceleration rates and introduces a divergence between an individual’s incentive and the overall payoff of the population. Analysis of the invasion dynamics of acceleration strategies shows a stable, non-invadable range of strategies for moderate acceleration levels. Our computational simulations confirm these results: A simple selective pressure to maximise the expected overlap, while minimising the associated physiological cost, causes an initially isochronous population to evolve towards producing increasingly accelerating sequences until a population-wide equilibrium of rhythmic accelerando is reached. These results are robust to a broad range of parameter values. Overall, our analyses show that if overlap is beneficial, emergent evolutionary dynamics allow a population to gradually start producing accelerating sequences and reach a stable state of moderate acceleration. Finally, our modelling results closely match empirical data recorded from an avian species showing rhythmic accelerando, the African penguin. This shows the productive interplay between theoretical and empirical biology.

Abstract

Psycholinguistic investigations provide invaluable empirical utility in theorizing and typologizing phonological phenomena. Instrumental approaches to the sound structure of Turkish have proven to be no exception here, contributing independent and multi-faceted evidence towards theory building and testing. Two areas of Turkish phonology in relation to suprasegmental structure and prominence patterns, namely word-level prosody (Section 2) and prominence and rhythmic phenomena at the level of the sentence and beyond (Section 3) have particularly fueled psycholinguistically motivated empirical studies. This chapter will approach representational and processing-related issues in each of these and provide a review of pertinent perception and production studies, touching upon phonetic and developmental investigations insofar as they have implications for mental representations or processing.

Abstract

We examined the morphosyntactic prediction ability of child heritage speakers and the role of reading skills and language experience in predictive processing. Using visual world eye-tracking, we focused on predictive use of case-marking cues in Turkish with monolingual (N=49, Mage=83 months) and heritage children, who were early bilinguals of Turkish and Dutch (N=30, Mage=90 months). We found quantitative differences in magnitude of the prediction ability of monolingual and heritage children; however, their overall prediction ability was on par. The heritage speakers’ prediction ability was facilitated by their reading skills in Dutch, but not in Turkish as well as by their heritage language exposure, but not by engagement in literacy activities. These findings emphasize the facilitatory role of reading skills and spoken language experience in predictive processing. This study is the first to show that in a developing bilingual mind, effects of reading-on-prediction can take place across modalities and across languages.

Abstract

One of the earliest sources of mathematical input arises in dyadic parent–child interactions. However, the emphasis has been on parental input only in speech and how input varies across different environmental and child-specific factors remains largely unexplored. Here, we investigated the relationship among parental math input modality and type, children’s gestational status (being preterm vs. full-term born), and vocabulary development. Using book-reading as a medium for parental math input in dyadic interaction, we coded specific math input elicited by Turkish-speaking parents and their 26-month-old children (N = 58, 24 preterms) for speech-only and multimodal (speech and gestures combined) input. Results showed that multimodal math input, as opposed to speech-only math input, was uniquely associated with gestational status, expressive vocabulary, and the interaction between the two. Full-term children with lower expressive vocabulary scores received more multimodal input compared to their preterm peers. However, there was no association between expressive vocabulary and multimodal math input for preterm children. Moreover, cardinality was the most frequent type for both speech-only and multimodal input. These findings suggest that the specific type of multimodal math input can be produced as a function of children’s gestational status and vocabulary development.

Abstract

*Joint first authorship.
Language acquisition unfolds within inherently multimodal contexts, where communication is expressed and perceived through diverse channels embedded in social interactions. For hearing children, this involves integrating speech with gesture; for deaf children, language develops through fully visual modalities. Such observations necessitate a paradigm shift from speech-centric models to a holistic framework that equally values all modalities, whether in spoken or signed languages. This framework must account not only for the multimodal scaffolding of input and interaction but also for individual and contextual diversity, including the cultural and cognitive variabilities children bring to language learning contexts. Responding to commentaries on our target article, this paper refines and expands the multimodal language framework, emphasizing its capacity to integrate the interactive richness of input and the heterogeneous contexts and individual variations shaping language acquisition.

Abstract

*=shared first authorship
Children across the world acquire their first language(s) naturally, regardless of typology or modality (e.g. sign or spoken). Various attempts have been made to explain the puzzle of language acquisition using several approaches, trying to understand to what extent it can be explained by what children bring to language-learning situations as well as what they learn from the input and the interactive context. However, most of these approaches consider only speech development, thus ignoring the inherently multimodal nature of human language. As a multimodal view of language is becoming more widely adopted for the study of adult language, a multimodal approach to language acquisition is inevitable. Not only do children have the capacity to learn spoken and sign language equally easily, but spoken language acquisition consists of learning to coordinate linguistic expressions in both modalities, that is, in both speech and gesture. To provide a step forward in this direction, this article aims to synthesize findings from research studies that take a multimodal perspective on language acquisition in different sign and spoken languages, including the development of speech and accompanying gestures. Our review shows that while some aspects of language acquisition seem to be modality-independent, others might differ according to the affordances of each modality when used separately as well as together (either in sign, speech, and/or gesture). We argue that these findings need to be integrated into our understanding of language acquisition. We also identify which areas need future research for both spoken and sign language acquisition, taking into account not only multimodal but also cross-linguistic variation.

Abstract

Purpose: The purpose of this viewpoint is to advocate for increased study of 3654244brcommon ground and audience design processes in multiparty communication in traumatic brain injury (TBI).
Method: Building on discussions at the 2024 International Cognitive-Communication Disorders Conference, we review common ground and audience design processes in dyadic and multiparty communication. We discuss how the diffuse profiles of neural and cognitive deficits place individuals with TBI at increased risk for keeping track of who knows what in group settings and using that knowledge to flexibly adapt their communication behaviors.
Results: We routinely engage in social communication in groups of three or more people at work, school, and social functions. While academic, vocational, and interpersonal domains are all areas where individuals with TBI are at risk for negative outcomes, we know very little about the impact of TBI on group, or multiparty, communication.
Conclusions: The empirical study of common ground and audience design in multiparty communication in TBI presents a promising new direction in characterizing the impact of TBI on social communication, uncovering the underlying mechanisms of cognitive-communication disorders, and may lead to new inter-ventions aimed at improving success in navigating group communication at work and school, and in interpersonal relationships.

Abstract

Despite strong popular beliefs that older users misunderstand emojis, empirical evidence is equivocal. Here we propose that different generations of users may vary in the degree of intra-generational agreement on emoji meanings (i.e., how much people from the same generation agree on what an emoji means). Inspired by research in cultural evolution demonstrating a positive association between social network size and the conventionalisation of signs, we hypothesised that younger users would show stronger agreement on emoji meanings because they tend to be embedded in larger online social networks than older users. We examined generational differences in intra-generational agreement on emoji interpretations, taking into account variability arising from different emoji renderings across platforms. In a pre-registered online study, 394 respondents from the culturally defined generations of GenZ (n = 152, age 13–24 years), Millennials (n = 149, age 25–40 years), and GenX/BabyBoomers (n = 93, age 41–76 years) produced three words to describe the meanings of 24 target face emojis and 10 popular filler emojis. Frequentist and Bayesian analyses showed no generational differences in intra-generational response entropy and in the probability of selecting the most frequent meaning within one's generation. Exploratory analysis further showed that the most commonly provided emoji interpretations did not differ across generations, despite generational differences in social media usage patterns. Together, these findings suggest that different generations not only interpret face emojis in similar ways, but also show similar intra-generational agreement on emoji meanings, consistent with the idea that, after a decade of use, face emojis have become a widely conventionalised semiotic system accessible to digital media users regardless of age.

Abstract

Experimental research has yielded many important psycholinguistic findings in bi-/multilingualism. However, cognitive computational models of sentence processing were limited to the single-language case until recently. In this methodological review, we discuss cognitive modelling work that uses the Bilingual Dual-path model to simulate experimental research on bilingual sentence production, processing, and development. As a detailed example of such work, we then report on new simulations conducted with the model. Finally, we suggest directions for future cognitive modelling research using this model.

Abstract

Sentence production is a stage-like process of mapping a conceptual representation to the linear speech signal via grammatical rules. While the typological diversity of languages is vast and thus must necessarily influence sentence production, psycholinguistic studies of diverse languages are comparatively rare. Here, we present data from a sentence planning and production study in Pitjantjatjara, an Australian Indigenous language that has highly flexible word order. Forty-nine (N = 49) native speakers described pictures of two-participant scenes while their eye-movements were recorded. Participants produced all possible orders of agent, patient, and verb. There was a general preference to produce agent-initial orders, but word order was influenced by the semantic properties of agent and patient referents (± human). Analyses of participants’ eye-movements revealed early relational encoding of the entire event, whereby speakers distributed their attention between agent and patient referents in a manner that is different than typically observed in languages that have more restricted word order options. Relational encoding was influenced by the word order that participants eventually produced. The results provide evidence to suggest that sentence planning in Pitjantjatjara is a hierarchical process, in which early relational encoding creates a wholistic conceptualization of an event, possibly driven by pressure to decide upon one of many possible word orders.

Abstract

The primary motor cortex (M1) is increasingly being recognized for its vital role in proprioceptive somatosensation. However, our current understanding of proprioceptive processing at the laminar scale is limited. Empirical findings in primates and rodents suggest a pronounced role of superficial cortical layers, but the involvement of deep layers has yet to be examined in humans. Submillimeter resolution functional magnetic resonance imaging (fMRI) has emerged in recent years, paving the way for studying layer-dependent activity in humans (laminar fMRI). In the present study, laminar fMRI was employed to investigate the influence of proprioceptive somatosensation on M1 deep layer activation using passive finger movements. Significant M1 deep layer activation was observed in response to proprioceptive stimulation across 10 healthy subjects using a vascular space occupancy (VASO)-sequence at 7 T. For further validation, two additional datasets were included which were obtained using a balanced steady-state free precession sequence with ultrahigh (0.3 mm) in-plane resolution, yielding converging results. These results were interpreted in the light of previous laminar fMRI studies and the active inference account of motor control. We propose that a considerable proportion of M1 deep layer activation is due to proprioceptive influence and that deep layers of M1 constitute a key component in proprioceptive circuits.

Abstract

The concept of brain age (BA) describes an integrative imaging marker of brain health, often suggested to reflect aging processes. However, the degree to which cross-sectional MRI features, including BA, reflect past, ongoing, and future brain changes across different tissue types from macro- to microstructure remains controversial. Here, we use multimodal imaging data of 39,325 UK Biobank participants, aged 44–82 years at baseline and 2,520 follow-ups within 1.12–6.90 years to examine BA changes and their relationship to anatomical brain changes. We find insufficient evidence to conclude that BA reflects the rate of brain aging. However, modality-specific differences in brain ages reflect the state of the brain, highlighting diffusion and multimodal MRI brain age as potentially useful cross-sectional markers.

Abstract

Advanced diffusion magnetic resonance imaging (dMRI) allows one to probe and assess brain white matter (WM) organisation and microstructure in vivo. Various dMRI models with different theoretical and practical assumptions have been developed, representing partly overlapping characteristics of the underlying brain biology with potentially complementary value in the cognitive and clinical neurosciences. To which degree the different dMRI metrics relate to clinically relevant geno- and phenotypes is still debated. Hence, we investigate how tract-based and whole WM skeleton parameters from different dMRI approaches associate with clinically relevant and white matter-related phenotypes (sex, age, pulse pressure (PP), body-mass-index (BMI), brain asymmetry) and genetic markers in the UK Biobank (UKB, n=52,140) and the Adolescent Brain Cognitive Development (ABCD) Study (n=5,844). In general, none of the imaging approaches could explain all examined phenotypes, though the approaches were overall similar in explaining variability of the examined phenotypes. Nevertheless, particular diffusion parameters of the used dMRI approaches stood out in explaining some important phenotypes known to correlate with general human health outcomes. A multi-compartment Bayesian dMRI approach provided the strongest WM associations with age, and together with diffusion tensor imaging, the largest accuracy for sex-classifications. We find a similar pattern of metric and tract-dependent asymmetries across datasets, with stronger asymmetries in ABCD data. The magnitude of WM associations with polygenic scores as well as PP depended more on the sample, and likely age, than dMRI metrics. However, kurtosis was most indicative of BMI and potentially of bipolar disorder polygenic scores. We conclude that WM microstructure is differentially associated with clinically relevant pheno- and genotypes at different points in life.

Abstract

Background
Reliable language mappings require sufficient language skills. This study evaluated whether linguistic task properties impact feasibility and reliability of navigated transcranial magnetic stimulation (nTMS)-based language mappings in aphasic glioma patients.

Methods
The effect of linguistic complexity on naming accuracy during baseline testing without stimulation and on the number of errors during nTMS was evaluated for 16 moderately and 4 severely expressive aphasic patients.

Result
During baseline, items acquired later in life and used less frequently, a higher amount of multisyllabic, compound, and inanimate items were named inaccurately. Even after removing these more complex items, less frequent and multisyllabic items were more error-prone during stimulation.

Conclusion
Higher linguistic item complexity was associated with decreased naming accuracy during baseline and resulted in a potentially higher false positive rate during nTMS in aphasic glioma patients. Thus, tailoring task complexity to individual performance capabilities may considerably support the preservation of residual functionality.

Abstract

Prediction is argued to be a key feature of human cognition, including in syntactic processing. Prediction error has been linked to dynamic changes in syntactic representations in theoretical models of language processing. This mechanism is termed error-based learning. Evidence from syntactic priming research supports error-based learning accounts; however, measuring prediction error itself has not been a research focus. Here we present a study exploring the use of pupillometry as a measure of prediction error during syntactic priming. We found a larger pupil response to the more complex and less expected passive structure. In addition, the pupil response predicted priming while being weakly dependent on changes in expectations over the experiment. We conclude that the pupil response is not only sensitive to syntactic complexity in comprehension, but there is some evidence that its magnitude is related to the adjustment of dynamic mental representations for syntax that lead to syntactic priming.

Abstract

The interaction engine is a label for the specialized capacities involved in human social interaction. The interaction engine comprises a suite of specific abilities that enable communication, for example, the capacity for rapid conversational turn-taking using multimodal signals, with systematic contingency between initiating signal and response—in which that contingency is often inference based rather than conventional in character. The properties of informal interaction subsumed within the broader “interaction engine” label appear to be largely universal, in contrast to the diversity of languages and many other aspects of social behavior. They seem to provide a platform that makes it possible for children to acquire their particular language and culture.

Abstract

Libraries are very often considered the hallway to developing knowledge. However, the lack of adequate staff within Indian libraries makes catering to the visitors’ needs difficult. Previous systems that have sought to address libraries’ needs through automation have mostly been limited to storage and fetching aspects while lacking in their interaction aspect. We propose to address this issue by incorporating social robots within Indian libraries that can communicate and address the visitors’ queries in a multi-modal fashion attempting to make the experience more natural and appealing while helping reduce the burden on the librarians. In this paper, we propose and deploy a Furhat robot as a robot librarian by programming it on certain core librarian functionalities. We evaluate our system with a physical robot librarian (N = 26). The results show that the robot librarian was found to be very informative and overall left with a positive impression and preference.

Abstract

This preregistered study examined whether visual experience influences conceptual representations by examining both gestural expression and feature listing. Gestures—mostly driven by analog mappings of visuospatial and motoric experiences onto the body—offer a unique window into conceptual representations and provide complementary information not offered by language-based features, which have been the focus of previous work. Thirty congenitally or early blind and 30 sighted Turkish speakers produced silent gestures and features for concepts from semantic categories that differentially rely on experience in visual (non-manipulable objects and animals) and motor (manipulable objects) information. Blind individuals were less likely than sighted individuals to produce gestures for non-manipulable objects and animals, but not for manipulable objects. Overall, the tendency to use a particular gesture strategy for specific semantic categories was similar across groups. However, blind participants relied less on drawing and personification strategies depicting visuospatial aspects of concepts than sighted participants. Feature-listing revealed that blind participants share considerable conceptual knowledge with sighted participants, but their understanding differs in fine-grained details, particularly for animals. Thus, while concepts appear broadly similar in blind and sighted individuals, this study reveals nuanced differences, too, highlighting the intricate role of visual experience in conceptual representations.

Abstract

Background
While individuals with autism often face challenges in everyday social interactions, they may demonstrate proficiency in structured theory of mind (ToM) tasks that assess their ability to infer others’ mental states. Using functional magnetic resonance imaging and pupillometry, we investigated whether these discrepancies stem from diminished spontaneous mentalizing or broader difficulties in unstructured contexts.
Methods
Fifty-two adults diagnosed with autism and 52 neurotypical control participants viewed the animated short Partly Cloudy, a nonverbal animated film with a dynamic social narrative known to engage the ToM brain network during specific scenes. Analysis focused on comparing brain and pupil responses to these ToM events. Additionally, dynamic intersubject correlations were used to explore the variability of these responses throughout the film.
Results
Both groups showed similar brain and pupil responses to ToM events and provided comparable descriptions of the characters’ mental states. However, participants with autism exhibited significantly stronger correlations in their responses across the film’s social narrative, indicating reduced interindividual variability. This distinct pattern emerged well before any ToM events and involved brain regions beyond the ToM network.
Conclusions
Our findings provide functional evidence of spontaneous mentalizing in autism, demonstrating this capacity in a context that affords but does not require mentalizing. Rather than responses to ToM events, a novel neurocognitive signature—interindividual variability in brain and pupil responses to evolving social narratives—differentiated neurotypical individuals from individuals with autism. These results suggest that idiosyncratic narrative processing in unstructured settings, a common element of everyday social interactions, may offer a more sensitive scenario for understanding the autistic mind.

Abstract

Cochlear implants (CIs) are neural prostheses that restore some level of hearing capacity, albeit conveying a less fine-grained speech signal than normal hearing conditions. For example, CIs convey altered fundamental frequency (F0) information, resulting in atypical lexical stress perception (e.g., distinguishing between the noun CONtent and the adjective conTENT) in languages in which this feature rests on F0 modulations. CI users can compensate for the degraded nature of the acoustic input by exploiting the audiovisual affordances of human communication, weighing more heavily the visual information provided by speakers (e.g., lip movements and gestures). Recent studies showed that, in individuals with normal hearing, the timing of simple up-and-down movements of the hand (i.e., beat gestures) biases lexical stress perception. The present study tested if the timing of beat gestures produced by an avatar can bias Dutch lexical stress perception in vocoded speech, which limits the reliability of F0 information in a way that mimics CI-hearing conditions. The effect of gestures in vocoded speech was particularly pronounced when hearing an ambiguous or the least frequent stress pattern in Dutch. These results suggest that (even artificially generated) beat gestures can support the perception of vocoded speech, especially when processing less frequent prosodic features.

Abstract

Acknowledging that the parent–child attachment is a dyadic relationship, we investigated differences between pairs of parents and preschool children based on gender configurations in the association between attachment and problem behavior. We looked at mother–daughter, mother–son, father–daughter, and father–son dyads, but also compared mothers and fathers, daughters and sons, and same versus different gender pairs. We employed multigroup structural equation modeling to explore moderation effects of gender in a sample of 446 independent pairs of parents and preschool children (2–5 years old) from the Netherlands. A stronger association between both secure and avoidant attachment and internalizing problems was found for father–son dyads compared to father–daughter dyads. A stronger association between both secure and avoidant attachment and externalizing problems was found for mother–son dyads compared to mother–daughter and father–daughter dyads. Sons showed a stronger negative association between secure attachment and externalizing problems, a stronger positive association between avoidant attachment and externalizing problems, and a stronger negative association between secure attachment and internalizing problems compared to daughters. These results provide evidence for gender moderation and demonstrate that a dyadic approach can reveal patterns of associations that would not be recognized if parent and child gender effects were assessed separately.

Abstract

Face-to-face communication relies on the seamless integration of multisensory signals, including voice, gaze, and head movements, to convey meaning effectively. This poses a fundamental computational challenge: optimally binding signals sharing the same communicative intention (e.g., looking at the addressee while speaking) and segregating unrelated signals (e.g., looking away while coughing), all within the rapid turn-taking dynamics of conversation. Critically, the computational mechanisms underlying this extraordinary feat remain largely unknown. Here, we cast face-to-face communication as a Bayesian Causal Inference problem to formally test whether prior expectations arbitrate between the integration and segregation of vocal and bodily signals. Specifically, we asked whether there is a stronger prior tendency to integrate audiovisual signals that convey the same communicative intention, thus establishing a crossmodal pragmatic correspondence. Additionally, we evaluated whether observers solve causal inference by adopting optimal Bayesian decision strategies or non-optimal approximate heuristics. In a spatial localization task, participants watched audiovisual clips of a speaker where the audio (voice) and the video (bodily cues) were sampled either from congruent positions or at increasing spatial disparities. Crucially, we manipulated the pragmatic correspondence of the signals: in a communicative condition, the speaker addressed the participant with their head, gaze and speech; in a non-communicative condition, the speaker kept the head down and produced a meaningless vocalization. We measured audiovisual integration through the ventriloquist effect, which quantifies how much the perceived audio position is misplaced towards the video position. Combining psychophysics with computational modelling, we show that observers solved audiovisual causal inference using non-optimal heuristics that nevertheless approximate optimal Bayesian inference with high accuracy. Remarkably, participants showed a stronger tendency to integrate vocal and bodily information when signals conveyed congruent communicative intent, suggesting that pragmatic correspondences enhance multisensory integration. Collectively, our findings provide novel and compelling evidence that face-to-face communication is shaped by deeply ingrained expectations about how multisensory signals should be structured and interpreted.

Abstract

*All authors contributed equally to this work
Meaningful gestures enhance degraded speech comprehension in neurotypical adults, but it is unknown whether this is the case for neurodivergent populations, such as autistic individuals. Previous research demonstrated atypical multisensory and speech-gesture integration in autistic individuals, suggesting that integrating speech and gestures may be more challenging and less beneficial for speech comprehension in adverse listening conditions in comparison to neurotypicals. Conversely, autistic individuals could also benefit from additional cues to comprehend speech in noise, as they encounter difficulties in filtering relevant information from noise. We here investigated whether gestural enhancement of degraded speech comprehension differs for neurotypical (n = 40, mean age = 24.1) compared to autistic (n = 40, mean age = 26.8) adults. Participants watched videos of an actress uttering a Dutch action verb in clear or degraded speech accompanied with or without a gesture, and completed a free-recall task. Gestural enhancement was observed for both autistic and neurotypical individuals, and did not differ between groups. In contrast to previous literature, our results demonstrate that autistic individuals do benefit from gestures during degraded speech comprehension, similar to neurotypicals. These findings provide relevant insights to improve communication practices with autistic individuals and to develop new interventions for speech comprehension.

Abstract

Experimental psychologists and psycholinguists increasingly turn to online research for data collection due to the ease of sampling many diverse participants in parallel. Online research has shown promising validity and consistency, but is it suitable for all paradigms? Specifically, is it reliable enough for individual differences research? The current paper reports performance on 15 tasks from a psycholinguistic individual differences battery, including timed and untimed assessments of linguistic abilities, as well as domain-general skills. From a demographically homogenous sample of young Dutch people, 149 participants participated in the lab study, and 515 participated online. Our results indicate that there is no reason to assume that participants tested online will underperform compared to lab-based testing, though they highlight the importance of motivation and the potential for external help (e.g., through looking up answers) online. Overall, we conclude that there is reason for optimism in the future of online research into individual differences.

Abstract

As lexicalized depictions, ideophones (also known as expressives or mimetics) differ fundamentally from other words both in the kinds of meanings they represent and the ways in which they represent them. This can make them difficult to capture using traditional methods for language description and documentation. We review some of the new and experimental techniques that have been used to elicit, describe, and analyse ideophones, and discuss how these can be used to address some of the unique challenges ideophones pose. They include stimulus-based elicitation; multimodal folk definitions; hybrid modes of analysis (combining images and text); and new ways of compiling and presenting multimodal ideophone corpora. We also review psycholinguistic methods for exploring the sensory properties of words and the organisation of the lexicon, such as sensory ratings and similarity judgment tasks, and discuss how these can contribute to our understanding of ideophone lexicons. Crucial to our approach is the combination of insights from multiple sources, the exploitation of polysemiotic resources (combining multiple modes of meaning making), and the integration of etic and emic perspectives. The discussion is structured around three key challenges: collecting ideophones, unravelling their slippery semantics, and representing them in ways that do justice to their special semiotic properties. The days when ideophones were just footnotes in grammars are long past. With more and more researchers working to document ideophones in languages around the world, and increasing interest in iconicity from across the language sciences, now is an excellent time to rethink the toolkit of documentary linguistics to make sure it can optimally deal with language in all its semiotic diversity.

Abstract

Visual cues play a key role in speech perception. Beat gestures (i.e., simple up-and-down hand movements) usually co-occur with prominence in speech. Previous studies found that hand beat timing can indicate word stress. The present study further examines whether hand beat timing influences spoken word recognition in a gradient fashion. On watching videos of a native speaker of Dutch uttering a disyllabic word voornaam while making a hand beat, 40 participants needed to decide if they heard the word with initial (VOORnaam, "first name") or final stress (voorNAAM, "respectable"). Crucially, nine beat apex timings were equally distributed between the pitch peaks of the two syllables. Results exhibited a gradient effect of hand beat timing on stress perception, which appeared not to be susceptible to brief pretest feedback implying that visual cues should be ignored. Our findings provide novel evidence for audiovisual interaction and can inform gesture generation in conversational agents.

Abstract

Speech is often accompanied by gestures. Since beat gestures—simple nonreferential up-and-down hand movements—frequently co-occur with prosodic prominence, they can indicate stress in a word and hence influence spoken-word recognition. However, little is known about the reverse influence of auditory speech on visual perception. The current study investigated whether lexical stress has an effect on the perceived timing of hand beats. We used videos in which a disyllabic word, embedded in a carrier sentence (Experiment 1) or in isolation (Experiment 2), was coupled with an up-and-down hand beat, while varying their degrees of asynchrony. Results from Experiment 1, a novel beat timing estimation task, revealed that gestures were estimated to occur closer in time to the pitch peak in a stressed syllable than their actual timing, hence reducing the perceived temporal distance between gestures and stress by around 60%. Using a forced-choice task, Experiment 2 further demonstrated that listeners tended to perceive a gesture, falling midway between two syllables, on the syllable receiving stronger cues to stress than the other, and this auditory effect was greater when gestural timing was most ambiguous. Our findings suggest that f0 and intensity are the driving force behind the temporal attraction effect of stress on perceived gestural timing. This study provides new evidence for auditory influences on visual perception, supporting bidirectionality in audiovisual interaction between speech-related signals that occur in everyday face-to-face communication.

Abstract

The increased interest in developing next-gen social robots has raised questions about the factors affecting the perception of robot emotions. This study investigates the impact of robot appearances (human-like, mechanical) and face regions (full-face, eye-region) on human perception of robot emotions. A between-subjects user study (N = 305) was conducted where participants were asked to identify the emotions being displayed in videos of robot faces, as well as a human baseline. Our findings reveal three important insights for effective social robot face design in Human-Robot Interaction (HRI): Firstly, robots equipped with a back-projected, fully animated face – regardless of whether they are more human-like or more mechanical-looking – demonstrate a capacity for emotional expression comparable to that of humans. Secondly, the recognition accuracy of emotional expressions in both humans and robots declines when only the eye region is visible. Lastly, within the constraint of only the eye region being visible, robots with more human-like features significantly enhance emotion recognition.

Abstract

Pathogenic genetic variants in the NuRD component CHD3 cause Snijders Blok–Campeau Syndrome, a neurodevelopmental disorder manifesting with intellectual disability and craniofacial anomalies. To investigate the role of CHD3 in craniofacial development, we differentiated control and CHD3-depleted human-induced pluripotent stem cells into cranial neural crest cells (CNCCs). In control lines, CHD3 is upregulated in early stages of CNCC specification, where it enhances the BMP signalling response by opening chromatin at BMP-responsive cis-regulatory elements and by increasing expression of BMP-responsive transcription factors, including DLX paralogs. CHD3 loss leads to repression of BMP target genes and loss of chromatin accessibility at cis-regulatory elements usually bound by BMP-responsive factors, causing an imbalance between BMP and Wnt signalling. Consequently, the CNCC specification fails, replaced by aberrant early-mesoderm identity, which can be partially rescued by titrating Wnt levels. Our findings highlight a novel role for CHD3 as a pivotal regulator of BMP signalling, essential for proper neural crest specification and craniofacial development. Moreover, these results suggest a molecular mechanism for the craniofacial anomalies of Snijders Blok–Campeau Syndrome.

Abstract

Advances in paleogenetics allowed the identification of protein-coding changes unique to Homo sapiens by comparing present-day and archaic hominin genomes. So far, experimental validation has been restricted to functional assays and model organisms. Large-scale biobanking now makes it possible to directly assess phenotypic consequences in living adults. Querying exomes of 455,000 UK Biobank participants at 37 sites with supposedly fixed human-specific changes, we identified 103 carriers at 17 positions, with variable allele counts across ances-tries. We performed phenotypic evaluations for two example changes. Individuals carrying archaic SSH2 alleles showed no clear deviations in an array of health, neuropsychiatric, and cognitive traits. Carriers of a TKTL1 mis-sense variant, previously linked to large effects on cortical neurogenesis, showed no obvious differences in brain anatomy, with many carriers holding college degrees. Our study demonstrates challenges associated with individual interrogation of key sites when seeking insights into the evolution of complex human traits and highlights the importance of including diverse ancestries in biobanking efforts.

Abstract

Online experimentation has become an essential tool in cognitive psychology, offering access to diverse participant samples. However, remote testing introduces variability in stimulus presentation and response timing due to differences in participant hardware, browsers, and internet conditions. To ensure the validity of online studies, it is crucial to assess the timing precision of experimental software. The present study evaluates the Individual Differences in Dutch Language Skills (IDLaS-NL) test battery, a collection of online tests designed to measure linguistic experience, domain-general cognitive skills, and linguistic processing. Implemented using Frinex, a programming environment developed at the Max Planck Institute for Psycholinguistics, IDLaS-NL allows researchers to customize test selections via a web platform. We conducted two studies to assess the timing precision of five chronometric tests within the battery. In Study 1, we evaluated the initial implementation of the tests, analyzing differences between expected and recorded stimulus presentation times, response latencies, and recording delays using the custom-made Web Experiment Analyzer (WEA). The results indicated imprecisions in some measures, particularly for reaction time and audio recording onset. Visual stimulus presentation, on the other hand, was fairly accurate. Study 2 introduced refined timing mechanisms in Frinex, incorporating specialized triggers for stimulus presentation and response registration. These adjustments improved timing precision, especially for speech production tasks. Overall, our findings confirm that Frinex achieves timing precision comparable to other widely used experimental platforms. While some variability in stimulus presentation and response timing is inherent to online testing, the results provide researchers with useful estimates of expected precision levels when using Frinex. This study contributes to the growing body of research on online testing methodologies by offering empirical insights into timing accuracy in web-based experiments.

Abstract

Background

The factors that contribute to language alternation by bilingual speakers with aphasia have been debated. Some studies suggest that atypical language mixing results from impairments in language control, while others posit that mixing is a way to enhance communicative effectiveness. To address this question, most prior research examined the appropriateness of language mixing in connected speech tasks.
Aims

The goal of this study was to provide new insight into the question whether language mixing in aphasia reflects a strategy to enhance verbal effectiveness or involuntary behaviour resulting from impaired language control.
Methods & procedures

Semi-structured web-based interviews with bilingual speakers with aphasia (N = 19) with varying language backgrounds were conducted. The interviews were transcribed and coded for: (1) Self-reports regarding language control and compensation, (2) instances of language mixing, and (3) in two cases, instances of repair initiation.
Outcomes & results

The results showed that several participants reported language control difficulties but that the knowledge of additional languages could also be recruited to compensate for lexical retrieval problems. Most participants showed no or very few instances of mixing and the observed mixes appeared to adhere to the pragmatic context and known functions of switching. Three participants exhibited more marked switching behaviour and reported corresponding difficulties with language control. Instances of atypical mixing did not coincide with clear problems initiating conversational repair.
Conclusions

Our study highlights the variability in language mixing patterns of bilingual speakers with aphasia. Furthermore, most of the individuals in the study appeared to be able to effectively control their languages, and to alternate between their languages for compensatory purposes. Control deficits resulting in atypical language mixing were observed in a small number of participants.

Abstract

Zoonoses are infectious diseases transmitted from animals to humans. Bats have been suggested to harbour more zoonotic viruses than any other mammalian order1. Infections in bats are largely asymptomatic2,3, indicating limited tissue-damaging inflammation and immunopathology. To investigate the genomic basis of disease resistance, the Bat1K project generated reference-quality genomes of ten bat species, including potential viral reservoirs. Here we describe a systematic analysis covering 115 mammalian genomes that revealed that signatures of selection in immune genes are more prevalent in bats than in other mammalian orders. We found an excess of immune gene adaptations in the ancestral chiropteran branch and in many descending bat lineages, highlighting viral entry and detection factors, and regulators of antiviral and inflammatory responses. ISG15, which is an antiviral gene contributing to hyperinflammation during COVID-19 (refs. 4,5), exhibits key residue changes in rhinolophid and hipposiderid bats. Cellular infection experiments show species-specific antiviral differences and an essential role of protein conjugation in antiviral function of bat ISG15, separate from its role in secretion and inflammation in humans. Furthermore, in contrast to humans, ISG15 in most rhinolophid and hipposiderid bats has strong anti-SARS-CoV-2 activity. Our work reveals molecular mechanisms that contribute to viral tolerance and disease resistance in bats.

Abstract

The ability to read is an important life skill and a major route to education. Dyslexia, characterized by difficulties with accurate/ fluent word reading, and poor spelling is influenced by genetic variation, with a twin study heritability estimate of 0.4–0.6. Until recently, genomic investigations were limited by modest sample size. We used a multivariate genome-wide association study (GWAS) method, MTAG, to leverage summary statistics from two independent GWAS efforts, boosting power for analyses of dyslexia; the GenLang meta-analysis of word reading (N = 27,180) and the 23andMe, Inc., study of dyslexia (Ncases = 51,800, Ncontrols = 1,087,070). We increased the effective sample size to 1,228,832 participants, representing the largest genetic study of reading-related phenotypes to date. Our analyses identified 80 independent genome-wide significant loci, including 36 regions which were not previously reported as significant. Of these 36 loci, 13 were novel regions with no prior association with dyslexia. We observed clear genetic correlations with cognitive and educational measures. Gene-set analyses revealed significant enrichment of dyslexia-associated genes in four neuronal biological process pathways, and findings were further supported by enrichment of neuronally expressed genes in the developing embryonic brain. Polygenic index analysis of our multivariate results predicted between 2.34–4.73% of variance in reading traits in an independent sample, the National Child Development Study cohort (N = 6410). Polygenic adaptation was examined using a large panel of ancient genomes spanning the last ~15 k years. We did not find evidence of selection, suggesting that dyslexia has not been subject to recent selection pressure in Europeans. By combining existing datasets to improve statistical power, these results provide novel insights into the biology of dyslexia.

Abstract

Preschoolers’ exposure to abstract language (i.e. talk beyond the here and now) during shared reading is associated with language development. This randomized intervention study tested whether preschoolers’ repeated exposure to simple and complex stories (as defined by the inferential demands of the story), and the extratextual talk associated with such stories, would lead to differences in language production during shared reading and to differential gains in vocabulary and narrative skills post intervention. An experimenter read scripted stories to 34 children (3;07–4;11) assigned to one of two story conditions (simple or complex) in small-groups, twice weekly over six weeks. Results showed that children in the complex story condition produced more complex language (as indexed by their mean length of utterance, use of mental and communication verbs, and use of subordinate clauses). However, post-intervention, children’s vocabulary and narrative skills did not differ between conditions. Specific kinds of stories and corresponding extratextual talk by adults may not only increase children’s exposure to rich and challenging input from the extratextual talk, but can also provide valuable opportunities for children to produce complex language. Theoretical and methodological implications are also discussed.

Abstract

When operating on gliomas near critical language regions, surgeons risk either leaving residual tumor or inducing permanent postoperative language deficits (PLDs). Despite the advent of intraoperative mapping techniques, subjective judgments frequently determine important surgical decisions. We aim to inform data-driven surgery by constructing a non-invasive mapping approach that quantitatively predicts the impact of individual surgical decisions on long-term language function. This study included 79consecutive patients undergoing resection of language-eloquent gliomas. Patients underwent preoperative navigated transcranial magnetic stimulation (TMS) language mapping to identify language-positive sites (“TMS points”) and their associated white matter tracts (“TMS tracts”) as well as formal language evaluations pre-and postoperatively. The resection of regions identified by preoperative mapping was correlated with permanent postoperative language deficits (PLDs). Resected tract segments (RTS) were normalized to MNI space for comparison with normative data. The resection of TMS points did not predict PLDs. However, a TMS point subgroup defined by white matter connectivity significantly predicted PLDs (OR = 8.74, p < 0.01) and demonstrated a canonical distribution of cortical language sites at a group level. TMS tracts recapitulated normative patterns of white matter connectivity defined by the Human Connectome Project. Subcortical resection of TMS tracts predicted PLDs independently of cortical resection (OR = 60, p < 0.001). In patients with PLDs, RTS showed significantly stronger co-localization with normative language-associated tracts compared to RTS in patients without PLDs (p < 0.05). Resecting patient-specific co-localizations between TMS tracts and normative tracts in native space predicted PLDs with an accuracy of 94% (OR = 134, p < 0.001). Prospective application of this data in a patient with glioblastoma precisely predicted the results of intraoperative language mapping with direct subcortical stimulation. Long-term postoperative language deficits result from resecting patient-specific white matter segments. We integrate these findings into a personalized tool that uses TMS language mappings, diffusion tractography, and population-level connectivity to preoperatively predict the long-term linguistic impact of individual surgical decisions.

Abstract

By studying communicative interactions between humans, we can investigate the basic processes underlying the evolution of language, including how humans manage to communicate in the first place, how they form novel conventions, how they create grammatical structure, and subsequent changes to their conventions and grammar. Communication experiments, which involve interactions between two or more human participants in artificial settings, are a useful method for addressing these questions within a controlled environment. These experiments can help researchers with teasing apart the effects of different variables on the emergence of language, which are typically confounded in naturalistic settings. In this chapter, we first briefly review the history of communication paradigms. We then summarize the procedures, designs, and typical measures that characterize communication experiments. Finally, we discuss the theoretical limitations and methodological challenges of using such paradigms and propose some ways forward.

Abstract

How do people shape the information they convey when they cannot rely on conventions from the language(s) they know? Silent gesture, a methodology in which hearing participants communicate using only their hands and bodies, has been a productive way to study this. Combined with learning and interaction, silent gesture provides the opportunity to simulate the emergence of artificial miniature sign languages in a laboratory setting, making it possible to closely observe how communicative strategies change and adapt as linguistic structure emerges. This chapter provides an overview of the phenomena investigated using silent gesture. By giving an in-depth example of silent gesture ‘in action’, we demonstrate how the method has been used to study the nature of reversible events, and their influence on word order. Furthermore, we evaluate options regarding stimuli presentation, participant selection, and setup details. Finally, we discuss silent gesture data analysis (manually as well as computationally).

Abstract

Impaired musical rhythm abilities and developmental speech-language related disorders are biologically and clinically intertwined. Prior work examining their relationship has primarily used small samples; here, we studied associations at population-scale by conducting the largest systematic epidemiological investigation to date (total N = 39,358). Based on existing theoretical frameworks, we predicted that rhythm impairment would be a significant risk factor for speech-language disorders in the general adult population. Findings were consistent across multiple independent datasets and rhythm subskills (including beat synchronization and rhythm discrimination), and aggregate meta-analyzed data showed that non-linguistic rhythm impairment is a modest but consistent risk factor for developmental speech, language, and reading disorders (OR = 1.33 [1.18 – 1.49]; p < .0001). Further, cross-trait polygenic score analyses (total N = 7180) indicated shared genetic architecture between musical rhythm and reading abilities, suggesting genetic pleiotropy between musicality and language-related phenotypes.

Abstract

In reply to Magnuson, Crinnion, Luthra, Gaston, and Grubb (2023), we challenge their conclusion that on-line activation feedback improves word recognition. This type of feedback is instantiated in the TRACE model (McClelland & Elman, 1986) as top-down spread of activation from lexical to phoneme nodes. We give two main reasons why Magnuson et al.'s demonstration that activation feedback speeds up word recognition in TRACE is not informative about whether activation feedback helps humans recognize words. First, the same speed-up could be achieved by changing other parameters in TRACE. Second, more fundamentally, there is room for improvement in TRACE's performance only because the model, unlike Bayesian models, is suboptimal. We also challenge Magnuson et al.'s claim that the available empirical data support activation feedback. The data they base this claim on are open to alternative explanations and there are data against activation feedback that they do not discuss. We argue, therefore, that there are no computational or empirical grounds to conclude that activation feedback benefits human spoken-word recognition and indeed no theoretical grounds why activation feedback would exist. Other types of feedback, for example feedback to support perceptual learning, likely do exist, precisely because they can help listeners recognize words.

Abstract

Recent decades have substantiated the understanding that the function of language relies on an elaborate network of not only cortical but also subcortical structures of the human brain. Therefore, efforts have been made in the neurosurgical field to delineate and preserve the synergy of both cortical language hubs and subcortical white matter tracts on a patient-tailored basis. Preferably, this mapping of function is achieved during the preoperative phase, thereby aiding meticulous presurgical planning. In this chapter, we present the techniques enabling this preoperative functional delineation of language: the combination of cortical stimulation mapping with navigated transcranial magnetic stimulation (nTMS) and tractography of white matter bundles for language. We commence in the first part with a stepwise description of nTMS language mapping and an overview of tractography approaches through region of interest placement and the merging of the two methods. In the second part, we depict the applicability of this combined approach by outlining the theory of language and the anatomy behind the intricate language system that these methods aim to preserve. Lastly, we present an illustrative case in order to depict the implementation in the individual. Through discussing the foundational principles of tractography and the cutting-edge applications of nTMS in language mapping, this chapter elucidates how these technologies can maximize surgical outcomes while preserving human language capacity.

Abstract

The study investigated whether the perspective of multimodal input in visuospatial maps predicts children’s spatial performance, particularly verbal recall and direction-following behavior. 5-year-old monolingual Turkish children were engaged in the Directions Task, which included visuospatial maps and videos of a speaker describing routes on maps in three conditions: Speech-Gesture combination with a front-facing view, Speech-Gesture combination with an upper back angle, and Speech-only condition with a front-facing view for control. Children were asked to verbally recall and draw the route described in the videos. They also engaged in perspective-taking, mental rotation, and relational reasoning tasks. Results showed that children’s verbal recall, but not necessarily behavioral recall, was enhanced by receiving multimodal directions. Moreover, children’s relational reasoning and perspective-taking abilities modulate their verbal recall performances. The results of this study underline the importance of multimodal input and presentation perspective in enhancing children’s spatial performance.

Abstract

Gestures express redundant or complementary information to speech they accompany by depicting visual and spatial features of referents. In doing so, they recruit both spatial and verbal cognitive resources that underpin the processing of visual semantic information and its integration with speech. The relation between spatial and verbal skills and gesture comprehension, where gestures may serve different roles in relation to speech is yet to be explored. This study examined the role of spatial and verbal skills in processing gestures that expressed redundant or complementary information to speech during the comprehension of spatial relations between objects. Turkish-speaking adults (N=74) watched videos describing the spatial location of objects that involved perspective-taking (left-right) or not (on-under) with speech and gesture. Gestures either conveyed redundant information to speech (e.g., saying and gesturing “left”) or complemented the accompanying demonstrative in speech (e.g., saying “here,” gesturing “left”). We also measured participants’ spatial (the Corsi block span and the mental rotation tasks) and verbal skills (the digit span task). Our results revealed nuanced interactions between these skills and spatial language comprehension, depending on the modality in which the information was expressed. One insight emerged prominently. Spatial skills, particularly spatial working memory capacity, were related to enhanced comprehension of visual semantic information conveyed through gestures especially when this information was not present in the accompanying speech. This study highlights the critical role of spatial working memory in gesture processing and underscores the importance of examining the interplay among cognitive and contextual factors to understand the complex dynamics of multimodal language.

Abstract

Background

Developmental delay (DD) poses challenges to children's overall development, necessitating early detection and intervention. Existing screening tools in China focus mainly on children with developmental issues in two or more domains, diagnosed as global developmental delay (GDD). However, the recent rise of early childhood development (ECD) concepts has expanded the focus to include not only those with severe brain development impairments but also children who lag in specific domains due to various social-environmental factors, with the aim of promoting positive development through active intervention. To support this approach, corresponding screening tools need to be developed.
Methods

The current study used a two-phase design to develop and validate the Parent-Reported Indicator of Developmental Evaluation for Chinese Children (PRIDE) tool. In Phase 1, age-specific milestone forms for PRIDE were created through a survey conducted in urban and rural primary care clinics across four economic regions in China. In Phase 2, PRIDE was validated in a community-based sample. Sensitivity and specificity of both PRIDE and Ages and Stages Questionnaires (ASQ)-3 were estimated using inverse probability weights (IPW) and multiple imputation (MI) to address planned and unplanned missing data.
Results

In Phase 1 involving a total of 1160 participants aged 1 to 48 months, 63 items were selected from the initial item pool to create 10 age-specific PRIDE forms. Our Phase 2 study included 777 children within the same age range. PRIDE demonstrated an estimated sensitivity and specificity of 83.3% [95% confidence interval (CI): 56.8%–100.0%] and 84.9% (95% CI: 82.8%–86.9%) in the identification of DD.
Conclusion

The findings suggest that PRIDE holds promise as a sensitive tool for detecting DD in community settings.

Abstract

Language is often regarded as a defining trait of our species, but what are its core properties? In 1960, Hockett published ‘The origin of speech’ enumerating 13 design features presumed to be common to all languages, and which, taken together, separate language from other communication systems. Here. we review which features still hold true in light of new evidence from cognitive science, linguistics, animal cognition, and anthropology, and demonstrate how a revised understanding of language highlights three core aspects: that language is inherently multimodal and semiotically diverse; that it functions as a tool for semantic, pragmatic, and social inference, as well as facilitating categorization; and that the processes of interaction and transmission give rise to central design features of language.

Abstract

Language operates within the cognitive machinery of its users. Hence language structure is likely to evolve under the pressure of cognitive constraints (Christiansen & Chater, 2008). The challenge remains, however, in determining precisely how this may have occurred. Hierarchical recursive structures are especially difficult to relate to finite cognitive features. Here, we propose a new cognitive account explaining why Center Embedded recursive structures of relative clauses (as in The boy A1 the dog A2 chases B2 falls B1) (A1A2B2B1) are ubiquitous among thousands of languages, whereas Crossed-Dependent (CD) structures (A1A2B1B2) hardly ever occur. The preponderance of CE grammars is surprising considering they can produce dependent elements at longer distances than CD. We propose that this can be explained by memory retrieval mechanisms combined with linguistic word binding operations (role assignment). Processing CE requires the sequential retrieval of referent words in a backward direction, and CD in a forward direction. We first specify two Retrieval-and-Binding (R&B) functions, from which we derive mathematically that R&B performance under backwards recall (CE) exceeds performance under forward recall (CD). Next, we reanalyze an existing dataset that investigated strategies of recall and review the literature on sequential recall strategies under conditions that mimic sentence processing. The reanalysis verified the predictions of our account and showed that a backwards recall (CE) strategy is superior under conditions relevant to language processing. We suggest that the productive power of recursive embeddings is best conserved in a CE instantiation because memory mechanisms optimally support the processing of this structure, which might explain why CE has prevailed during language evolution.

Abstract

Combining academics and athletics is challenging but important for the psychological and psychosocial development of those involved. However, little is known about how experiences in academics spill over and relate to athletics. Drawing on the enrichment mechanisms proposed by the Work-Home Resources model, we posit that study crafting behaviours are positively related to volatile personal resources, which, in turn, are related to higher athletic achievement. Via structural equation modelling, we examine a path model among 243 student-athletes, incorporating study crafting behaviours and personal resources (i.e., positive affect and study engagement), and self- and coach-rated athletic achievement measured two weeks later. Results show that optimising the academic environment by crafting challenging study demands relates positively to positive affect and study engagement. In turn, positive affect related positively to self-rated athletic achievement, whereas – unexpectedly – study engagement related negatively to coach-rated athletic achievement. Optimising the academic environment through cognitive crafting and crafting social study resources did not relate to athletic outcomes. We discuss how these findings offer new insights into the interplay between academics and athletics.

Abstract

Changes in the activity profile of cortical neurons are due to effects at the scale of local and long-range networks. Accordingly, abrupt transitions in the state of cortical neurons—a phenomenon known as Up-Down states—have been attributed to variation in the activity of afferent neurons. However, cellular physiology and morphology may also play a role in causing Up-Down states. This study examines the impact of dendritic nonlinearities, particularly those mediated by voltage-dependent NMDA receptors, on the response of cortical neurons to balanced excitatory/inhibitory synaptic inputs. Using a neuron model with two segregated dendritic compartments, we compared cells with and without dendritic nonlinearities. NMDA receptors boosted somatic firing in the balanced condition and increased the correlation between membrane potentials across the compartments of the neuron model. Dendritic nonlinearities elicited strong bimodality in the distribution of the somatic potential when the cell was driven with cortical-like input. Moreover, dendritic nonlinearities could detect small input fluctuations and lead to Up-Down states whose statistics and dynamics closely resemble electrophysiological data. Up-Down states also occurred in recurrent networks with oscillatory firing activity, as in anaesthetized animal models, when dendritic NMDA receptors were partially disabled. These findings suggest that there is a dissociation between cellular and network-level features that could both contribute to the emergence of Up-Down states. Our study highlights the complex interplay between dendritic integration and activity-driven dynamics in the origin of cortical bistability.

Abstract

To study patterns in behavior, fitness, and population dynamics, estimating the age of the individuals is often a necessity. Specifically, age estimation of young animals is very important for animal rehabilitation centers because it may determine if the animal should be taken in and, if so, what care is optimal for its rehabilitation. Accurate age estimation is also important to determine the growth pattern of an individual, and it is needed to correctly interpret the influence of early body condition on its growth trajectories. The purpose of our study was to find body measurements that function as good age estimators in young (up to 3 months old) harbor seals (Phoca vitulina vitulina), placing emphasis on noninvasive techniques that can be used in the field. To meet this goal, body mass (BM), dorsal standard length (DSL), upper canine length (CL), body condition (BC), and sex were determined from 45 Harbor Seal pups of known age. Generalized additive mixed models were fitted to find how well these morphometric measures predicted age, and the results from the selected model were used to compute growth curves and to create a practical table to determine the age of young animals in the field. We found that both DSL and CL—and to some extent sex—were useful predictors for estimating age in young harbor seals and that the growth rate of pups raised in captivity is significantly lower than for those raised in the wild. In addition, we found no evidence for compensatory growth, given that animals that arrived at the center with a poor BM or BC continued to show lower BM or BC throughout almost the entire rehabilitation period.

Abstract

The long-standing claim that young children are the main agents of language change is often presented as an established fact, and has tacitly guided research in developmental science and evolutionary linguistics. It rests on the assumption that language change arises from language acquisition errors predominantly committed by children. Here, we review whether arguments in support of this idea stand up to logical and empirical scrutiny. We conclude that while children’s imperfect learning indeed leads them to produce input-divergent linguistic variants, there is no convincing evidence that it is these child-generated innovations that eventually spread through the language community, nor that language change is mainly driven by constraints and biases operating uniquely in children. By exposing the conceptual and empirical shortcomings of overemphasizing children as the agents of language change, we hope to rebalance the field toward a more nuanced understanding of how individual- and population-level processes shape language change.

Abstract

Apolipoprotein E ε4 is a major genetic risk factor for Alzheimer’s disease, and some apolipoprotein E ε4 carriers show Alzheimer’s disease–related neuropathology many years before cognitive changes are apparent. Therefore, studying healthy apolipoprotein E genotyped individuals offers an opportunity to investigate the earliest changes in brain measures that may signal the presence of disease-related processes. For example, subtle changes in functional magnetic resonance imaging functional connectivity, particularly within the default mode network, have been described when comparing healthy ε4 carriers to ε3 carriers. Similarly, very mild impairments of episodic memory have also been documented in healthy apolipoprotein E ε4 carriers. Here, we use a naturalistic activity (movie watching), and a marker of episodic memory encoding (transient changes in functional magnetic resonance imaging activity and functional connectivity around so-called ‘event boundaries’), to investigate potential phenotype differences associated with the apolipoprotein E ε4 genotype in a large sample of healthy adults. Using Bayes factor analyses, we found strong evidence against existence of differences associated with apolipoprotein E allelic status. Similarly, we did not find apolipoprotein E-associated differences when we ran exploratory analyses examining: functional system segregation across the whole brain, and connectivity within the default mode network. We conclude that apolipoprotein E genotype has little or no effect on how ongoing experiences are processed in healthy adults. The mild phenotype differences observed in some studies may reflect early effects of Alzheimer’s disease–related pathology in apolipoprotein E ε4 carriers.

Abstract

Tractography has emerged as a central tool for mapping the cerebral white matter architecture. However, its scientific value continues to be a subject of debate, given its inherent limitations in anatomical accuracy. This concise communication showcases key points of a debate held at the 2024 Tract-Anat Retreat, addressing the trade-offs between the accuracy and utility of tractography. While tractography remains constrained by limitations related to resolution, sensitivity, and validation, its usefulness and utility in areas such as surgical planning, disorder prediction, and the elucidation of brain development are emphasized. These perspectives highlight the necessity of context-specific interpretation, anatomically informed algorithms, and the continuous refinement of tractography workflows to achieve an optimal balance between accuracy and utility.

Abstract

Hemispheric brain asymmetry is a basic organizational principle of the human brain and has been implicated in various psychiatric conditions, including autism spectrum disorder. Brain asymmetry is not a uniquely human feature and is observed in other species such as the mouse. Yet, asymmetry patterns are generally nuanced, and substantial sample sizes are required to detect these patterns. In this pre-registered study, we use a mouse dataset from the Province of Ontario Neurodevelopmental Network, which comprises structural MRI data from over 2000 mice, including genetic models for autism spectrum disorder, to reveal the scope and magnitude of hemispheric asymmetry in the mouse. Our findings demonstrate the presence of robust hemispheric asymmetry in the mouse brain, such as larger right hemispheric volumes towards the anterior pole and larger left hemispheric volumes toward the posterior pole, opposite to what has been shown in humans. This suggests the existence of species-specific traits. Further clustering analysis identified distinct asymmetry patterns in autism spectrum disorder models, a phenomenon that is also seen in atypically developing participants. Our study shows potential for the use of mouse models in studying the biological bases of typical and atypical brain asymmetry but also warrants caution as asymmetry patterns seem to differ between humans and mice.

Abstract

Despite the impact of tractography on human brain mapping, direct validation and biological interpretation remain challenging. This short communication summarizes the key points of a debate held at the 2024 Tract-Anat Retreat on whether animal models are useful for studying human neuroanatomy with diffusion MRI tractography. While recognizing limitations, such as anatomical and biological differences between species, hardware and acquisition considerations and direct translation and interpretation, we identified immense value and utility of animal models for tractography including validation with histology, acquiring high-resolution datasets, exploring disease mechanisms, and advancing comparative neuroanatomy. These perspectives highlight the translational potential of preclinical models to inform tractography methodologies and underscore the need for careful species selection, methodological rigor, and ethical oversight in cross-species neuroimaging research.

Abstract

When talking, speakers naturally produce hand movements (co-speech gestures) that contribute to communication. Evidence in Dutch suggests that the timing of simple up-and-down, non-referential “beat” gestures influences spoken word recognition: the same auditory stimulus was perceived as CONtent (noun, capitalized letters indicate stressed syllables) when a beat gesture occurred on the first syllable, but as conTENT (adjective) when the gesture occurred on the second syllable. However, these findings were based on a small number of minimal pairs in Dutch, limiting the generalizability of the findings. We therefore tested this effect in Spanish, where lexical stress is highly relevant in the verb conjugation system, distinguishing bailo, “I dance” with word-initial stress from bailó, “she danced” with word-final stress. Testing a larger sample (N = 100), we also assessed whether individual differences in working memory capacity modulated how much individuals relied on the gestures in spoken word recognition. The results showed that, similar to Dutch, Spanish participants were biased to perceive lexical stress on the syllable that visually co-occurred with a beat gesture, with the effect being strongest when the acoustic stress cues were most ambiguous. No evidence was found for by-participant effect sizes to be influenced by individual differences in phonological or visuospatial working memory. These findings reveal gestural-speech coordination impacts lexical stress perception in a language where listeners are regularly confronted with such lexical stress contrasts, highlighting the impact of gestures’ timing on prominence perception and spoken word recognition.

Abstract

This book is about social action as it is carried out in everyday life. To some readers, the phrase social action may evoke the idea of people taking the initiative for change at the political and economic level of society; these are social actions that take days, months, or years to accomplish. The kinds of actions this book is concerned with are, instead, much more rapid and minute. They are actions performed on the fly, in the back and forth of ordinary interaction; they are actions like questions, answers, complaints, compliments, and requests. As a species of social action, requests serve a basic function: getting help from others. Every day in a community, people make hundreds of requests of one another, most of which are small requests for mundane things such as passing an item or performing a service around the house. Another way of thinking about requests is as the exercise of social influence in our everyday encounters, the kind of influence with tangible effects on the subsequent conduct of those around us. The book reports on an extensive study of requests “in the wild,” through the methodical observation and analysis of naturally occurring social interactions captured on video. Using the case of everyday requests among speakers of Italian, the book shows that our resources for social action are organized in systems—that is, in coherent sets of interdependent practices. It argues that such systems are part of the social order, as they shape, constrain, and enable interaction between people.

Abstract

A strong predictor of children's language is performance on non-word repetition (NWR) tasks. However, the basis of this relationship remains unknown. Some suggest that NWR tasks measure phonological working memory, which then affects language growth. Others argue that children's knowledge of language/language experience affects NWR performance. A complicating factor is that most studies focus on school-aged children, who have already mastered key language skills. Here, we present a new NWR task for English-learning 2-year-olds, use it to assess the effect of NWR performance on concurrent and later vocabulary development, and compare the children's performance with that of an experience-based computational model (CLASSIC). The new NWR task produced reliable results; replicating wordlikeness effects, word-length effects, and the relationship with concurrent and later language ability we see in older children. The model also simulated all effects, suggesting that the relationship between vocabulary and NWR performance can be explained by language experience-/knowledge-based theories.

Abstract

Emotional facial expressions often take place during communicative face-to-face interactions. Yet little is known as to whether natural spoken processing can be modulated by emotional expressions during online processing. Furthermore, the functional independence of syntactic processing from other cognitive and affective processes remains a long-standing debate in the literature. To address these issues, this study investigated the influence of masked emotional facial expressions on syntactic speech processing. Participants listened to sentences that could contain morphosyntactic anomalies while a masked emotional expression was presented for 16 ms (i.e., subliminally) just preceding the critical word. A larger Left Anterior Negativity (LAN) amplitude was observed for both emotional faces (i.e., happy and angry) compared to neutral ones. Moreover, a larger LAN amplitude was found for angry faces than for happy faces. Finally, a reduced P600 amplitude was observed only for angry faces when compared to neutral faces. Collectively, the results presented here indicate that first-pass syntactic parsing is influenced by emotional visual stimuli even under masked conditions and that this effect extends also to later linguistic processes. These findings constitute evidence in favor of an interactive view of language processing as integrated within a complex and integrated system for human communication.

Abstract

Prior research shows that self-referential information (e.g., seeing one's own face) is prioritized in human cognition. However, the brain signal variability underlying self-processing remains scarcely treated in the literature. Additionally, less is known about whether the processing of self-referential visual content can be modulated by facial expressions of emotion, as these resemble more natural situations than neutral expressions. This study therefore investigated the brain signal variability underlying self-referential visual processing and its possible interaction with emotional facial expressions, as indexed by multiscale entropy analysis (MSE). This metric captures the temporal complexity or variability contained in neural patterns at varying timescales. Thirty-two participants were presented with distinctive facial identities (self, friend, and unknown) displaying different facial expressions (happy, neutral, and angry) and performed an identity recognition task. Our results showed that brain signal variability decreases in response to self-faces compared to other identities. Similarly, brain signal variability also decreases for friend faces relative to unknown faces. This reduction in complexity could be indicative of greater efficiency during the preferential processing of personally relevant stimuli. Furthermore, the data observed here show that self-processing is unaffected by facial expressions of emotion, suggesting an independent processing of identity from more dynamic facial information, particularly when the task demands are focused on identity recognition. These results provide novel evidence of the moment-to-moment brain signal variability involved in the identity of the self and others. The evidence presented here adds to a growing literature highlighting the relevance of neural variability for understanding brain-behavior relationships.

Abstract

Pragmatic phenomena are characterized by extreme variability, which makes it difficult to draw sound generalizations about the role of social cognition in pragmatic language by and large. I introduce cultural evolutionary pragmatics as a new framework for the study of the interdependence between language and social cognition, and point at the study of common-ground management across languages and ages as a way to test the reliance of pragmatic language on social cognition. I illustrate this new research line with three experiments on article use by second language speakers, whose mother tongue lacks articles. These L2 speakers are known to find article use challenging and it is often argued that their difficulties stem from articles being pragmatically redundant. Contrary to this view, the results of this exploratory study support the view that proficient article use requires automatizing basic socio-cognitive processes, offering a window into the interdependence between language and social cognition.

Abstract

How might social cognition help us communicate through language? At what levels does this interaction occur? In classical views, social cognition is independent of language, and integrating the two can be slow, effortful, and error-prone. But new research into word level processes reveals that communication
is brimming with social micro-processes that happen in real time, guiding even the simplest choices like how we use adjectives, articles, and demonstratives. We interpret these findings in the context of advances in theoretical models of social cognition and propose a Communicative Mind-Tracking
framework, where social micro-processes aren’t a secondary process in how we use language—they are fundamental to how communication works.