Monthly New Publications

Abstract

Humans acquire word knowledge through producing and comprehending spoken and written language. Word learning continues into adulthood and knowledge accumulates across the lifespan. Therefore, receptive vocabulary size is often conceived of as a proxy for linguistic experience and plays a central role in assessing individuals’ language proficiency. There is currently no valid open access test available for assessing receptive vocabulary size in German-speaking adults. We addressed this gap and developed the German Auditory and Image Vocabulary Test (GAudI). In the GAudI, participants are presented with spoken test words and have to indicate their meanings by selecting the corresponding picture from a set of four alternatives. Here we describe the development of the test and provide evidence for its validity. Specifically, we report a study in which 168 German-speaking participants completed the GAudI and five other tests tapping into linguistic experience: one test measuring print exposure, two tests measuring productive vocabulary, one test assessing knowledge of book language grammar, and a test of receptive vocabulary that was normed in adolescents. The psychometric properties of the GAudI and its relationships to the other tests demonstrate that it is a suitable tool for measuring receptive vocabulary size. We offer an open-access digital test environment that can be used for research purposes, accessible via https://ems13.mpi.nl/bq4_customizable_de/researchers_welcome.php.

Abstract

Translational network neuroscience aims to integrate advanced neuroimaging and data analysis techniques into clinical practice to better understand and treat neurological disorders. Despite the promise of technologies such as functional MRI and diffusion MRI combined with network analysis tools, the field faces several challenges that hinder its swift clinical translation. We have identified nine key roadblocks that impede this process: (a) theoretical and basic science foundations; (b) network construction, data interpretation, and validation; (c) MRI access, data variability, and protocol standardization; (d) data sharing; (e) computational resources and expertise; (f) interdisciplinary collaboration; (g) industry collaboration and commercialization; (h) operational efficiency, integration, and training; and (i) ethical and legal considerations. To address these challenges, we propose several possible solution strategies. By aligning scientific goals with clinical realities and establishing a sound ethical framework, translational network neuroscience can achieve meaningful advances in personalized medicine and ultimately improve patient care. We advocate for an interdisciplinary commitment to overcoming translational hurdles in network neuroscience and integrating advanced technologies into routine clinical practice.

Abstract

We introduce a new method for measuring prediction and language-vision interactions: tracking the trajectories of hand-reaching movements in Virtual Reality (VR) environments. Spatiotemporal trajectory tracking of hand-reaching movements in VR offers an ecologically valid yet controlled medium for conducting experiments in an environment that mirrors characteristics of real-world behaviors. Importantly, it enables tracking the continuous dynamics of processing on a single-trial level. In an exploratory experiment L2 speakers heard predictive or non-predictive sentences (e.g., “The barber cuts the hair” vs. “The coach remembers the hair”). Participants’ task was to move their hands as quickly and as accurately as possible towards the object most relevant to the sentence. We measured reaction times (RTs) and hand-reaching trajectories as indicators of predictive behavior. There was a main effect of predictability: Predictable items were touched faster than unpredictable ones. Importantly, uncertainty was captured using spatiotemporal survival analysis by prolonged fluctuations in upward and downward vertical hand movements before making a final move to target or distractor. Self-correction of prediction errors was revealed by participants switching the direction of hand-reaching movements mid-trial. We conclude that the Virtual Hand Paradigm enables measuring the onset and dynamics of predictive behavior in real time in single and averaged trial data and captures (un)certainty about target objects and the self-correction of prediction error online in ‘close to real-world’ experimental settings. The new method has great potential to provide additional insights about time-course and intermediate states of processing, provisional interpretations and partial target commitments that go beyond other state-of-the-art methods.

Abstract

We examined the morphosyntactic prediction ability of child heritage speakers and the role of reading skills and language experience in predictive processing. Using visual world eye-tracking, we focused on predictive use of case-marking cues in Turkish with monolingual (N=49, Mage=83 months) and heritage children, who were early bilinguals of Turkish and Dutch (N=30, Mage=90 months). We found quantitative differences in magnitude of the prediction ability of monolingual and heritage children; however, their overall prediction ability was on par. The heritage speakers’ prediction ability was facilitated by their reading skills in Dutch, but not in Turkish as well as by their heritage language exposure, but not by engagement in literacy activities. These findings emphasize the facilitatory role of reading skills and spoken language experience in predictive processing. This study is the first to show that in a developing bilingual mind, effects of reading-on-prediction can take place across modalities and across languages.

Abstract

Advanced diffusion magnetic resonance imaging (dMRI) allows one to probe and assess brain white matter (WM) organisation and microstructure in vivo. Various dMRI models with different theoretical and practical assumptions have been developed, representing partly overlapping characteristics of the underlying brain biology with potentially complementary value in the cognitive and clinical neurosciences. To which degree the different dMRI metrics relate to clinically relevant geno- and phenotypes is still debated. Hence, we investigate how tract-based and whole WM skeleton parameters from different dMRI approaches associate with clinically relevant and white matter-related phenotypes (sex, age, pulse pressure (PP), body-mass-index (BMI), brain asymmetry) and genetic markers in the UK Biobank (UKB, n=52,140) and the Adolescent Brain Cognitive Development (ABCD) Study (n=5,844). In general, none of the imaging approaches could explain all examined phenotypes, though the approaches were overall similar in explaining variability of the examined phenotypes. Nevertheless, particular diffusion parameters of the used dMRI approaches stood out in explaining some important phenotypes known to correlate with general human health outcomes. A multi-compartment Bayesian dMRI approach provided the strongest WM associations with age, and together with diffusion tensor imaging, the largest accuracy for sex-classifications. We find a similar pattern of metric and tract-dependent asymmetries across datasets, with stronger asymmetries in ABCD data. The magnitude of WM associations with polygenic scores as well as PP depended more on the sample, and likely age, than dMRI metrics. However, kurtosis was most indicative of BMI and potentially of bipolar disorder polygenic scores. We conclude that WM microstructure is differentially associated with clinically relevant pheno- and genotypes at different points in life.

Abstract

To study patterns in behavior, fitness, and population dynamics, estimating the age of the individuals is often a necessity. Specifically, age estimation of young animals is very important for animal rehabilitation centers because it may determine if the animal should be taken in and, if so, what care is optimal for its rehabilitation. Accurate age estimation is also important to determine the growth pattern of an individual, and it is needed to correctly interpret the influence of early body condition on its growth trajectories. The purpose of our study was to find body measurements that function as good age estimators in young (up to 3 months old) harbor seals (Phoca vitulina vitulina), placing emphasis on noninvasive techniques that can be used in the field. To meet this goal, body mass (BM), dorsal standard length (DSL), upper canine length (CL), body condition (BC), and sex were determined from 45 Harbor Seal pups of known age. Generalized additive mixed models were fitted to find how well these morphometric measures predicted age, and the results from the selected model were used to compute growth curves and to create a practical table to determine the age of young animals in the field. We found that both DSL and CL—and to some extent sex—were useful predictors for estimating age in young harbor seals and that the growth rate of pups raised in captivity is significantly lower than for those raised in the wild. In addition, we found no evidence for compensatory growth, given that animals that arrived at the center with a poor BM or BC continued to show lower BM or BC throughout almost the entire rehabilitation period.

Abstract

When talking, speakers naturally produce hand movements (co-speech gestures) that contribute to communication. Evidence in Dutch suggests that the timing of simple up-and-down, non-referential “beat” gestures influences spoken word recognition: the same auditory stimulus was perceived as CONtent (noun, capitalized letters indicate stressed syllables) when a beat gesture occurred on the first syllable, but as conTENT (adjective) when the gesture occurred on the second syllable. However, these findings were based on a small number of minimal pairs in Dutch, limiting the generalizability of the findings. We therefore tested this effect in Spanish, where lexical stress is highly relevant in the verb conjugation system, distinguishing bailo, “I dance” with word-initial stress from bailó, “she danced” with word-final stress. Testing a larger sample (N = 100), we also assessed whether individual differences in working memory capacity modulated how much individuals relied on the gestures in spoken word recognition. The results showed that, similar to Dutch, Spanish participants were biased to perceive lexical stress on the syllable that visually co-occurred with a beat gesture, with the effect being strongest when the acoustic stress cues were most ambiguous. No evidence was found for by-participant effect sizes to be influenced by individual differences in phonological or visuospatial working memory. These findings reveal gestural-speech coordination impacts lexical stress perception in a language where listeners are regularly confronted with such lexical stress contrasts, highlighting the impact of gestures’ timing on prominence perception and spoken word recognition.

Abstract

To date, research has reliably shown that language can engage and modify perceptual processes in a top-down manner. However, our understanding of the cognitive and neural mechanisms underlying such top-down influences is still under debate. In this review, we provide an overview of findings from literature investigating the organization of semantic networks in the brain (spontaneous engagement of the visual system while processing linguistic information), and linguistic cueing studies (looking at the immediate effects of language on the perception of a visual target), in an effort to isolate such mechanisms. Additionally, we connect the findings from linguistic cueing studies to those reported in (nonlinguistic) literature on priors in perception, in order to find commonalities in neural processes allowing for top-down influences on perception. In doing so, we discuss the effects of language on perception in the context of broader, general cognitive and neural principles. Finally, we propose a way forward in the study of linguistic influences on perception.

Abstract

In face-to-face conversation, people use speech and gesture to convey meaning. Seeing gestures alongside speech facilitates comprehenders’ language processing, but crucially, the mechanisms underlying this facilitation remain unclear. We investigated whether comprehenders use the semantic information in gestures, typically preceding related speech, to predict upcoming meaning. Dutch adults listened to questions asked by a virtual avatar. Questions were accompanied by an iconic gesture (e.g., typing) or meaningless control movement (e.g., arm scratch) followed by a short pause and target word (e.g., “type”). A Cloze experiment showed that gestures improved explicit predictions of upcoming target words. Moreover, an EEG experiment showed that gestures reduced alpha and beta power during the pause, indicating anticipation, and reduced N400 amplitudes, demonstrating facilitated semantic processing. Thus, comprehenders use iconic gestures to predict upcoming meaning. Theories of linguistic prediction should incorporate communicative bodily signals as predictive cues to capture how language is processed in face-to-face interaction.