Publications

Displaying 401 - 500 of 614
  • Poulton, V. R., & Nieuwland, M. S. (2022). Can you hear what’s coming? Failure to replicate ERP evidence for phonological prediction. Neurobiology of Language, 3(4), 556 -574. doi:10.1162/nol_a_00078.

    Abstract

    Prediction-based theories of language comprehension assume that listeners predict both the meaning and phonological form of likely upcoming words. In alleged event-related potential (ERP) demonstrations of phonological prediction, prediction-mismatching words elicit a phonological mismatch negativity (PMN), a frontocentral negativity that precedes the centroparietal N400 component. However, classification and replicability of the PMN has proven controversial, with ongoing debate on whether the PMN is a distinct component or merely an early part of the N400. In this electroencephalography (EEG) study, we therefore attempted to replicate the PMN effect and its separability from the N400, using a participant sample size (N = 48) that was more than double that of previous studies. Participants listened to sentences containing either a predictable word or an unpredictable word with/without phonological overlap with the predictable word. Preregistered analyses revealed a widely distributed negative-going ERP in response to unpredictable words in both the early (150–250 ms) and the N400 (300–500 ms) time windows. Bayes factor analysis yielded moderate evidence against a different scalp distribution of the effects in the two time windows. Although our findings do not speak against phonological prediction during sentence comprehension, they do speak against the PMN effect specifically as a marker of phonological prediction mismatch. Instead of an PMN effect, our results demonstrate the early onset of the auditory N400 effect associated with unpredictable words. Our failure to replicate further highlights the risk associated with commonly employed data-contingent analyses (e.g., analyses involving time windows or electrodes that were selected based on visual inspection) and small sample sizes in the cognitive neuroscience of language.
  • Pouw, W., Dingemanse, M., Motamedi, Y., & Ozyurek, A. (2021). A systematic investigation of gesture kinematics in evolving manual languages in the lab. Cognitive Science, 45(7): e13014. doi:10.1111/cogs.13014.

    Abstract

    Silent gestures consist of complex multi-articulatory movements but are now primarily studied through categorical coding of the referential gesture content. The relation of categorical linguistic content with continuous kinematics is therefore poorly understood. Here, we reanalyzed the video data from a gestural evolution experiment (Motamedi, Schouwstra, Smith, Culbertson, & Kirby, 2019), which showed increases in the systematicity of gesture content over time. We applied computer vision techniques to quantify the kinematics of the original data. Our kinematic analyses demonstrated that gestures become more efficient and less complex in their kinematics over generations of learners. We further detect the systematicity of gesture form on the level of thegesture kinematic interrelations, which directly scales with the systematicity obtained on semantic coding of the gestures. Thus, from continuous kinematics alone, we can tap into linguistic aspects that were previously only approachable through categorical coding of meaning. Finally, going beyond issues of systematicity, we show how unique gesture kinematic dialects emerged over generations as isolated chains of participants gradually diverged over iterations from other chains. We, thereby, conclude that gestures can come to embody the linguistic system at the level of interrelationships between communicative tokens, which should calibrate our theories about form and linguistic content.
  • Pouw, W., & Holler, J. (2022). Timing in conversation is dynamically adjusted turn by turn in dyadic telephone conversations. Cognition, 222: 105015. doi:10.1016/j.cognition.2022.105015.

    Abstract

    Conversational turn taking in humans involves incredibly rapid responding. The timing mechanisms underpinning such responses have been heavily debated, including questions such as who is doing the timing. Similar to findings on rhythmic tapping to a metronome, we show that floor transfer offsets (FTOs) in telephone conversations are serially dependent, such that FTOs are lag-1 negatively autocorrelated. Finding this serial dependence on a turn-by-turn basis (lag-1) rather than on the basis of two or more turns, suggests a counter-adjustment mechanism operating at the level of the dyad in FTOs during telephone conversations, rather than a more individualistic self-adjustment within speakers. This finding, if replicated, has major implications for models describing turn taking, and confirms the joint, dyadic nature of human conversational dynamics. Future research is needed to see how pervasive serial dependencies in FTOs are, such as for example in richer communicative face-to-face contexts where visual signals affect conversational timing.
  • Pouw, W., & Dixon, J. A. (2022). What you hear and see specifies the perception of a limb-respiratory-vocal act. Proceedings of the Royal Society B: Biological Sciences, 289(1979): 20221026. doi:10.1098/rspb.2022.1026.
  • Pouw, W., Proksch, S., Drijvers, L., Gamba, M., Holler, J., Kello, C., Schaefer, R. S., & Wiggins, G. A. (2021). Multilevel rhythms in multimodal communication. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 376: 20200334. doi:10.1098/rstb.2020.0334.

    Abstract

    It is now widely accepted that the brunt of animal communication is conducted via several modalities, e.g. acoustic and visual, either simultaneously or sequentially. This is a laudable multimodal turn relative to traditional accounts of temporal aspects of animal communication which have focused on a single modality at a time. However, the fields that are currently contributing to the study of multimodal communication are highly varied, and still largely disconnected given their sole focus on a particular level of description or their particular concern with human or non-human animals. Here, we provide an integrative overview of converging findings that show how multimodal processes occurring at neural, bodily, as well as social interactional levels each contribute uniquely to the complex rhythms that characterize communication in human and non-human animals. Though we address findings for each of these levels independently, we conclude that the most important challenge in this field is to identify how processes at these different levels connect.
  • Pouw, W., Harrison, S. J., & Dixon, J. A. (2022). The importance of visual control and biomechanics in the regulation of gesture-speech synchrony for an individual deprived of proprioceptive feedback of body position. Scientific Reports, 12: 14775. doi:10.1038/s41598-022-18300-x.

    Abstract

    Do communicative actions such as gestures fundamentally differ in their control mechanisms from other actions? Evidence for such fundamental differences comes from a classic gesture-speech coordination experiment performed with a person (IW) with deafferentation (McNeill, 2005). Although IW has lost both his primary source of information about body position (i.e., proprioception) and discriminative touch from the neck down, his gesture-speech coordination has been reported to be largely unaffected, even if his vision is blocked. This is surprising because, without vision, his object-directed actions almost completely break down. We examine the hypothesis that IW’s gesture-speech coordination is supported by the biomechanical effects of gesturing on head posture and speech. We find that when vision is blocked, there are micro-scale increases in gesture-speech timing variability, consistent with IW’s reported experience that gesturing is difficult without vision. Supporting the hypothesis that IW exploits biomechanical consequences of the act of gesturing, we find that: (1) gestures with larger physical impulses co-occur with greater head movement, (2) gesture-speech synchrony relates to larger gesture-concurrent head movements (i.e. for bimanual gestures), (3) when vision is blocked, gestures generate more physical impulse, and (4) moments of acoustic prominence couple more with peaks of physical impulse when vision is blocked. It can be concluded that IW’s gesturing ability is not based on a specialized language-based feedforward control as originally concluded from previous research, but is still dependent on a varied means of recurrent feedback from the body.

    Additional information

    supplementary tables
  • Pouw, W., De Jonge-Hoekstra, L., Harrison, S. J., Paxton, A., & Dixon, J. A. (2021). Gesture-speech physics in fluent speech and rhythmic upper limb movements. Annals of the New York Academy of Sciences, 1491(1), 89-105. doi:10.1111/nyas.14532.

    Abstract

    Communicative hand gestures are often coordinated with prosodic aspects of speech, and salient moments of gestural movement (e.g., quick changes in speed) often co-occur with salient moments in speech (e.g., near peaks in fundamental frequency and intensity). A common understanding is that such gesture and speech coordination is culturally and cognitively acquired, rather than having a biological basis. Recently, however, the biomechanical physical coupling of arm movements to speech movements has been identified as a potentially important factor in understanding the emergence of gesture-speech coordination. Specifically, in the case of steady-state vocalization and mono-syllable utterances, forces produced during gesturing are transferred onto the tensioned body, leading to changes in respiratory-related activity and thereby affecting vocalization F0 and intensity. In the current experiment (N = 37), we extend this previous line of work to show that gesture-speech physics impacts fluent speech, too. Compared with non-movement, participants who are producing fluent self-formulated speech, while rhythmically moving their limbs, demonstrate heightened F0 and amplitude envelope, and such effects are more pronounced for higher-impulse arm versus lower-impulse wrist movement. We replicate that acoustic peaks arise especially during moments of peak-impulse (i.e., the beat) of the movement, namely around deceleration phases of the movement. Finally, higher deceleration rates of higher-mass arm movements were related to higher peaks in acoustics. These results confirm a role for physical-impulses of gesture affecting the speech system. We discuss the implications of
    gesture-speech physics for understanding of the emergence of communicative gesture, both ontogenetically and phylogenetically.

    Additional information

    data and analyses
  • Pouw, W., & Fuchs, S. (2022). Origins of vocal-entangled gesture. Neuroscience and Biobehavioral Reviews, 141: 104836. doi:10.1016/j.neubiorev.2022.104836.

    Abstract

    Gestures during speaking are typically understood in a representational framework: they represent absent or distal states of affairs by means of pointing, resemblance, or symbolic replacement. However, humans also gesture along with the rhythm of speaking, which is amenable to a non-representational perspective. Such a perspective centers on the phenomenon of vocal-entangled gestures and builds on evidence showing that when an upper limb with a certain mass decelerates/accelerates sufficiently, it yields impulses on the body that cascade in various ways into the respiratory–vocal system. It entails a physical entanglement between body motions, respiration, and vocal activities. It is shown that vocal-entangled gestures are realized in infant vocal–motor babbling before any representational use of gesture develops. Similarly, an overview is given of vocal-entangled processes in non-human animals. They can frequently be found in rats, bats, birds, and a range of other species that developed even earlier in the phylogenetic tree. Thus, the origins of human gesture lie in biomechanics, emerging early in ontogeny and running deep in phylogeny.
  • Preisig, B., & Hervais-Adelman, A. (2022). The predictive value of individual electric field modeling for transcranial alternating current stimulation induced brain modulation. Frontiers in Cellular Neuroscience, 16: 818703. doi:10.3389/fncel.2022.818703.

    Abstract

    There is considerable individual variability in the reported effectiveness of non-invasive brain stimulation. This variability has often been ascribed to differences in the neuroanatomy and resulting differences in the induced electric field inside the brain. In this study, we addressed the question whether individual differences in the induced electric field can predict the neurophysiological and behavioral consequences of gamma band tACS. In a within-subject experiment, bi-hemispheric gamma band tACS and sham stimulation was applied in alternating blocks to the participants’ superior temporal lobe, while task-evoked auditory brain activity was measured with concurrent functional magnetic resonance imaging (fMRI) and a dichotic listening task. Gamma tACS was applied with different interhemispheric phase lags. In a recent study, we could show that anti-phase tACS (180° interhemispheric phase lag), but not in-phase tACS (0° interhemispheric phase lag), selectively modulates interhemispheric brain connectivity. Using a T1 structural image of each participant’s brain, an individual simulation of the induced electric field was computed. From these simulations, we derived two predictor variables: maximal strength (average of the 10,000 voxels with largest electric field values) and precision of the electric field (spatial correlation between the electric field and the task evoked brain activity during sham stimulation). We found considerable variability in the individual strength and precision of the electric fields. Importantly, the strength of the electric field over the right hemisphere predicted individual differences of tACS induced brain connectivity changes. Moreover, we found in both hemispheres a statistical trend for the effect of electric field strength on tACS induced BOLD signal changes. In contrast, the precision of the electric field did not predict any neurophysiological measure. Further, neither strength, nor precision predicted interhemispheric integration. In conclusion, we found evidence for the dose-response relationship between individual differences in electric fields and tACS induced activity and connectivity changes in concurrent fMRI. However, the fact that this relationship was stronger in the right hemisphere suggests that the relationship between the electric field parameters, neurophysiology, and behavior may be more complex for bi-hemispheric tACS.
  • Preisig, B., Riecke, L., & Hervais-Adelman, A. (2022). Speech sound categorization: The contribution of non-auditory and auditory cortical regions. NeuroImage, 258: 119375. doi:10.1016/j.neuroimage.2022.119375.

    Abstract

    Which processes in the human brain lead to the categorical perception of speech sounds? Investigation of this question is hampered by the fact that categorical speech perception is normally confounded by acoustic differences in the stimulus. By using ambiguous sounds, however, it is possible to dissociate acoustic from perceptual stimulus representations. Twenty-seven normally hearing individuals took part in an fMRI study in which they were presented with an ambiguous syllable (intermediate between /da/ and /ga/) in one ear and with disambiguating acoustic feature (third formant, F3) in the other ear. Multi-voxel pattern searchlight analysis was used to identify brain areas that consistently differentiated between response patterns associated with different syllable reports. By comparing responses to different stimuli with identical syllable reports and identical stimuli with different syllable reports, we disambiguated whether these regions primarily differentiated the acoustics of the stimuli or the syllable report. We found that BOLD activity patterns in left perisylvian regions (STG, SMG), left inferior frontal regions (vMC, IFG, AI), left supplementary motor cortex (SMA/pre-SMA), and right motor and somatosensory regions (M1/S1) represent listeners’ syllable report irrespective of stimulus acoustics. Most of these regions are outside of what is traditionally regarded as auditory or phonological processing areas. Our results indicate that the process of speech sound categorization implicates decision-making mechanisms and auditory-motor transformations.

    Additional information

    figures and table
  • Preisig, B., Riecke, L., Sjerps, M. J., Kösem, A., Kop, B. R., Bramson, B., Hagoort, P., & Hervais-Adelman, A. (2021). Selective modulation of interhemispheric connectivity by transcranial alternating current stimulation influences binaural integration. Proceedings of the National Academy of Sciences of the United States of America, 118(7): e2015488118. doi:10.1073/pnas.2015488118.

    Abstract

    Brain connectivity plays a major role in the encoding, transfer, and
    integration of sensory information. Interregional synchronization
    of neural oscillations in the γ-frequency band has been suggested
    as a key mechanism underlying perceptual integration. In a recent
    study, we found evidence for this hypothesis showing that the
    modulation of interhemispheric oscillatory synchrony by means of
    bihemispheric high-density transcranial alternating current stimulation
    (HD-TACS) affects binaural integration of dichotic acoustic features.
    Here, we aimed to establish a direct link between oscillatory
    synchrony, effective brain connectivity, and binaural integration.
    We experimentally manipulated oscillatory synchrony (using bihemispheric
    γ-TACS with different interhemispheric phase lags) and
    assessed the effect on effective brain connectivity and binaural integration
    (as measured with functional MRI and a dichotic listening
    task, respectively). We found that TACS reduced intrahemispheric
    connectivity within the auditory cortices and antiphase (interhemispheric
    phase lag 180°) TACS modulated connectivity between the
    two auditory cortices. Importantly, the changes in intra- and interhemispheric
    connectivity induced by TACS were correlated with
    changes in perceptual integration. Our results indicate that γ-band
    synchronization between the two auditory cortices plays a functional
    role in binaural integration, supporting the proposed role
    of interregional oscillatory synchrony in perceptual integration.
  • Price, K. M., Wigg, K. G., Eising, E., Feng, Y., Blokland, K., Wilkinson, M., Kerr, E. N., Guger, S. L., Quantitative Trait Working Group of the GenLang Consortium, Fisher, S. E., Lovett, M. W., Strug, L. J., & Barr, C. L. (2022). Hypothesis-driven genome-wide association studies provide novel insights into genetics of reading disabilities. Translational Psychiatry, 12: 495. doi:10.1038/s41398-022-02250-z.

    Abstract

    Reading Disability (RD) is often characterized by difficulties in the phonology of the language. While the molecular mechanisms underlying it are largely undetermined, loci are being revealed by genome-wide association studies (GWAS). In a previous GWAS for word reading (Price, 2020), we observed that top single-nucleotide polymorphisms (SNPs) were located near to or in genes involved in neuronal migration/axon guidance (NM/AG) or loci implicated in autism spectrum disorder (ASD). A prominent theory of RD etiology posits that it involves disturbed neuronal migration, while potential links between RD-ASD have not been extensively investigated. To improve power to identify associated loci, we up-weighted variants involved in NM/AG or ASD, separately, and performed a new Hypothesis-Driven (HD)–GWAS. The approach was applied to a Toronto RD sample and a meta-analysis of the GenLang Consortium. For the Toronto sample (n = 624), no SNPs reached significance; however, by gene-set analysis, the joint contribution of ASD-related genes passed the threshold (p~1.45 × 10–2, threshold = 2.5 × 10–2). For the GenLang Cohort (n = 26,558), SNPs in DOCK7 and CDH4 showed significant association for the NM/AG hypothesis (sFDR q = 1.02 × 10–2). To make the GenLang dataset more similar to Toronto, we repeated the analysis restricting to samples selected for reading/language deficits (n = 4152). In this GenLang selected subset, we found significant association for a locus intergenic between BTG3-C21orf91 for both hypotheses (sFDR q < 9.00 × 10–4). This study contributes candidate loci to the genetics of word reading. Data also suggest that, although different variants may be involved, alleles implicated in ASD risk may be found in the same genes as those implicated in word reading. This finding is limited to the Toronto sample suggesting that ascertainment influences genetic associations.
  • Pronina, M., Hübscher, I., Holler, J., & Prieto, P. (2021). Interactional training interventions boost children’s expressive pragmatic abilities: Evidence from a novel multidimensional testing approach. Cognitive Development, 57: 101003. doi:10.1016/j.cogdev.2020.101003.

    Abstract

    This study investigates the effectiveness of training preschoolers in order to enhance their social cognition and pragmatic skills. Eighty-three 3–4-year-olds were divided into three groups and listened to stories enriched with mental state terms. Then, whereas the control group engaged in non-reflective activities, the two experimental groups were guided by a trainer to reflect on mental states depicted in the stories. In one of these groups, the children were prompted to not only talk about these states but also “embody” them through prosodic and gestural cues. Results showed that while there were no significant effects on Theory of Mind, emotion understanding, and mental state verb comprehension, the experimental groups significantly improved their pragmatic skill scores pretest-to-posttest. These results suggest that interactional interventions can contribute to preschoolers’ pragmatic development, demonstrate the value of the new embodied training, and highlight the importance of multidimensional testing for the evaluation of intervention effects.
  • Puebla, G., Martin, A. E., & Doumas, L. A. A. (2021). The relational processing limits of classic and contemporary neural network models of language processing. Language, Cognition and Neuroscience, 36(2), 240-254. doi:10.1080/23273798.2020.1821906.

    Abstract

    Whether neural networks can capture relational knowledge is a matter of long-standing controversy. Recently, some researchers have argued that (1) classic connectionist models can handle relational structure and (2) the success of deep learning approaches to natural language processing suggests that structured representations are unnecessary to model human language. We tested the Story Gestalt model, a classic connectionist model of text comprehension, and a Sequence-to-Sequence with Attention model, a modern deep learning architecture for natural language processing. Both models were trained to answer questions about stories based on abstract thematic roles. Two simulations varied the statistical structure of new stories while keeping their relational structure intact. The performance of each model fell below chance at least under one manipulation. We argue that both models fail our tests because they can't perform dynamic binding. These results cast doubts on the suitability of traditional neural networks for explaining relational reasoning and language processing phenomena.

    Additional information

    supplementary material
  • Räsänen, O., Seshadri, S., Lavechin, M., Cristia, A., & Casillas, M. (2021). ALICE: An open-source tool for automatic measurement of phoneme, syllable, and word counts from child-centered daylong recordings. Behavior Research Methods, 53, 818-835. doi:10.3758/s13428-020-01460-x.

    Abstract

    Recordings captured by wearable microphones are a standard method for investigating young children’s language environments. A key measure to quantify from such data is the amount of speech present in children’s home environments. To this end, the LENA recorder and software—a popular system for measuring linguistic input—estimates the number of adult words that children may hear over the course of a recording. However, word count estimation is challenging to do in a language-independent manner; the relationship between observable acoustic patterns and language-specific lexical entities is far from uniform across human languages. In this paper, we ask whether some alternative linguistic units, namely phone(me)s or syllables, could be measured instead of, or in parallel with, words in order to achieve improved cross-linguistic applicability and comparability of an automated system for measuring child language input. We discuss the advantages and disadvantages of measuring different units from theoretical and technical points of view. We also investigate the practical applicability of measuring such units using a novel system called Automatic LInguistic unit Count Estimator (ALICE) together with audio from seven child-centered daylong audio corpora from diverse cultural and linguistic environments. We show that language-independent measurement of phoneme counts is somewhat more accurate than syllables or words, but all three are highly correlated with human annotations on the same data. We share an open-source implementation of ALICE for use by the language research community, allowing automatic phoneme, syllable, and word count estimation from child-centered audio recordings.
  • Rasenberg, M., Pouw, W., Özyürek, A., & Dingemanse, M. (2022). The multimodal nature of communicative efficiency in social interaction. Scientific Reports, 12: 19111. doi:10.1038/s41598-022-22883-w.

    Abstract

    How does communicative efficiency shape language use? We approach this question by studying it at the level of the dyad, and in terms of multimodal utterances. We investigate whether and how people minimize their joint speech and gesture efforts in face-to-face interactions, using linguistic and kinematic analyses. We zoom in on other-initiated repair—a conversational microcosm where people coordinate their utterances to solve problems with perceiving or understanding. We find that efforts in the spoken and gestural modalities are wielded in parallel across repair turns of different types, and that people repair conversational problems in the most cost-efficient way possible, minimizing the joint multimodal effort for the dyad as a whole. These results are in line with the principle of least collaborative effort in speech and with the reduction of joint costs in non-linguistic joint actions. The results extend our understanding of those coefficiency principles by revealing that they pertain to multimodal utterance design.

    Additional information

    Data and analysis scripts
  • Rasenberg, M., Özyürek, A., Bögels, S., & Dingemanse, M. (2022). The primacy of multimodal alignment in converging on shared symbols for novel referents. Discourse Processes, 59(3), 209-236. doi:10.1080/0163853X.2021.1992235.

    Abstract

    When people establish shared symbols for novel objects or concepts, they have been shown to rely on the use of multiple communicative modalities as well as on alignment (i.e., cross-participant repetition of communicative behavior). Yet these interactional resources have rarely been studied together, so little is known about if and how people combine multiple modalities in alignment to achieve joint reference. To investigate this, we systematically track the emergence of lexical and gestural alignment in a referential communication task with novel objects. Quantitative analyses reveal that people frequently use a combination of lexical and gestural alignment, and that such multimodal alignment tends to emerge earlier compared to unimodal alignment. Qualitative analyses of the interactional contexts in which alignment emerges reveal how people flexibly deploy lexical and gestural alignment (independently, simultaneously or successively) to adjust to communicative pressures.
  • Ravignani, A., & Garcia, M. (2022). A cross-species framework to identify vocal learning abilities in mammals. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 377: 20200394. doi:10.1098/rstb.2020.0394.

    Abstract

    Vocal production learning (VPL) is the experience-driven ability to produce novel vocal signals through imitation or modification of existing vocalizations. A parallel strand of research investigates acoustic allometry, namely how information about body size is conveyed by acoustic signals. Recently, we proposed that deviation from acoustic allometry principles as a result of sexual selection may have been an intermediate step towards the evolution of vocal learning abilities in mammals. Adopting a more hypothesis-neutral stance, here we perform phylogenetic regressions and other analyses further testing a potential link between VPL and being an allometric outlier. We find that multiple species belonging to VPL clades deviate from allometric scaling but in the opposite direction to that expected from size exaggeration mechanisms. In other words, our correlational approach finds an association between VPL and being an allometric outlier. However, the direction of this association, contra our original hypothesis, may indicate that VPL did not necessarily emerge via sexual selection for size exaggeration: VPL clades show higher vocalization frequencies than expected. In addition, our approach allows us to identify species with potential for VPL abilities: we hypothesize that those outliers from acoustic allometry lying above the regression line may be VPL species. Our results may help better understand the cross-species diversity, variability and aetiology of VPL, which among other things is a key underpinning of speech in our species.

    This article is part of the theme issue ‘Voice modulation: from origin and mechanism to social impact (Part II)’.

    Additional information

    Raw data Supplementary material
  • Ravignani, A. (2021). Isochrony, vocal learning and the acquisition of rhythm and melody. Behavioral and Brain Sciences, 44: e88. doi:10.1017/S0140525X20001478.

    Abstract

    A cross-species perspective can extend and provide testable predictions for Savage et al.’s
    framework. Rhythm and melody, I argue, could bootstrap each other in the evolution of
    musicality. Isochrony may function as a temporal grid to support rehearsing and learning
    modulated, pitched vocalizations. Once this melodic plasticity is acquired, focus can shift back to refining rhythm processing and beat induction.
  • Ravignani, A. (2022). Language evolution: Sound meets gesture? [Review of the book From signal to symbol: The evolution of language by By R. Planer and K. Sterelny]. Evolutionary Anthropology, 31, 317-318. doi:10.1002/evan.21961.
  • Ravignani, A., & De Boer, B. (2021). Joint origins of speech and music: Testing evolutionary hypotheses on modern humans. Semiotica, 239, 169-176. doi:10.1515/sem-2019-0048.

    Abstract

    How music and speech evolved is a mystery. Several hypotheses on their
    origins, including one on their joint origins, have been put forward but rarely
    tested. Here we report and comment on the first experiment testing the hypothesis
    that speech and music bifurcated from a common system. We highlight strengths
    of the reported experiment, point out its relatedness to animal work, and suggest
    three alternative interpretations of its results. We conclude by sketching a future
    empirical programme extending this work.
  • Raviv, L., Lupyan, G., & Green, S. C. (2022). How variability shapes learning and generalization. Trends in Cognitive Sciences, 26(6), 462-483. doi:10.1016/j.tics.2022.03.007.

    Abstract

    Learning is using past experiences to inform new behaviors and actions. Because all experiences are unique, learning always requires some generalization. An effective way of improving generalization is to expose learners to more variable (and thus often more representative) input. More variability tends to make initial learning more challenging, but eventually leads to more general and robust performance. This core principle has been repeatedly rediscovered and renamed in different domains (e.g., contextual diversity, desirable difficulties, variability of practice). Reviewing this basic result as it has been formulated in different domains allows us to identify key patterns, distinguish between different kinds of variability, discuss the roles of varying task-relevant versus irrelevant dimensions, and examine the effects of introducing variability at different points in training.
  • Raviv, L., De Heer Kloots, M., & Meyer, A. S. (2021). What makes a language easy to learn? A preregistered study on how systematic structure and community size affect language learnability. Cognition, 210: 104620. doi:10.1016/j.cognition.2021.104620.

    Abstract

    Cross-linguistic differences in morphological complexity could have important consequences for language learning. Specifically, it is often assumed that languages with more regular, compositional, and transparent grammars are easier to learn by both children and adults. Moreover, it has been shown that such grammars are more likely to evolve in bigger communities. Together, this suggests that some languages are acquired faster than others, and that this advantage can be traced back to community size and to the degree of systematicity in the language. However, the causal relationship between systematic linguistic structure and language learnability has not been formally tested, despite its potential importance for theories on language evolution, second language learning, and the origin of linguistic diversity. In this pre-registered study, we experimentally tested the effects of community size and systematic structure on adult language learning. We compared the acquisition of different yet comparable artificial languages that were created by big or small groups in a previous communication experiment, which varied in their degree of systematic linguistic structure. We asked (a) whether more structured languages were easier to learn; and (b) whether languages created by the bigger groups were easier to learn. We found that highly systematic languages were learned faster and more accurately by adults, but that the relationship between language learnability and linguistic structure was typically non-linear: high systematicity was advantageous for learning, but learners did not benefit from partly or semi-structured languages. Community size did not affect learnability: languages that evolved in big and small groups were equally learnable, and there was no additional advantage for languages created by bigger groups beyond their degree of systematic structure. Furthermore, our results suggested that predictability is an important advantage of systematic structure: participants who learned more structured languages were better at generalizing these languages to new, unfamiliar meanings, and different participants who learned the same more structured languages were more likely to produce similar labels. That is, systematic structure may allow speakers to converge effortlessly, such that strangers can immediately understand each other.
  • Raviv, L., Peckre, L. R., & Boeckx, C. (2022). What is simple is actually quite complex: A critical note on terminology in the domain of language and communication. Journal of Comparative Psychology, 136(4), 215-220. doi:10.1037/com0000328.

    Abstract

    On the surface, the fields of animal communication and human linguistics have arrived at conflicting theories and conclusions with respect to the effect of social complexity on communicative complexity. For example, an increase in group size is argued to have opposite consequences on human versus animal communication systems: although an increase in human community size leads to some types of language simplification, an increase in animal group size leads to an increase in signal complexity. But do human and animal communication systems really show such a fundamental discrepancy? Our key message is that the tension between these two adjacent fields is the result of (a) a focus on different levels of analysis (namely, signal variation or grammar-like rules) and (b) an inconsistent use of terminology (namely, the terms “simple” and “complex”). By disentangling and clarifying these terms with respect to different measures of communicative complexity, we show that although animal and human communication systems indeed show some contradictory effects with respect to signal variability, they actually display essentially the same patterns with respect to grammar-like structure. This is despite the fact that the definitions of complexity and simplicity are actually aligned for signal variability, but diverge for grammatical structure. We conclude by advocating for the use of more objective and descriptive terms instead of terms such as “complexity,” which can be applied uniformly for human and animal communication systems—leading to comparable descriptions of findings across species and promoting a more productive dialogue between fields.
  • Rebuschat, P., Monaghan, P., & Schoetensack, C. (2021). Learning vocabulary and grammar from cross-situational statistics. Cognition, 206: 104475. doi:10.1016/j.cognition.2020.104475.

    Abstract

    Across multiple situations, child and adult learners are sensitive to co-occurrences between individual words and their referents in the environment, which provide a means by which the ambiguity of word-world mappings may be resolved (Monaghan & Mattock, 2012; Scott & Fisher, 2012; Smith & Yu, 2008; Yu & Smith, 2007). In three studies, we tested whether cross-situational learning is sufficiently powerful to support simultaneous learning the referents for words from multiple grammatical categories, a more realistic reflection of more complex natural language learning situations. In Experiment 1, adult learners heard sentences comprising nouns, verbs, adjectives, and grammatical markers indicating subject and object roles, and viewed a dynamic scene to which the sentence referred. In Experiments 2 and 3, we further increased the uncertainty of the referents by presenting two scenes alongside each sentence. In all studies, we found that cross-situational statistical learning was sufficiently powerful to facilitate acquisition of both vocabulary and grammar from complex sentence-to-scene correspondences, simulating the situations that more closely resemble the challenge facing the language learner.

    Additional information

    supplementary material
  • Redl, T., Szuba, A., de Swart, P., Frank, S. L., & de Hoop, H. (2022). Masculine generic pronouns as a gender cue in generic statements. Discourse Processes, 59, 828-845. doi:10.1080/0163853X.2022.2148071.

    Abstract

    An eye-tracking experiment was conducted with speakers of Dutch (N = 84, 36 male), a language that falls between grammatical and natural-gender languages. We tested whether a masculine generic pronoun causes a male bias when used in generic statements—that is, in the absence of a specific referent. We tested two types of generic statements by varying conceptual number, hypothesizing that the pronoun zijn “his” was more likely to cause a male bias with a conceptually singular than a conceptually plural ante-cedent (e.g., Someone (conceptually singular)/Everyone (conceptually plural) with perfect pitch can tune his instrument quickly). We found male participants to exhibit a male bias but with the conceptually singular antecedent only. Female participants showed no signs of a male bias. The results show that the generically intended masculine pronoun zijn “his” leads to a male bias in conceptually singular generic contexts but that this further depends on participant gender.

    Additional information

    Data availability
  • Redl, T., Frank, S. L., De Swart, P., & De Hoop, H. (2021). The male bias of a generically-intended masculine pronoun: Evidence from eye-tracking and sentence evaluation. PLoS One, 16(4): e0249309. doi:10.1371/journal.pone.0249309.

    Abstract

    Two experiments tested whether the Dutch possessive pronoun zijn ‘his’ gives rise to a gender inference and thus causes a male bias when used generically in sentences such as Everyone was putting on his shoes. Experiment 1 (N = 120, 48 male) was a conceptual replication of a previous eye-tracking study that had not found evidence of a male bias. The results of the current eye-tracking experiment showed the generically-intended masculine pronoun to trigger a gender inference and cause a male bias, but for male participants and in stereotypically neutral stereotype contexts only. No evidence for a male bias was thus found in stereotypically female and male context nor for female participants altogether. Experiment 2 (N = 80, 40 male) used the same stimuli as Experiment 1, but employed the sentence evaluation paradigm. No evidence of a male bias was found in Experiment 2. Taken together, the results suggest that the generically-intended masculine pronoun zijn ‘his’ can cause a male bias for male participants even when the referents are previously introduced by inclusive and grammatically gender-unmarked iedereen ‘everyone’. This male bias surfaces with eye-tracking, which taps directly into early language processing, but not in offline sentence evaluations. Furthermore, the results suggest that the intended generic reading of the masculine possessive pronoun zijn ‘his’ is more readily available for women than for men.

    Additional information

    data
  • Redolfi, M., Soares, S. M. P., Czypionka, A., & Kupisch, T. (2021). Experimental evidence for the interpretation of definite plural articles as markers of genericity – How Italian can help. Glossa: a journal of general linguistics, 6(1): 16. doi:10.5334/gjgl.1165.

    Abstract

    In the Romance languages, definite plural articles (e.g., le rane ‘the frogs’) are generally ambiguous between a generic and a specific interpretation, and speakers must reconstruct the intended interpretation through the linguistic or extra-linguistic context. Following the “polar bear” paradigm implemented in Czypionka & Kupisch (2019)’s investigation on German, the goal of the present study is to check the suitability of their test on article semantics, by establishing to what extent native speakers of Italian interpret ambiguous definite plural DPs as generic or specific in the presence of a nonlinguistic picture context. We present judgment and reaction time data monitoring the preferred reading of sentences introduced by different kinds of noun phrases (e.g., Le rane/Queste rane/Le rane di solito sono verdi/gialle ‘The/These/Usually frogs are green/yellow’), while looking at pictures showing prototypical or non-prototypical properties (e.g., green vs. yellow frogs). Our results show that both possible interpretations of definite plural articles are routinely considered in Italian, despite the presence of a picture with specific referents, validating the “polar bear” paradigm as a suitable test of article semantics.
  • Reifegerste, J., Meyer, A. S., Zwitserlood, P., & Ullman, M. T. (2021). Aging affects steaks more than knives: Evidence that the processing of words related to motor skills is relatively spared in aging. Brain and Language, 218: 104941. doi:10.1016/j.bandl.2021.104941.

    Abstract

    Lexical-processing declines are a hallmark of aging. However, the extent of these declines may vary as a function of different factors. Motivated by findings from neurodegenerative diseases and healthy aging, we tested whether ‘motor-relatedness’ (the degree to which words are associated with particular human body movements) might moderate such declines. We investigated this question by examining data from three experiments. The experiments were carried out in different languages (Dutch, German, English) using different tasks (lexical decision, picture naming), and probed verbs and nouns, in all cases controlling for potentially confounding variables (e.g., frequency, age-of-acquisition, imageability). Whereas ‘non-motor words’ (e.g., steak) showed age-related performance decreases in all three experiments, ‘motor words’ (e.g., knife) yielded either smaller decreases (in one experiment) or no decreases (in two experiments). The findings suggest that motor-relatedness can attenuate or even prevent age-related lexical declines, perhaps due to the relative sparing of neural circuitry underlying such words.

    Additional information

    supplementary material
  • Reinisch, E., & Bosker, H. R. (2022). Encoding speech rate in challenging listening conditions: White noise and reverberation. Attention, Perception & Psychophysics, 84, 2303 -2318. doi:10.3758/s13414-022-02554-8.

    Abstract

    Temporal contrasts in speech are perceived relative to the speech rate of the surrounding context. That is, following a fast context
    sentence, listeners interpret a given target sound as longer than following a slow context, and vice versa. This rate effect, often
    referred to as “rate-dependent speech perception,” has been suggested to be the result of a robust, low-level perceptual process,
    typically examined in quiet laboratory settings. However, speech perception often occurs in more challenging listening condi-
    tions. Therefore, we asked whether rate-dependent perception would be (partially) compromised by signal degradation relative to
    a clear listening condition. Specifically, we tested effects of white noise and reverberation, with the latter specifically distorting
    temporal information. We hypothesized that signal degradation would reduce the precision of encoding the speech rate in the
    context and thereby reduce the rate effect relative to a clear context. This prediction was borne out for both types of degradation in
    Experiment 1, where the context sentences but not the subsequent target words were degraded. However, in Experiment 2, which
    compared rate effects when contexts and targets were coherent in terms of signal quality, no reduction of the rate effect was
    found. This suggests that, when confronted with coherently degraded signals, listeners adapt to challenging listening situations,
    eliminating the difference between rate-dependent perception in clear and degraded conditions. Overall, the present study
    contributes towards understanding the consequences of different types of listening environments on the functioning of low-
    level perceptual processes that listeners use during speech perception.

    Additional information

    Data availability
  • de Reus, K., Soma, M., Anichini, M., Gamba, M., de Heer Kloots, M., Lense, M., Bruno, J. H., Trainor, L., & Ravignani, A. (2021). Rhythm in dyadic interactions. Philosophical Transactions of the Royal Society of London, Series B: Biological Sciences, 376: 20200337. doi:10.1098/rstb.2020.0337.

    Abstract

    This review paper discusses rhythmic dyadic interactions in social and sexual contexts. We report rhythmic interactions during communication within dyads, as found in humans, non-human primates, non-primate mammals, birds, anurans and insects. Based on the patterns observed, we infer adaptive explanations for the observed rhythm interactions and identify knowledge gaps. Across species, the social environment during ontogeny is a key factor in shaping adult signal repertoires and timing mechanisms used to regulate interactions. The degree of temporal coordination is influenced by the dynamic and strength of the dyadic interaction. Most studies of temporal structure in interactive signals mainly focus on one modality (acoustic and visual); we suggest more work should be performed on multimodal signals. Multidisciplinary approaches combining cognitive science, ethology and ecology should shed more light on the exact timing mechanisms involved. Taken together, rhythmic signalling behaviours are widespread and critical in regulating social interactions across taxa.
  • de Reus, K., Carlson, D., Lowry, A., Gross, S., Garcia, M., Rubio-Garcia, A., Salazar-Casals, A., & Ravignani, A. (2022). Vocal tract allometry in a mammalian vocal learner. Journal of Experimental Biology, 225(8): jeb243766. doi:10.1242/jeb.243766.

    Abstract

    Acoustic allometry occurs when features of animal vocalisations can be predicted from body size measurements. Despite this being considered the norm, allometry sometimes breaks, resulting in species sounding smaller or larger than expected. A recent hypothesis suggests that allometry-breaking animals cluster into two groups: those with anatomical adaptations to their vocal tracts and those capable of learning new sounds (vocal learners). Here we test this hypothesis by probing vocal tract allometry in a proven mammalian vocal learner, the harbour seal (Phoca vitulina). We test whether vocal tract structures and body size scale allometrically in 68 individuals. We find that both body length and body weight accurately predict vocal tract length and one tracheal dimension. Independently, body length predicts vocal fold length while body weight predicts a second tracheal dimension. All vocal tract measures are larger in weaners than in pups and some structures are sexually dimorphic within age classes. We conclude that harbour seals do comply with allometric constraints, lending support to our hypothesis. However, allometry between body size and vocal fold length seems to emerge after puppyhood, suggesting that ontogeny may modulate the anatomy-learning distinction previously hypothesised as clear-cut. Species capable of producing non-allometric signals while their vocal tract scales allometrically, like seals, may then use non-morphological allometry-breaking mechanisms. We suggest that seals, and potentially other vocal learning mammals, may achieve allometry-breaking through developed neural control over their vocal organs.
  • Rhie, A., McCarthy, S. A., Fedrigo, O., Damas, J., Formenti, G., Koren, S., Uliano-Silva, M., Chow, W., Fungtammasan, A., Kim, J., Lee, C., Ko, B. J., Chaisson, M., Gedman, G. L., Cantin, L. J., Thibaud-Nissen, F., Haggerty, L., Bista, I., Smith, M., Haase, B. and 107 moreRhie, A., McCarthy, S. A., Fedrigo, O., Damas, J., Formenti, G., Koren, S., Uliano-Silva, M., Chow, W., Fungtammasan, A., Kim, J., Lee, C., Ko, B. J., Chaisson, M., Gedman, G. L., Cantin, L. J., Thibaud-Nissen, F., Haggerty, L., Bista, I., Smith, M., Haase, B., Mountcastle, J., Winkler, S., Paez, S., Howard, J., Vernes, S. C., Lama, T. M., Grutzner, F., Warren, W. C., Balakrishnan, C. N., Burt, D., George, J. M., Biegler, M. T., Iorns, D., Digby, A., Eason, D., Robertson, B., Edwards, T., Wilkinson, M., Turner, G., Meyer, A., Kautt, A. F., Franchini, P., Detrich, H. W., Svardal, H., Wagner, M., Naylor, G. J. P., Pippel, M., Malinsky, M., Mooney, M., Simbirsky, M., Hannigan, B. T., Pesout, T., Houck, M., Misuraca, A., Kingan, S. B., Hall, R., Kronenberg, Z., Sović, I., Dunn, C., Ning, Z., Hastie, A., Lee, J., Selvaraj, S., Green, R. E., Putnam, N. H., Gut, I., Ghurye, J., Garrison, E., Sims, Y., Collins, J., Pelan, S., Torrance, J., Tracey, A., Wood, J., Dagnew, R. E., Guan, D., London, S. E., Clayton, D. F., Mello, C. V., Friedrich, S. R., Lovell, P. V., Osipova, E., Al-Ajli, F. O., Secomandi, S., Kim, H., Theofanopoulou, C., Hiller, M., Zhou, Y., Harris, R. S., Makova, K. D., Medvedev, P., Hoffman, J., Masterson, P., Clark, K., Martin, F., Howe, K., Flicek, P., Walenz, B. P., Kwak, W., Clawson, H., Diekhans, M., Nassar, L., Paten, B., Kraus, R. H. S., Crawford, A. J., Gilbert, M. T. P., Zhang, G., Venkatesh, B., Murphy, R. W., Koepfli, K.-P., Shapiro, B., Johnson, W. E., Di Palma, F., Marques-Bonet, T., Teeling, E. C., Warnow, T., Graves, J. M., Ryder, O. A., Haussler, D., O’Brien, S. J., Korlach, J., Lewin, H. A., Howe, K., Myers, E. W., Durbin, R., Phillippy, A. M., & Jarvis, E. D. (2021). Towards complete and error-free genome assemblies of all vertebrate species. Nature, 592, 737-746. doi:10.1038/s41586-021-03451-0.

    Abstract

    High-quality and complete reference genome assemblies are fundamental for the application of genomics to biology, disease, and biodiversity conservation. However, such assemblies are available for only a few non-microbial species1,2,3,4. To address this issue, the international Genome 10K (G10K) consortium5,6 has worked over a five-year period to evaluate and develop cost-effective methods for assembling highly accurate and nearly complete reference genomes. Here we present lessons learned from generating assemblies for 16 species that represent six major vertebrate lineages. We confirm that long-read sequencing technologies are essential for maximizing genome quality, and that unresolved complex repeats and haplotype heterozygosity are major sources of assembly error when not handled correctly. Our assemblies correct substantial errors, add missing sequence in some of the best historical reference genomes, and reveal biological discoveries. These include the identification of many false gene duplications, increases in gene sizes, chromosome rearrangements that are specific to lineages, a repeated independent chromosome breakpoint in bat genomes, and a canonical GC-rich pattern in protein-coding genes and their regulatory regions. Adopting these lessons, we have embarked on the Vertebrate Genomes Project (VGP), an international effort to generate high-quality, complete reference genomes for all of the roughly 70,000 extant vertebrate species and to help to enable a new era of discovery across the life sciences.
  • Rinker, T., Papadopoulou, D., Ávila-Varela, D., Bosch, J., Castro, S., Olioumtsevits, K., Pereira Soares, S. M., Wodniecka, Z., & Marinis, T. (2022). Does multilingualism bring benefits?: What do teachers think about multilingualism? The Multilingual Mind: Policy Reports 2022, 3. doi:10.48787/kops/352-2-1m7py02eqd0b56.
  • Rodd, J., Decuyper, C., Bosker, H. R., & Ten Bosch, L. (2021). A tool for efficient and accurate segmentation of speech data: Announcing POnSS. Behavior Research Methods, 53, 744-756. doi:10.3758/s13428-020-01449-6.

    Abstract

    Despite advances in automatic speech recognition (ASR), human input is still essential to produce research-grade segmentations of speech data. Con- ventional approaches to manual segmentation are very labour-intensive. We introduce POnSS, a browser-based system that is specialized for the task of segmenting the onsets and offsets of words, that combines aspects of ASR with limited human input. In developing POnSS, we identified several sub- tasks of segmentation, and implemented each of these as separate interfaces for the annotators to interact with, to streamline their task as much as possible. We evaluated segmentations made with POnSS against a base- line of segmentations of the same data made conventionally in Praat. We observed that POnSS achieved comparable reliability to segmentation us- ing Praat, but required 23% less annotator time investment. Because of its greater efficiency without sacrificing reliability, POnSS represents a distinct methodological advance for the segmentation of speech data.
  • Rohde, H., & Rubio-Fernández, P. (2022). Color interpretation is guided by informativity expectations, not by world knowledge about colors. Journal of Memory and Language, 127: 104371. doi:10.1016/j.jml.2022.104371.

    Abstract

    When people hear words for objects with prototypical colors (e.g., ‘banana’), they look at objects of the same color (e.g., lemon), suggesting a link in comprehension between objects and their prototypical colors. However, that link does not carry over to production: The experimental record also shows that when people speak, they tend to omit prototypical colors, using color adjectives when it is informative (e.g., when referring to clothes, which have no prototypical color). These findings yield an interesting prediction, which we tested here: while prior work shows that people look at yellow objects when hearing ‘banana’, they should look away from bananas when hearing ‘yellow’. The results of an offline sentence-completion task (N = 100) and an online eye-tracking task (N = 41) confirmed that when presented with truncated color descriptions (e.g., ‘Click on the yellow…’), people anticipate clothing items rather than stereotypical fruits. A corpus analysis ruled out the possibility that this association between color and clothing arises from simple context-free co-occurrence statistics. We conclude that comprehenders make linguistic predictions based not only on what they know about the world (e.g., which objects are yellow) but also on what speakers tend to say about the world (i.e., what content would be informative).

    Additional information

    supplementary data 1
  • Rojas-Berscia, L. M., Lehecka, T., Claassen, S. A., Peute, A. A. K., Escobedo, M. P., Escobedo, S. P., Tangoa, A. H., & Pizango, E. Y. (2022). Embedding in Shawi narrations: A quantitative analysis of embedding in a post-colonial Amazonian indigenous society. Language in Society, 51(3), 427-451. doi:10.1017/S0047404521000634.

    Abstract

    In this article, we provide the first quantitative account of the frequent use of embedding in Shawi, a Kawapanan language spoken in Peruvian Northwestern Amazonia. We collected a corpus of ninety-two Frog Stories (Mayer 1969) from three different field sites in 2015 and 2016. Using the glossed corpus as our data, we conducted a generalised mixed model analysis, where we predicted the use of embedding with several macrosocial variables, such as gender, age, and education level. We show that bilingualism (Amazonian Spanish-Shawi) and education, mostly restricted by complex gender differences in Shawi communities, play a significant role in the establishment of linguistic preferences in narration. Moreover, we argue that the use of embedding reflects the impact of the mestizo1 society from the nineteenth century until today in Santa Maria de Cahuapanas, reshaping not only Shawi demographics but also linguistic practices
  • Rossi, G., & Stivers, T. (2021). Category-sensitive actions in interaction. Social Psychology Quarterly, 84(1), 49-74. doi:10.1177/0190272520944595.

    Abstract

    This article is concerned with how social categories (e.g., wife, mother, sister, tenant, guest) become visible through the actions that individuals perform in social interaction. Using audio and video recordings of social interaction as data and conversation analysis as a method, we examine how individuals display their rights or constraints to perform certain actions by virtue of occupying a certain social category. We refer to actions whose performance is sensitive to membership in a certain social category as category-sensitive actions. Most of the time, the social boundaries surrounding these actions remain invisible because participants in interaction typically act in ways that are consistent with their social status and roles. In this study, however, we specifically examine instances where category boundaries become visible as participants approach, expose, or transgress them. Our focus is on actions with relatively stringent category sensitivity such as requests, offers, invitations, or handling one’s possessions. Ultimately, we believe these are the tip of an iceberg that potentially includes most, if not all, actions.
  • Rothman, J., Bayram, F., DeLuca, V., Di Pisa, G., Duñabeitia, J. A., Gharibi, K., Hao, J., Kolb, N., Kubota, M., Kupisch, T., Laméris, T., Luque, A., Van Osch, B., Pereira Soares, S. M., Prystauka, Y., Tat, D., Tomić, A., Voits, T., & Wulff, S. (2022). Monolingual comparative normativity in bilingualism research is out of “control”: Arguments and alternatives. Applied Psycholinguistics, 44(3), 316-329. doi:10.1017/S0142716422000315.

    Abstract

    Herein, we contextualize, problematize, and offer some insights for moving beyond the problem of monolingual comparative normativity in (psycho) linguistic research on bilingualism. We argue that, in the vast majority of cases, juxtaposing (functional) monolinguals to bilinguals fails to offer what the comparison is supposedly intended to do: meet the standards of empirical control in line with the scientific method. Instead, the default nature of monolingual comparative normativity has historically contributed to inequalities in many facets of bilingualism research and continues to impede progress on multiple levels. Beyond framing our views on the matter, we offer some epistemological considerations and methodological alternatives to this standard practice that improve empirical rigor while fostering increased diversity, inclusivity, and equity in our field.
  • Royo, J., Forkel, S. J., Pouget, P., & Thiebaut de Schotten, M. (2021). The squirrel monkey model in clinical neuroscience. Neuroscience and Biobehavioral Reviews, 128, 152-164. doi:10.1016/j.neubiorev.2021.06.006.

    Abstract

    Clinical neuroscience research relying on animal models brought valuable translational insights into the function and pathologies of the human brain. The anatomical, physiological, and behavioural similarities between humans and mammals have prompted researchers to study cerebral mechanisms at different levels to develop and test new treatments. The vast majority of biomedical research uses rodent models, which are easily manipulable and have a broadly resembling organisation to the human nervous system but cannot satisfactorily mimic some disorders. For these disorders, macaque monkeys have been used as they have a more comparable central nervous system. Still, this research has been hampered by limitations, including high costs and reduced samples. This review argues that a squirrel monkey model might bridge the gap by complementing translational research from rodents, macaque, and humans. With the advent of promising new methods such as ultrasound imaging, tool miniaturisation, and a shift towards open science, the squirrel monkey model represents a window of opportunity that will potentially fuel new translational discoveries in the diagnosis and treatment of brain pathologies.
  • Rubio-Fernandez, P., Long, M., Shukla, V., Bhatia, V., & Sinha, P. (2022). Visual perspective taking is not automatic in a simplified Dot task: Evidence from newly sighted children, primary school children and adults. Neuropsychologia, 172: e0153485. doi:10.1016/j.neuropsychologia.2022.108256.

    Abstract

    In the Dot task, children and adults involuntarily compute an avatar’s visual perspective, which has been interpreted by some as automatic Theory of Mind. This interpretation has been challenged by other researchers arguing that the task reveals automatic attentional orienting. Here we tested a new interpretation of previous findings: the seemingly automatic processes revealed by the Dot task result from the high Executive Control demands of this verification paradigm, which taxes short-term memory and imposes perspective-switching costs. We tested this hypothesis in three experiments conducted in India with newly sighted children (Experiment 1; N = 5; all girls), neurotypical children (Experiment 2; ages 5–10; N = 90; 38 girls) and adults (Experiment 3; N = 30; 18 women) in a highly simplified version of the Dot task. No evidence of automatic perspective-taking was observed, although all groups revealed perspective-taking costs. A newly sighted child and the youngest children in our sample also showed an egocentric bias, which disappeared by age 10, confirming that visual perspective taking develops during the school years. We conclude that the standard Dot task imposes such methodological demands on both children and adults that the alleged evidence of automatic processes (either mindreading or domain general) may simply reveal limitations in Executive Control.

    Additional information

    1-s2.0-S0028393222001154-mmc1.docx
  • Rubio-Fernández, P. (2021). Color discriminability makes over-specification efficient: Theoretical analysis and empirical evidence. Humanities and Social Sciences Communications, 8: 147. doi:10.1057/s41599-021-00818-6.

    Abstract

    A psychophysical analysis of referential communication establishes a causal link between a visual stimulus and a speaker’s perception of this stimulus, and between the speaker’s internal representation and their reference production. Here, I argue that, in addition to visual perception and language, social cognition plays an integral part in this complex process, as it enables successful speaker-listener coordination. This pragmatic analysis of referential communication tries to explain the redundant use of color adjectives. It is well documented that people use color words when it is not necessary to identify the referent; for instance, they may refer to “the blue star” in a display of shapes with a single star. This type of redundancy challenges influential work from cognitive science and philosophy of language, suggesting that human communication is fundamentally efficient. Here, I explain these seemingly contradictory findings by confirming the visual efficiency hypothesis: redundant color words can facilitate the listener’s visual search for a referent, despite making the description unnecessarily long. Participants’ eye movements revealed that they were faster to find “the blue star” than “the star” in a display of shapes with only one star. A language production experiment further revealed that speakers are highly sensitive to a target’s discriminability, systematically reducing their use of redundant color adjectives as the color of the target became more pervasive in a display. It is concluded that a referential expression’s efficiency should be based not only on its informational value, but also on its discriminatory value, which means that redundant color words can be more efficient than shorter descriptions.
  • Rubio-Fernández, P., Shukla, V., Bhatia, V., Ben-Ami, S., & Sinha, P. (2022). Head turning is an effective cue for gaze following: Evidence from newly sighted individuals, school children and adults. Neuropsychologia, 174: 108330. doi:10.1016/j.neuropsychologia.2022.108330.

    Abstract

    In referential communication, gaze is often interpreted as a social cue that facilitates comprehension and enables word learning. Here we investigated the degree to which head turning facilitates gaze following. We presented participants with static pictures of a man looking at a target object in a first and third block of trials (pre- and post-intervention), while they saw short videos of the same man turning towards the target in the second block of trials (intervention). In Experiment 1, newly sighted individuals (treated for congenital cataracts; N = 8) benefited from the motion cues, both when comparing their initial performance with static gaze cues to their performance with dynamic head turning, and their performance with static cues before and after the videos. In Experiment 2, neurotypical school children (ages 5–10 years; N = 90) and adults (N = 30) also revealed improved performance with motion cues, although most participants had started to follow the static gaze cues before they saw the videos. Our results confirm that head turning is an effective social cue when interpreting new words, offering new insights for a pathways approach to development.
  • Rubio-Fernández, P., Wienholz, A., Ballard, C. M., Kirby, S., & Lieberman, A. M. (2022). Adjective position and referential efficiency in American Sign Language: Effects of adjective semantics, sign type and age of sign exposure. Journal of Memory and Language, 126: 104348. doi:10.1016/j.jml.2022.104348.

    Abstract

    Previous research has pointed at communicative efficiency as a possible constraint on language structure. Here we investigated adjective position in American Sign Language (ASL), a language with relatively flexible word order, to test the incremental efficiency hypothesis, according to which both speakers and signers try to produce efficient referential expressions that are sensitive to the word order of their languages. The results of three experiments using a standard referential communication task confirmed that deaf ASL signers tend to produce absolute adjectives, such as color or material, in prenominal position, while scalar adjectives tend to be produced in prenominal position when expressed as lexical signs, but in postnominal position when expressed as classifiers. Age of ASL exposure also had an effect on referential choice, with early-exposed signers producing more classifiers than late-exposed signers, in some cases. Overall, our results suggest that linguistic, pragmatic and developmental factors affect referential choice in ASL, supporting the hypothesis that communicative efficiency is an important factor in shaping language structure and use.
  • Rubio-Fernández, P., Mollica, F., & Jara-Ettinger, J. (2021). Speakers and listeners exploit word order for communicative efficiency: A cross-linguistic investigation. Journal of Experimental Psychology: General, 150, 583-594. doi:10.1037/xge0000963.

    Abstract

    Pragmatic theories and computational models of reference must account for people’s frequent use of redundant color adjectives (e.g., referring to a single triangle as “the blue triangle”). The standard pragmatic view holds that the informativity of a referential expression depends on pragmatic contrast: Color adjectives should be used to contrast competitors of the same kind to preempt an ambiguity (e.g., between several triangles of different colors), otherwise they are redundant. Here we propose an alternative to the standard view, the incremental efficiency hypothesis, according to which the efficiency of a referential expression must be calculated incrementally over the entire visual context. This is the first theoretical account of referential efficiency that is sensitive to the incrementality of language processing, making different cross-linguistic predictions depending on word order. Experiment 1 confirmed that English speakers produced more redundant color adjectives (e.g., “the blue triangle”) than Spanish speakers (e.g., “el triángulo azul”), but both language groups used more redundant color adjectives in denser displays where it would be more efficient. In Experiments 2A and 2B, we used eye tracking to show that pragmatic contrast is not a processing constraint. Instead, incrementality and efficiency determine that English listeners establish color contrast across categories (BLUE SHAPES > TRIANGULAR ONE), whereas Spanish listeners establish color contrast within a category (TRIANGLES > BLUE ONE). Spanish listeners, however, reversed their visual search strategy when tested in English immediately after. Our results show that speakers and listeners of different languages exploit word order to increase communicative efficiency.
  • Rubio-Fernández, P. (2021). Pragmatic markers: the missing link between language and Theory of Mind. Synthese, 199, 1125-1158. doi:10.1007/s11229-020-02768-z.

    Abstract

    Language and Theory of Mind come together in communication, but their relationship has been intensely contested. I hypothesize that pragmatic markers connect language and Theory of Mind and enable their co-development and co-evolution through a positive feedback loop, whereby the development of one skill boosts the development of the other. I propose to test this hypothesis by investigating two types of pragmatic markers: demonstratives (e.g., ‘this’ vs. ‘that’ in English) and articles (e.g., ‘a’ vs. ‘the’). Pragmatic markers are closed-class words that encode non-representational information that is unavailable to consciousness, but accessed automatically in processing. These markers have been associated with implicit Theory of Mind because they are used to establish joint attention (e.g., ‘I prefer that one’) and mark shared knowledge (e.g., ‘We bought the house’ vs. ‘We bought a house’). Here I develop a theoretical account of how joint attention (as driven by the use of demonstratives) is the basis for children’s later tracking of common ground (as marked by definite articles). The developmental path from joint attention to common ground parallels language change, with demonstrative forms giving rise to definite articles. This parallel opens the possibility of modelling the emergence of Theory of Mind in human development in tandem with its routinization across language communities and generations of speakers. I therefore propose that, in order to understand the relationship between language and Theory of Mind, we should study pragmatics at three parallel timescales: during language acquisition, language use, and language change.
  • Rubio-Fernández, P., Southgate, V., & Király, I. (2021). Pragmatics for infants: commentary on Wenzelet al. (2020). Royal Society Open Science, 8: 210247. doi:10.1098/rsos.210247.
  • Rubio-Fernandez, P. (2022). Demonstrative systems: From linguistic typology to social cognition. Cognitive Psychology, 139: 101519. doi:10.1016/j.cogpsych.2022.101519.

    Abstract

    This study explores the connection between language and social cognition by empirically testing different typological analyses of various demonstrative systems. Linguistic typology classifies demonstrative systems as distance-oriented or person-oriented, depending on whether they indicate the location of a referent relative only to the speaker, or to both the speaker and the listener. From the perspective of social cognition, speakers of languages with person-oriented systems must monitor their listener’s spatial location in order to accurately use their demonstratives, while speakers of languages with distance-oriented systems can use demonstratives from their own, egocentric perspective. Resolving an ongoing controversy around the nature of the Spanish demonstrative system, the results of Experiment 1 confirmed that this demonstrative system is person oriented, while the English system is distance oriented. Experiment 2 revealed that not all three-way demonstrative systems are person oriented, with Japanese speakers showing sensitivity to the listener’s spatial location, while Turkish speakers did not show such an effect in their demonstrative choice. In Experiment 3, Catalan-Spanish bilinguals showed sensitivity to listener position in their choice of the Spanish distal form, but not in their choice of the medial form. These results were interpreted as a transfer effect from Catalan, which revealed analogous results to English. Experiment 4 investigated the use of demonstratives to redirect a listener’s attention to the intended referent, which is a universal function of demonstratives that also hinges on social cognition. Japanese and Spanish speakers chose between their proximal and distal demonstratives flexibly, depending on whether the listener was looking closer or further from the referent, whereas Turkish speakers chose their medial form for attention correction. In conclusion, the results of this study support the view that investigating how speakers of different languages jointly use language and social cognition in communication has the potential to unravel the deep connection between these two fundamentally human capacities.
  • De Rue, N., Snijders, T. M., & Fikkert, P. (2021). Contrast and conflict in Dutch vowels. Frontiers in Human Neuroscience, 15: 629648. doi:10.3389/fnhum.2021.629648.

    Abstract

    The nature of phonological representations has been extensively studied in phonology and psycholinguistics. While full specification is still the norm in psycholinguistic research, underspecified representations may better account for perceptual asymmetries. In this paper, we report on a mismatch negativity (MMN) study with Dutch listeners who took part in a passive oddball paradigm to investigate when the brain notices the difference between expected and observed vowels. In particular, we tested neural discrimination (indicating perceptual discrimination) of the tense mid vowel pairs /o/-/ø/ (place contrast), /e/-/ø/ (labiality or rounding contrast), and /e/-/o/ (place and labiality contrast). Our results show (a) a perceptual asymmetry for place in the /o/-/ø/ contrast, supporting underspecification of [CORONAL] and replicating earlier results for German, and (b) a perceptual asymmetry for labiality for the /e/-/ø/ contrast, which was not reported in the German study. A labial deviant [ø] (standard /e/) yielded a larger MMN than a deviant [e] (standard /ø/). No asymmetry was found for the two-feature contrast. This study partly replicates a similar MMN study on German vowels, and partly presents new findings indicating cross-linguistic differences. Although the vowel inventory of Dutch and German is to a large extent comparable, their (morpho)phonological systems are different, which is reflected in processing.

    Additional information

    supplementary material
  • Ruggeri, K., Većkalov, B., Bojanić, L., Andersen, T. L., Ashcroft-Jones, S., Ayacaxli, N., Barea-Arroyo, P., Berge, M. L., Bjørndal, L. D., Bursalıoğlu, A., Bühler, V., Čadek, M., Çetinçelik, M., Clay, G., Cortijos-Bernabeu, A., Damnjanović, K., Dugue, T. M., Esberg, M., Esteban-Serna, C., Felder, E. N. and 63 moreRuggeri, K., Većkalov, B., Bojanić, L., Andersen, T. L., Ashcroft-Jones, S., Ayacaxli, N., Barea-Arroyo, P., Berge, M. L., Bjørndal, L. D., Bursalıoğlu, A., Bühler, V., Čadek, M., Çetinçelik, M., Clay, G., Cortijos-Bernabeu, A., Damnjanović, K., Dugue, T. M., Esberg, M., Esteban-Serna, C., Felder, E. N., Friedemann, M., Frontera-Villanueva, D. I., Gale, P., Garcia-Garzon, E., Geiger, S. J., George, L., Girardello, A., Gracheva, A., Gracheva, A., Guillory, M., Hecht, M., Herte, K., Hubená, B., Ingalls, W., Jakob, L., Janssens, M., Jarke, H., Kácha, O., Kalinova, K. N., Karakasheva, R., Khorrami, P. R., Lep, Ž., Lins, S., Lofthus, I. S., Mamede, S., Mareva, S., Mascarenhas, M. F., McGill, L., Morales-Izquierdo, S., Moltrecht, B., Mueller, T. S., Musetti, M., Nelsson, J., Otto, T., Paul, A. F., Pavlović, I., Petrović, M. B., Popović, D., Prinz, G. M., Razum, J., Sakelariev, I., Samuels, V., Sanguino, I., Say, N., Schuck, J., Soysal, I., Todsen, A. L., Tünte, M. R., Vdovic, M., Vintr, J., Vovko, M., Vranka, M. A., Wagner, L., Wilkins, L., Willems, M., Wisdom, E., Yosifova, A., Zeng, S., Ahmed, M. A., Dwarkanath, T., Cikara, M., Lees, J., & Folke, T. (2021). The general fault in our fault lines. Nature Human Behaviour, 5, 1369-1380. doi:10.1038/s41562-021-01092-x.

    Abstract

    Pervading global narratives suggest that political polarization is increasing, yet the accuracy of such group meta-perceptions has been drawn into question. A recent US study suggests that these beliefs are inaccurate and drive polarized beliefs about out-groups. However, it also found that informing people of inaccuracies reduces those negative beliefs. In this work, we explore whether these results generalize to other countries. To achieve this, we replicate two of the original experiments with 10,207 participants across 26 countries. We focus on local group divisions, which we refer to as fault lines. We find broad generalizability for both inaccurate meta-perceptions and reduced negative motive attribution through a simple disclosure intervention. We conclude that inaccurate and negative group meta-perceptions are exhibited in myriad contexts and that informing individuals of their misperceptions can yield positive benefits for intergroup relations. Such generalizability highlights a robust phenomenon with implications for political discourse worldwide.

    Additional information

    supplementary information data via OSF
  • Ruggeri, K., Panin, A., Vdovic, M., Većkalov, B., Abdul-Salaam, N., Achterberg, J., Akil, C., Amatya, J., Amatya, K., Andersen, T. L., Aquino, S. D., Arunasalam, A., Ashcroft-Jones, S., Askelund, A. D., Ayacaxli, N., Bagheri Sheshdeh, A., Bailey, A., Barea Arroyo, P., Basulto Mejía, G., Benvenuti, M. and 151 moreRuggeri, K., Panin, A., Vdovic, M., Većkalov, B., Abdul-Salaam, N., Achterberg, J., Akil, C., Amatya, J., Amatya, K., Andersen, T. L., Aquino, S. D., Arunasalam, A., Ashcroft-Jones, S., Askelund, A. D., Ayacaxli, N., Bagheri Sheshdeh, A., Bailey, A., Barea Arroyo, P., Basulto Mejía, G., Benvenuti, M., Berge, M. L., Bermaganbet, A., Bibilouri, K., Bjørndal, L. D., Black, S., Blomster Lyshol, J. K., Brik, T., Buabang, E. K., Burghart, M., Bursalıoğlu, A., Buzayu, N. M., Čadek, M., De Carvalho, N. M., Cazan, A.-M., Çetinçelik, M., Chai, V. E., Chen, P., Chen, S., Clay, G., D’Ambrogio, S., Damnjanović, K., Duffy, G., Dugue, T., Dwarkanath, T., Envuladu, E. A., Erceg, N., Esteban-Serna, C., Farahat, E., Farrokhnia, R. A., Fawad, M., Fedryansyah, M., Feng, D., Filippi, S., Fonollá, M. A., Freichel, R., Freira, L., Friedemann, M., Gao, Z., Ge, S., Geiger, S. J., George, L., Grabovski, I., Gracheva, A., Gracheva, A., Hajian, A., Hasan, N., Hecht, M., Hong, X., Hubená, B., Ikonomeas, A. G. F., Ilić, S., Izydorczyk, D., Jakob, L., Janssens, M., Jarke, H., Kácha, O., Kalinova, K. N., Kapingura, F. M., Karakasheva, R., Kasdan, D. O., Kemel, E., Khorrami, P., Krawiec, J. M., Lagidze, N., Lazarević, A., Lazić, A., Lee, H. S., Lep, Ž., Lins, S., Lofthus, I. S., Macchia, L., Mamede, S., Mamo, M. A., Maratkyzy, L., Mareva, S., Marwaha, S., McGill, L., McParland, S., Melnic, A., Meyer, S. A., Mizak, S., Mohammed, A., Mukhyshbayeva, A., Navajas, J., Neshevska, D., Niazi, S. J., Nieves, A. E. N., Nippold, F., Oberschulte, J., Otto, T., Pae, R., Panchelieva, T., Park, S. Y., Pascu, D. S., Pavlović, I., Petrović, M. B., Popović, D., Prinz, G. M., Rachev, N. R., Ranc, P., Razum, J., Rho, C. E., Riitsalu, L., Rocca, F., Rosenbaum, R. S., Rujimora, J., Rusyidi, B., Rutherford, C., Said, R., Sanguino, I., Sarikaya, A. K., Say, N., Schuck, J., Shiels, M., Shir, Y., Sievert, E. D. C., Soboleva, I., Solomonia, T., Soni, S., Soysal, I., Stablum, F., Sundström, F. T. A., Tang, X., Tavera, F., Taylor, J., Tebbe, A.-L., Thommesen, K. K., Tobias-Webb, J., Todsen, A. L., Toscano, F., Tran, T., Trinh, J., Turati, A., Ueda, K., Vacondio, M., Vakhitov, V., Valencia, A. J., Van Reyn, C., Venema, T. A. G., Verra, S. E., Vintr, J., Vranka, M. A., Wagner, L., Wu, X., Xing, K. Y., Xu, K., Xu, S., Yamada, Y., Yosifova, A., Zupan, Z., & García-Garzon, E. (2022). The globalizability of temporal discounting. Nature Human Behaviour, 6, 1386-1397. doi:10.1038/s41562-022-01392-w.

    Abstract

    Economic inequality is associated with preferences for smaller, immediate gains over larger, delayed ones. Such temporal discounting may feed into rising global inequality, yet it is unclear whether it is a function of choice preferences or norms, or rather the absence of sufficient resources for immediate needs. It is also not clear whether these reflect true differences in choice patterns between income groups. We tested temporal discounting and five intertemporal choice anomalies using local currencies and value standards in 61 countries (N = 13,629). Across a diverse sample, we found consistent, robust rates of choice anomalies. Lower-income groups were not significantly different, but economic inequality and broader financial circumstances were clearly correlated with population choice patterns.
  • De Ruiter, L. E., Lemen, H., Lieven, E. V. M., Brandt, S., & Theakston, A. L. (2021). Structural and interactional aspects of adverbial sentences in English mother-child interactions: an analysis of two dense corpora. Journal of Child Language, 48(6), 1150-1184. doi:10.1017/S0305000920000641.

    Abstract

    We analysed both structural and functional aspects of sentences containing the four
    adverbials “after”, “before”, “because”, and “if” in two dense corpora of parent-child
    interactions from two British English-acquiring children (2;00–4;07). In comparing
    mothers’ and children’s usage we separate out the effects of frequency, cognitive
    complexity and pragmatics in explaining the course of acquisition of adverbial
    sentences. We also compare these usage patterns to stimuli used in a range of
    experimental studies and show how differences may account for some of the difficulties
    that children have shown in experiments. In addition, we report descriptive data on
    various aspects of adverbial sentences that have not yet been studied as a resource for
    future investigations.

    Additional information

    S0305000920000641sup001.docx
  • Sainburg, T., Mai, A., & Gentner, T. Q. (2022). Long-range sequential dependencies precede complex syntactic production in language acquisition. Proceedings of the Royal Society B: Biological Sciences, 289: 20212657. doi:10.1098/rspb.2021.2657.

    Abstract

    To convey meaning, human language relies on hierarchically organized, long-
    range relationships spanning words, phrases, sentences and discourse. As the
    distances between elements (e.g. phonemes, characters, words) in human
    language sequences increase, the strength of the long-range relationships
    between those elements decays following a power law. This power-law
    relationship has been attributed variously to long-range sequential organiz-
    ation present in human language syntax, semantics and discourse structure.
    However, non-linguistic behaviours in numerous phylogenetically distant
    species, ranging from humpback whale song to fruit fly motility, also demon-
    strate similar long-range statistical dependencies. Therefore, we hypothesized
    that long-range statistical dependencies in human speech may occur indepen-
    dently of linguistic structure. To test this hypothesis, we measured long-range
    dependencies in several speech corpora from children (aged 6 months–
    12 years). We find that adult-like power-law statistical dependencies are present
    in human vocalizations at the earliest detectable ages, prior to the production of
    complex linguistic structure. These linguistic structures cannot, therefore, be
    the sole cause of long-range statistical dependencies in language
  • Salazar-Casals, A., de Reus, K., Greskewitz, N., Havermans, J., Geut, M., Villanueva, S., & Rubio-Garcia, A. (2022). Increased incidence of entanglements and ingested marine debris in Dutch seals from 2010 to 2020. Oceans, 3(3), 389-400. doi:10.3390/oceans3030026.

    Abstract

    In recent decades, the amount of marine debris has increased in our oceans. As wildlife interactions with debris increase, so does the number of entangled animals, impairing normal behavior and potentially affecting the survival of these individuals. The current study summarizes data on two phocid species, harbor (Phoca vitulina) and gray seals (Halichoerus grypus), affected by marine debris in Dutch waters from 2010 to 2020. The findings indicate that the annual entanglement rate (13.2 entanglements/year) has quadrupled compared with previous studies. Young seals, particularly gray seals, are the most affected individuals, with most animals found or sighted with fishing nets wrapped around their necks. Interestingly, harbor seals showed a higher incidence of ingested debris. Species differences with regard to behavior, foraging strategies, and habitat preferences may explain these findings. The lack of consistency across reports suggests that it is important to standardize data collection from now on. Despite increased public awareness about the adverse environmental effects of marine debris, more initiatives and policies are needed to ensure the protection of the marine environment in the Netherlands.
  • San Jose, A., Roelofs, A., & Meyer, A. S. (2021). Modeling the distributional dynamics of attention and semantic interference in word production. Cognition, 211: 104636. doi:10.1016/j.cognition.2021.104636.

    Abstract

    In recent years, it has become clear that attention plays an important role in spoken word production. Some of this evidence comes from distributional analyses of reaction time (RT) in regular picture naming and picture-word interference. Yet we lack a mechanistic account of how the properties of RT distributions come to reflect attentional processes and how these processes may in turn modulate the amount of conflict between lexical representations. Here, we present a computational account according to which attentional lapses allow for existing conflict to build up unsupervised on a subset of trials, thus modulating the shape of the resulting RT distribution. Our process model resolves discrepancies between outcomes of previous studies on semantic interference. Moreover, the model's predictions were confirmed in a new experiment where participants' motivation to remain attentive determined the size and distributional locus of semantic interference in picture naming. We conclude that process modeling of RT distributions importantly improves our understanding of the interplay between attention and conflict in word production. Our model thus provides a framework for interpreting distributional analyses of RT data in picture naming tasks.
  • Sankoff, G., & Brown, P. (1976). The origins of syntax in discourse: A case study of Tok Pisin relatives. Language, 52(3), 631-666.

    Abstract

    The structure of relative clauses has attracted considerable attention in recent years, and a number of authors have carried out analyses of the syntax of relativization. In our investigation of syntactic structure and change in New Guinea Tok Pisin, we find that the basic processes involved in relativization have much broader discourse functions, and that relativization is only a special instance of the application of general ‘bracketing’ devices used in the organization of information. Syntactic structure, in this case, can be understood as a component of, and derivative from, discourse structure.
  • Santin, M., Van Hout, A., & Flecken, M. (2021). Event endings in memory and language. Language, Cognition and Neuroscience, 36(5), 625-648. doi:10.1080/23273798.2020.1868542.

    Abstract

    Memory is fundamental for comprehending and segmenting the flow of activity around us into units called “events”. Here, we investigate the effect of the movement dynamics of actions (ceased, ongoing) and the inner structure of events (with or without object-state change) on people's event memory. Furthermore, we investigate how describing events, and the meaning and form of verb predicates used (denoting a culmination moment, or not, in single verbs or verb-satellite constructions), affects event memory. Before taking a surprise recognition task, Spanish and Mandarin speakers (who lexicalise culmination in different verb predicate forms) watched short videos of events, either in a non-verbal (probe-recognition) or a verbal experiment (event description). Results show that culminated events (i.e. ceased change-of-state events) were remembered best across experiments. Language use showed to enhance memory overall. Further, the form of the verb predicates used for denoting culmination had a moderate effect on memory.
  • Sauppe, S., & Flecken, M. (2021). Speaking for seeing: Sentence structure guides visual event apprehension. Cognition, 206: 104516. doi:10.1016/j.cognition.2020.104516.

    Abstract

    Human experience and communication are centred on events, and event apprehension is a rapid process that draws on the visual perception and immediate categorization of event roles (“who does what to whom”). We demonstrate a role for syntactic structure in visual information uptake for event apprehension. An event structure foregrounding either the agent or patient was activated during speaking, transiently modulating the apprehension of subsequently viewed unrelated events. Speakers of Dutch described pictures with actives and passives (agent and patient foregrounding, respectively). First fixations on pictures of unrelated events that were briefly presented (for 300 ms) next were influenced by the active or passive structure of the previously produced sentence. Going beyond the study of how single words cue object perception, we show that sentence structure guides the viewpoint taken during rapid event apprehension.

    Additional information

    supplementary material
  • Scala, M., Anijs, M., Battini, R., Madia, F., Capra, V., Scudieri, P., Verrotti, A., Zara, F., Minetti, C., Vernes, S. C., & Striano, P. (2021). Hyperkinetic stereotyped movements in a boy with biallelic CNTNAP2 variants. Italian Journal of Pediatrics, 47: 208. doi:10.1186/s13052-021-01162-w.

    Abstract

    Background

    Heterozygous variants in CNTNAP2 have been implicated in a wide range of neurological phenotypes, including intellectual disability (ID), epilepsy, autistic spectrum disorder (ASD), and impaired language. However, heterozygous variants can also be found in unaffected individuals. Biallelic CNTNAP2 variants are rarer and cause a well-defined genetic syndrome known as CASPR2 deficiency disorder, a condition characterised by ID, early-onset refractory epilepsy, language impairment, and autistic features.
    Case-report

    A 7-year-old boy presented with hyperkinetic stereotyped movements that started during early infancy and persisted over childhood. Abnormal movements consisted of rhythmic and repetitive shaking of the four limbs, with evident stereotypic features. Additional clinical features included ID, attention deficit-hyperactivity disorder (ADHD), ASD, and speech impairment, consistent with CASPR2 deficiency disorder. Whole-genome array comparative genomic hybridization detected a maternally inherited 0.402 Mb duplication, which involved intron 1, exon 2, and intron 2 of CNTNAP2 (c.97 +?_209-?dup). The affected region in intron 1 contains a binding site for the transcription factor FOXP2, potentially leading to abnormal CNTNAP2 expression regulation. Sanger sequencing of the coding region of CNTNAP2 also identified a paternally-inherited missense variant c.2752C > T, p.(Leu918Phe).
    Conclusion

    This case expands the molecular and phenotypic spectrum of CASPR2 deficiency disorder, suggesting that Hyperkinetic stereotyped movements may be a rare, yet significant, clinical feature of this complex neurological disorder. Furthermore, the identification of an in-frame, largely non-coding duplication in CNTNAP2 points to a sophisticated underlying molecular mechanism, likely involving impaired FOXP2 binding.

    Additional information

    additional files
  • Schilberg, L., Ten Oever, S., Schuhmann, T., & Sack, A. T. (2021). Phase and power modulations on the amplitude of TMS-induced motor evoked potentials. PLoS One, 16(9): e0255815. doi:10.1371/journal.pone.0255815.

    Abstract

    The evaluation of transcranial magnetic stimulation (TMS)-induced motor evoked potentials (MEPs) promises valuable information about fundamental brain related mechanisms and may serve as a diagnostic tool for clinical monitoring of therapeutic progress or surgery procedures. However, reports about spontaneous fluctuations of MEP amplitudes causing high intra-individual variability have led to increased concerns about the reliability of this measure. One possible cause for high variability of MEPs could be neuronal oscillatory activity, which reflects fluctuations of membrane potentials that systematically increase and decrease the excitability of neuronal networks. Here, we investigate the dependence of MEP amplitude on oscillation power and phase by combining the application of single pulse TMS over the primary motor cortex with concurrent recordings of electromyography and electroencephalography. Our results show that MEP amplitude is correlated to alpha phase, alpha power as well as beta phase. These findings may help explain corticospinal excitability fluctuations by highlighting the modulatory effect of alpha and beta phase on MEPs. In the future, controlling for such a causal relationship may allow for the development of new protocols, improve this method as a (diagnostic) tool and increase the specificity and efficacy of general TMS applications.

    Additional information

    data and supporting information
  • Schlag, F., Allegrini, A. G., Buitelaar, J., Verhoef, E., Van Donkelaar, M. M. J., Plomin, R., Rimfeld, K., Fisher, S. E., & St Pourcain, B. (2022). Polygenic risk for mental disorder reveals distinct association profiles across social behaviour in the general population. Molecular Psychiatry, 27, 1588-1598. doi:10.1038/s41380-021-01419-0.

    Abstract

    Many mental health conditions present a spectrum of social difficulties that overlaps with social behaviour in the general population including shared but little characterised genetic links. Here, we systematically investigate heterogeneity in shared genetic liabilities with attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorders (ASD), bipolar disorder (BP), major depression (MD) and schizophrenia across a spectrum of different social symptoms. Longitudinally assessed low-prosociality and peer-problem scores in two UK population-based cohorts (4–17 years; parent- and teacher-reports; Avon Longitudinal Study of Parents and Children(ALSPAC): N ≤ 6,174; Twins Early Development Study(TEDS): N ≤ 7,112) were regressed on polygenic risk scores for disorder, as informed by genome-wide summary statistics from large consortia, using negative binomial regression models. Across ALSPAC and TEDS, we replicated univariate polygenic associations between social behaviour and risk for ADHD, MD and schizophrenia. Modelling variation in univariate genetic effects jointly using random-effect meta-regression revealed evidence for polygenic links between social behaviour and ADHD, ASD, MD, and schizophrenia risk, but not BP. Differences in age, reporter and social trait captured 45–88% in univariate effect variation. Cross-disorder adjusted analyses demonstrated that age-related heterogeneity in univariate effects is shared across mental health conditions, while reporter- and social trait-specific heterogeneity captures disorder-specific profiles. In particular, ADHD, MD, and ASD polygenic risk were more strongly linked to peer problems than low prosociality, while schizophrenia was associated with low prosociality only. The identified association profiles suggest differences in the social genetic architecture across mental disorders when investigating polygenic overlap with population-based social symptoms spanning 13 years of child and adolescent development.
  • Schoenmakers, G.-J., & Storment, J. D. (2021). Going city: Directional predicates and preposition incorporation in youth vernaculars of Dutch. Linguistics in the Netherlands, 38(1), 65-80. doi:10.1075/avt.00050.sch.

    Abstract

    In certain varieties of Dutch spoken among young people, the preposition and determiner in locative and directional PPs can sometimes be omitted. We argue on the basis of language data taken from Twitter and intuitions of young speakers of Dutch that nominal arguments in these constructions do not have a DP layer, the absence of which leads to a special interpretation. The option to omit the preposition is related to the structural and semantic complexity of the verb. The bare construction is possible only with simple verbs, and not with manner-of-motion verbs. We present an analysis that accounts for the non-pronunciation of prepositions in directional predicates by claiming that they can be licensed through incorporation into the verb. This type of incorporation is blocked if the verb is structurally complex.
  • Schoenmakers, G.-J., Poortvliet, M., & Schaeffer, J. (2022). Topicality and anaphoricity in Dutch scrambling. Natural Language & Linguistic Theory, 40, 541-571. doi:10.1007/s11049-021-09516-z.

    Abstract

    Direct objects in Dutch can precede or follow adverbs, a phenomenon commonly referred to as scrambling. The linguistic literature agrees in its assumption that scrambling is regulated by the topicality and anaphoricity status of definite objects, but theories vary as to what kinds of objects exactly are predicted to scramble. This study reports experimental data from a sentence completion experiment with adult native speakers of Dutch, showing that topics are scrambled more often than foci, and that anaphoric objects are scrambled more often than non-anaphoric objects. However, while the data provide support for the assumption that topicality and anaphoricity play an important role in scrambling, they also indicate that the discourse status of the object in and of itself cannot explain the full scrambling variation.
  • Schubotz, L., Holler, J., Drijvers, L., & Ozyurek, A. (2021). Aging and working memory modulate the ability to benefit from visible speech and iconic gestures during speech-in-noise comprehension. Psychological Research, 85, 1997-2011. doi:10.1007/s00426-020-01363-8.

    Abstract

    When comprehending speech-in-noise (SiN), younger and older adults benefit from seeing the speaker’s mouth, i.e. visible speech. Younger adults additionally benefit from manual iconic co-speech gestures. Here, we investigate to what extent younger and older adults benefit from perceiving both visual articulators while comprehending SiN, and whether this is modulated by working memory and inhibitory control. Twenty-eight younger and 28 older adults performed a word recognition task in three visual contexts: mouth blurred (speech-only), visible speech, or visible speech + iconic gesture. The speech signal was either clear or embedded in multitalker babble. Additionally, there were two visual-only conditions (visible speech, visible speech + gesture). Accuracy levels for both age groups were higher when both visual articulators were present compared to either one or none. However, older adults received a significantly smaller benefit than younger adults, although they performed equally well in speech-only and visual-only word recognition. Individual differences in verbal working memory and inhibitory control partly accounted for age-related performance differences. To conclude, perceiving iconic gestures in addition to visible speech improves younger and older adults’ comprehension of SiN. Yet, the ability to benefit from this additional visual information is modulated by age and verbal working memory. Future research will have to show whether these findings extend beyond the single word level.

    Additional information

    supplementary material
  • Schubotz, L., Özyürek, A., & Holler, J. (2022). Individual differences in working memory and semantic fluency predict younger and older adults' multimodal recipient design in an interactive spatial task. Acta Psychologica, 229: 103690. doi:10.1016/j.actpsy.2022.103690.

    Abstract

    Aging appears to impair the ability to adapt speech and gestures based on knowledge shared with an addressee
    (common ground-based recipient design) in narrative settings. Here, we test whether this extends to spatial settings
    and is modulated by cognitive abilities. Younger and older adults gave instructions on how to assemble 3D-
    models from building blocks on six consecutive trials. We induced mutually shared knowledge by either
    showing speaker and addressee the model beforehand, or not. Additionally, shared knowledge accumulated
    across the trials. Younger and crucially also older adults provided recipient-designed utterances, indicated by a
    significant reduction in the number of words and of gestures when common ground was present. Additionally, we
    observed a reduction in semantic content and a shift in cross-modal distribution of information across trials.
    Rather than age, individual differences in verbal and visual working memory and semantic fluency predicted the
    extent of addressee-based adaptations. Thus, in spatial tasks, individual cognitive abilities modulate the inter-
    active language use of both younger and older adul

    Additional information

    1-s2.0-S0001691822002050-mmc1.docx
  • Seijdel, N., Loke, J., Van de Klundert, R., Van der Meer, M., Quispel, E., Van Gaal, S., De Haan, E. H., & Scholte, H. S. (2021). On the necessity of recurrent processing during object recognition: It depends on the need for scene segmentation. Journal of Neuroscience, 41(29), 6281-6289. doi:10.1523/JNEUROSCI.2851-20.2021.

    Abstract

    Although feedforward activity may suffice for recognizing objects in isolation, additional visual operations that aid object recognition might be needed for real-world scenes. One such additional operation is figure-ground segmentation, extracting the relevant features and locations of the target object while ignoring irrelevant features. In this study of 60 human participants (female and male), we show objects on backgrounds of increasing complexity to investigate whether recurrent computations are increasingly important for segmenting objects from more complex backgrounds. Three lines of evidence show that recurrent processing is critical for recognition of objects embedded in complex scenes. First, behavioral results indicated a greater reduction in performance after masking objects presented on more complex backgrounds, with the degree of impairment increasing with increasing background complexity. Second, electroencephalography (EEG) measurements showed clear differences in the evoked response potentials between conditions around time points beyond feedforward activity, and exploratory object decoding analyses based on the EEG signal indicated later decoding onsets for objects embedded in more complex backgrounds. Third, deep convolutional neural network performance confirmed this interpretation. Feedforward and less deep networks showed a higher degree of impairment in recognition for objects in complex backgrounds compared with recurrent and deeper networks. Together, these results support the notion that recurrent computations drive figure-ground segmentation of objects in complex scenes.SIGNIFICANCE STATEMENT The incredible speed of object recognition suggests that it relies purely on a fast feedforward buildup of perceptual activity. However, this view is contradicted by studies showing that disruption of recurrent processing leads to decreased object recognition performance. Here, we resolve this issue by showing that how object recognition is resolved and whether recurrent processing is crucial depends on the context in which it is presented. For objects presented in isolation or in simple environments, feedforward activity could be sufficient for successful object recognition. However, when the environment is more complex, additional processing seems necessary to select the elements that belong to the object and by that segregate them from the background.
  • Seijdel, N., Scholte, H. S., & de Haan, E. H. (2021). Visual features drive the category-specific impairments on categorization tasks in a patient with object agnosia. Neuropsychologia, 161: 108017. doi:10.1016/j.neuropsychologia.2021.108017.

    Abstract

    Object and scene recognition both require mapping of incoming sensory information to existing conceptual knowledge about the world. A notable finding in brain-damaged patients is that they may show differentially impaired performance for specific categories, such as for “living exemplars”. While numerous patients with category-specific impairments have been reported, the explanations for these deficits remain controversial. In the current study, we investigate the ability of a brain injured patient with a well-established category-specific impairment of semantic memory to perform two categorization experiments: ‘natural’ vs. ‘manmade’ scenes (experiment 1) and objects (experiment 2). Our findings show that the pattern of categorical impairment does not respect the natural versus manmade distinction. This suggests that the impairments may be better explained by differences in visual features, rather than by category membership. Using Deep Convolutional Neural Networks (DCNNs) as ‘artificial animal models’ we further explored this idea. Results indicated that DCNNs with ‘lesions’ in higher order layers showed similar response patterns, with decreased relative performance for manmade scenes (experiment 1) and natural objects (experiment 2), even though they have no semantic category knowledge, apart from a mapping between pictures and labels. Collectively, these results suggest that the direction of category-effects to a large extent depends, at least in MS′ case, on the degree of perceptual differentiation called for, and not semantic knowledge.

    Additional information

    data and code
  • Senft, G. (2021). [Review of the book Approaches to Language and Culture ed. by Svenja Völkel and Nico Nassenstein]. Anthropological Linguistics, 63(3), 318-321.
  • Seuren, P. A. M. (2021). Saving the square of opposition. History and Philosophy of Logic, 42(1), 72-96. doi:10.1080/01445340.2020.1865782.

    Abstract

    Contrary to received opinion, the Aristotelian Square of Opposition (square) is logically sound, differing from standard modern predicate logic (SMPL) only in that it restricts the universe U of cognitively constructible situations by banning null predicates, making it less unnatural than SMPL. U-restriction strengthens the logic without making it unsound. It also invites a cognitive approach to logic. Humans are endowed with a cognitive predicate logic (CPL), which checks the process of cognitive modelling (world construal) for consistency. The square is considered a first approximation to CPL, with a cognitive set-theoretic semantics. Not being cognitively real, the null set Ø is eliminated from the semantics of CPL. Still rudimentary in Aristotle’s On Interpretation (Int), the square was implicitly completed in his Prior Analytics (PrAn), thereby introducing U-restriction. Abelard’s reconstruction of the logic of Int is logically and historically correct; the loca (Leaking O-Corner Analysis) interpretation of the square, defended by some modern logicians, is logically faulty and historically untenable. Generally, U-restriction, not redefining the universal quantifier, as in Abelard and loca, is the correct path to a reconstruction of CPL. Valuation Space modelling is used to compute the effects of U-restriction.
  • Seuren, P. A. M. (1982). De spellingsproblematiek in Suriname: Een inleiding. OSO, 1(1), 71-79.
  • Seuren, P. A. M. (2021). Essentials of semantic syntax: An appetiser. Cadernos de Linguística, 2(1). doi:10.25189/2675-4916.2021.v2.n1.id290.

    Abstract

    Semantic Syntax (SeSyn), originally called Generative Semantics, is an offshoot of Chomskyan generative grammar (ChoGG), rejected by Chomsky and his school in the late 1960s. SeSyn is the theory of algorithmical grammars producing the well-formed sentences of a language L from the corresponding semantic input, the Semantic Analysis (SA), represented as a traditional tree structure diagram in a specific formal language of incremental predicate logic with quantifying and qualifying operators (including the truth functions), and with all lexical items filled in. A SeSyn-type grammar is thus by definition transformational, but not generative. The SA originates in cognition in a manner that is still largely mysterious, but its actual form can be distilled from the Surface Structure (SS) of the sentences of L following the principles set out in SeSyn. In this presentation we provide a more or less technical résumé of the SeSyn theory. A comparison is made with ChoGG-type grammars, which are rejected on account of their intrinsic unsuitability as a cognitive-realist grammar model. The ChoGG model follows the pattern of a 1930s neopositivist Carnap-type grammar for formal logical languages. Such grammars are random sentence generators, whereas, obviously, (nonpathological) humans are not. A ChoGG-type grammar is fundamentally irreconcilable with a mentalist-realist theory of grammar. The body of the paper consists in a demonstration of the production of an English and a French sentence, the latter containing a classic instance of the cyclic rule of Predicate Raising (PR), essential in the general theory of clausal complementation yet steadfastly repudiated in ChoGG for reasons that have never been clarified. The processes and categories defined in SeSyn are effortlessly recognised in languages all over the world, whether indigenous or languages of a dominant culture—taking into account language-specific values for the general theoretical parameters involved. This property makes SeSyn particularly relevant for linguistic typology, which now ranks as the most promising branch of linguistics but has so far conspicuously lacked an adequate theoretical basis.
  • Seuren, P. A. M. (1971). Chomsky, man en werk. De Gids, 134, 298-308.
  • Seuren, P. A. M. (1976). Clitic pronoun clusters. Italian Linguistics, 2, 7-35.
  • Seuren, P. A. M. (1979). [Review of the book Approaches to natural language ed. by K. Hintikka, J. Moravcsik and P. Suppes]. Leuvense Bijdragen, 68, 163-168.
  • Seuren, P. A. M. (1971). [Review of the book Introduction à la grammaire générative by Nicolas Ruwet]. Linguistics, 10(78), 111-120. doi:10.1515/ling.1972.10.78.72.
  • Seuren, P. A. M. (1971). [Review of the book La linguistique synchronique by Andre Martinet]. Linguistics, 10(78), 109-111. doi:10.1515/ling.1972.10.78.72.
  • Seuren, P. A. M. (1971). [Review of the book Syntaxis by A. Kraak and W. Klooster]. Foundations of Language, 7(3), 441-445.
  • Seuren, P. A. M. (1979). Meer over minder dan hoeft. De Nieuwe Taalgids, 72(3), 236-239.
  • Seuren, P. A. M. (1982). Internal variability in competence. Linguistische Berichte, 77, 1-31.
  • Seuren, P. A. M. (1989). Neue Entwicklungen im Wahrheitsbegriff. Studia Leibnitiana, 21(2), 155-173.
  • Seuren, P. A. M. (1980). The delimitation between semantics and pragmatics. Quaderni di Semantica, 1, 108-113; 126-134.
  • Seuren, P. A. M. (1980). Wat is taal? Cahiers Bio-Wetenschappen en Maatschappij, 6(4), 23-29.
  • Severijnen, G. G. A., Bosker, H. R., Piai, V., & McQueen, J. M. (2021). Listeners track talker-specific prosody to deal with talker-variability. Brain Research, 1769: 147605. doi:10.1016/j.brainres.2021.147605.

    Abstract

    One of the challenges in speech perception is that listeners must deal with considerable
    segmental and suprasegmental variability in the acoustic signal due to differences between talkers. Most previous studies have focused on how listeners deal with segmental variability.
    In this EEG experiment, we investigated whether listeners track talker-specific usage of suprasegmental cues to lexical stress to recognize spoken words correctly. In a three-day training phase, Dutch participants learned to map non-word minimal stress pairs onto different object referents (e.g., USklot meant “lamp”; usKLOT meant “train”). These non-words were
    produced by two male talkers. Critically, each talker used only one suprasegmental cue to signal stress (e.g., Talker A used only F0 and Talker B only intensity). We expected participants to learn which talker used which cue to signal stress. In the test phase, participants indicated whether spoken sentences including these non-words were correct (“The word for lamp is…”).
    We found that participants were slower to indicate that a stimulus was correct if the non-word was produced with the unexpected cue (e.g., Talker A using intensity). That is, if in training Talker A used F0 to signal stress, participants experienced a mismatch between predicted and perceived phonological word-forms if, at test, Talker A unexpectedly used intensity to cue
    stress. In contrast, the N200 amplitude, an event-related potential related to phonological
    prediction, was not modulated by the cue mismatch. Theoretical implications of these
    contrasting results are discussed. The behavioral findings illustrate talker-specific prediction of prosodic cues, picked up through perceptual learning during training.
  • Sha, Z., Van Rooij, D., Anagnostou, E., Arango, C., Auzias, G., Behrmann, M., Bernhardt, B., Bolte, S., Busatto, G. F., Calderoni, S., Calvo, R., Daly, E., Deruelle, C., Duan, M., Duran, F. L. S., Durston, S., Ecker, C., Ehrlich, S., Fair, D., Fedor, J. and 38 moreSha, Z., Van Rooij, D., Anagnostou, E., Arango, C., Auzias, G., Behrmann, M., Bernhardt, B., Bolte, S., Busatto, G. F., Calderoni, S., Calvo, R., Daly, E., Deruelle, C., Duan, M., Duran, F. L. S., Durston, S., Ecker, C., Ehrlich, S., Fair, D., Fedor, J., Fitzgerald, J., Floris, D. L., Franke, B., Freitag, C. M., Gallagher, L., Glahn, D. C., Haar, S., Hoekstra, L., Jahanshad, N., Jalbrzikowski, M., Janssen, J., King, J. A., Lazaro, L., Luna, B., McGrath, J., Medland, S. E., Muratori, F., Murphy, D. G., Neufeld, J., O’Hearn, K., Oranje, B., Parellada, M., Pariente, J. C., Postema, M., Remnelius, K. L., Retico, A., Rosa, P. G. P., Rubia, K., Shook, D., Tammimies, K., Taylor, M. J., Tosetti, M., Wallace, G. L., Zhou, F., Thompson, P. M., Fisher, S. E., Buitelaar, J. K., & Francks, C. (2022). Subtly altered topological asymmetry of brain structural covariance networks in autism spectrum disorder across 43 datasets from the ENIGMA consortium. Molecular Psychiatry, 27, 2114-2125. doi:10.1038/s41380-022-01452-7.

    Abstract

    Small average differences in the left-right asymmetry of cerebral cortical thickness have been reported in individuals with autism spectrum disorder (ASD) compared to typically developing controls, affecting widespread cortical regions. The possible impacts of these regional alterations in terms of structural network effects have not previously been characterized. Inter-regional morphological covariance analysis can capture network connectivity between different cortical areas at the macroscale level. Here, we used cortical thickness data from 1455 individuals with ASD and 1560 controls, across 43 independent datasets of the ENIGMA consortium’s ASD Working Group, to assess hemispheric asymmetries of intra-individual structural covariance networks, using graph theory-based topological metrics. Compared with typical features of small-world architecture in controls, the ASD sample showed significantly altered average asymmetry of networks involving the fusiform, rostral middle frontal, and medial orbitofrontal cortex, involving higher randomization of the corresponding right-hemispheric networks in ASD. A network involving the superior frontal cortex showed decreased right-hemisphere randomization. Based on comparisons with meta-analyzed functional neuroimaging data, the altered connectivity asymmetry particularly affected networks that subserve executive functions, language-related and sensorimotor processes. These findings provide a network-level characterization of altered left-right brain asymmetry in ASD, based on a large combined sample. Altered asymmetrical brain development in ASD may be partly propagated among spatially distant regions through structural connectivity.
  • Sha, Z., Schijven, D., & Francks, C. (2021). Patterns of brain asymmetry associated with polygenic risks for autism and schizophrenia implicate language and executive functions but not brain masculinization. Molecular Psychiatry, 26(12), 7652-7660. doi:10.1038/s41380-021-01204-z.

    Abstract

    Autism spectrum disorder (ASD) and schizophrenia have been conceived as partly opposing disorders in terms of systemizing versus empathizing cognitive styles, with resemblances to male versus female average sex differences. Left-right asymmetry of the brain is an important aspect of its organization that shows average differences between the sexes, and can be altered in both ASD and schizophrenia. Here we mapped multivariate associations of polygenic risk scores for ASD and schizophrenia with asymmetries of regional cerebral cortical surface area, thickness and subcortical volume measures in 32,256 participants from the UK Biobank. Polygenic risks for the two disorders were positively correlated (r=0.08, p=7.13×10-50), and both were higher in females compared to males, consistent with biased participation against higher-risk males. Each polygenic risk score was associated with multivariate brain asymmetry after adjusting for sex, ASD r=0.03, p=2.17×10-9, schizophrenia r=0.04, p=2.61×10-11, but the multivariate patterns were mostly distinct for the two polygenic risks, and neither resembled average sex differences. Annotation based on meta-analyzed functional imaging data showed that both polygenic risks were associated with asymmetries of regions important for language and executive functions, consistent with behavioural associations that arose in phenome-wide association analysis. Overall, the results indicate that distinct patterns of subtly altered brain asymmetry may be functionally relevant manifestations of polygenic risks for ASD and schizophrenia, but do not support brain masculinization or feminization in their etiologies.
  • Sha, Z., Pepe, A., Schijven, D., Carrion Castillo, A., Roe, J. M., Westerhausen, R., Joliot, M., Fisher, S. E., Crivello, F., & Francks, C. (2021). Handedness and its genetic influences are associated with structural asymmetries of the cerebral cortex in 31,864 individuals. Proceedings of the National Academy of Sciences of the United States of America, 118(47): e2113095118. doi:10.1073/pnas.2113095118.

    Abstract

    Roughly 10% of the human population is left-handed, and this rate is increased in some brain-related disorders. The neuroanatomical correlates of hand preference have remained equivocal. We resampled structural brain image data from 28,802 right-handers and 3,062 left-handers (UK Biobank population dataset) to a symmetrical surface template, and mapped asymmetries for each of 8,681 vertices across the cerebral cortex in each individual. Left-handers compared to right-handers showed average differences of surface area asymmetry within the fusiform cortex, the anterior insula, the anterior middle cingulate cortex, and the precentral cortex. Meta-analyzed functional imaging data implicated these regions in executive functions and language. Polygenic disposition to left-handedness was associated with two of these regional asymmetries, and 18 loci previously linked with left-handedness by genome-wide screening showed associations with one or more of these asymmetries. Implicated genes included six encoding microtubule-related proteins: TUBB, TUBA1B, TUBB3, TUBB4A, MAP2, and NME7—mutations in the latter can cause left to right reversal of the visceral organs. There were also two cortical regions where average thickness asymmetry was altered in left-handedness: on the postcentral gyrus and the inferior occipital cortex, functionally annotated with hand sensorimotor and visual roles. These cortical thickness asymmetries were not heritable. Heritable surface area asymmetries of language-related regions may link the etiologies of hand preference and language, whereas nonheritable asymmetries of sensorimotor cortex may manifest as consequences of hand preference.
  • Sha, Z., Schijven, D., Carrion Castillo, A., Joliot, M., Mazoyer, B., Fisher, S. E., Crivello, F., & Francks, C. (2021). The genetic architecture of structural left–right asymmetry of the human brain. Nature Human Behaviour, 5, 1226-1236. doi:10.1038/s41562-021-01069-w.

    Abstract

    Left–right hemispheric asymmetry is an important aspect of healthy brain organization for many functions including language, and it can be altered in cognitive and psychiatric disorders. No mechanism has yet been identified for establishing the human brain’s left–right axis. We performed multivariate genome-wide association scanning of cortical regional surface area and thickness asymmetries, and subcortical volume asymmetries, using data from 32,256 participants from the UK Biobank. There were 21 significant loci associated with different aspects of brain asymmetry, with functional enrichment involving microtubule-related genes and embryonic brain expression. These findings are consistent with a known role of the cytoskeleton in left–right axis determination in other organs of invertebrates and frogs. Genetic variants associated with brain asymmetry overlapped with those associated with autism, educational attainment and schizophrenia. Comparably large datasets will likely be required in future studies, to replicate and further clarify the associations of microtubule-related genes with variation in brain asymmetry, behavioural and psychiatric traits.
  • Shapland, C. Y., Verhoef, E., Smith, G. D., Fisher, S. E., Verhulst, B., Dale, P. S., & St Pourcain, B. (2021). Multivariate genome-wide covariance analyses of literacy, language and working memory skills reveal distinct etiologies. npj Science of Learning, 6: 23. doi:10.1038/s41539-021-00101-y.

    Abstract

    Several abilities outside literacy proper are associated with reading and spelling, both phenotypically and genetically, though our knowledge of multivariate genomic covariance structures is incomplete. Here, we introduce structural models describing genetic and residual influences between traits to study multivariate links across measures of literacy, phonological awareness, oral language, and phonological working memory (PWM) in unrelated UK youth (8-13 years, N=6,453). We find that all phenotypes share a large proportion of underlying genetic variation, although especially oral language and PWM reveal substantial differences in their genetic variance composition with substantial trait-specific genetic influences. Multivariate genetic and residual trait covariance showed concordant patterns, except for marked differences between oral language and literacy/phonological awareness, where strong genetic links contrasted near-zero residual overlap. These findings suggest differences in etiological mechanisms, acting beyond a pleiotropic set of genetic variants, and implicate variation in trait modifiability even among phenotypes that have high genetic correlations.

    Additional information

    supplementary information
  • Shebani, Z., Carota, F., Hauk, O., Rowe, J. B., Barsalou, L. W., Tomasello, R., & Pulvermüller, F. (2022). Brain correlates of action word memory revealed by fMRI. Scientific Reports, 12: 16053. doi:10.1038/s41598-022-19416-w.

    Abstract

    Understanding language semantically related to actions activates the motor cortex. This activation is sensitive to semantic information such as the body part used to perform the action (e.g. arm-/leg-related action words). Additionally, motor movements of the hands/feet can have a causal effect on memory maintenance of action words, suggesting that the involvement of motor systems extends to working memory. This study examined brain correlates of verbal memory load for action-related words using event-related fMRI. Seventeen participants saw either four identical or four different words from the same category (arm-/leg-related action words) then performed a nonmatching-to-sample task. Results show that verbal memory maintenance in the high-load condition produced greater activation in left premotor and supplementary motor cortex, along with posterior-parietal areas, indicating that verbal memory circuits for action-related words include the cortical action system. Somatotopic memory load effects of arm- and leg-related words were observed, but only at more anterior cortical regions than was found in earlier studies employing passive reading tasks. These findings support a neurocomputational model of distributed action-perception circuits (APCs), according to which language understanding is manifest as full ignition of APCs, whereas working memory is realized as reverberant activity receding to multimodal prefrontal and lateral temporal areas.

    Additional information

    supplementary figure S1 caption
  • Shkaravska, O., & Van Eekelen, M. (2021). Polynomial solutions of algebraic difference equations and homogeneous symmetric polynomials. Journal of Symbolic Computation, 103, 22-45. doi:10.1016/j.jsc.2019.10.022.

    Abstract

    This article addresses the problem of computing an upper bound of
    the degree d of a polynomial solution P(x) of an algebraic differ-
    ence equation of the form Gx)(P(x −τ1), . . . , P(x −τs) + G0(x) =

    0 when such P(x) with the coefficients in a field K of character-
    istic zero exists and where G is a non-linear s-variable polynomial
    with coefficients in K[x] and G0 is a polynomial with coefficients
    in K.
    It will be shown that if G is a quadratic polynomial with constant
    coefficients then one can construct a countable family of polynomi-
    als fl(u0) such that if there exists a (minimal) index l0 with fl0(u0)
    being a non-zero polynomial, then the degree d is one of its roots
    or d ≤ l0, or d < deg(G0). Moreover, the existence of such l0 will
    be proven for K being the field of real numbers. These results are
    based on the properties of the modules generated by special fami-
    lies of homogeneous symmetric polynomials.
    A sufficient condition for the existence of a similar bound of the
    degree of a polynomial solution for an algebraic difference equation
    with G of arbitrary total degree and with variable coefficients will
    be proven as well.
  • Shukla, V., Long, M., & Rubio-Fernandez, P. (2022). Children’s acquisition of new/given markers in English, Hindi, Mandinka and Spanish: Exploring the effect of optionality during grammaticalization. Glossa Psycholinguistics, 1(1): 13. doi:10.5070/G6011120.

    Abstract

    We investigated the effect of optionality on the acquisition of new/given markers, with a special focus on grammaticalization as a stage of optional use of the emerging form. To this end, we conducted a narrative-elicitation task with 5-year-old children and adults across four typologically-distinct languages with different new/given markers: English, Hindi, Mandinka and Spanish. Our starting assumption was that the Hindi numeral ‘ek’ (one) is developing into an indefinite article, which should delay children’s acquisition because of its optional use to introduce discourse referents. Supporting the Optionality Hypothesis, Experiment 1 revealed that obligatory markers are acquired earlier than optional markers. Experiment 2 focused on Hindi and showed that 10-year-old children’s use of ‘ek’ to introduce discourse characters was higher than 5-year-olds’ and comparable to adults’, replicating this pattern of results in two different cities in Northern India. Lastly, a follow-up study showed that Mandinka-speaking children and adults made use of all available discourse markers when tested on a familiar story, rather than with pictorial prompts, highlighting the importance of using culturally-appropriate methods of narrative elicitation in cross-linguistic research. We conclude by discussing the implications of article grammaticalization for common ground management in a speech community.
  • Shukla, V., Long, M., Bhatia, V., & Rubio-Fernandez, P. (2022). Some sentences prime pragmatic reasoning in the verification and evaluation of comparisons. Journal of Experimental Psychology: Learning, Memory, and Cognition, 48(4), 569-582. doi:10.1037/xlm0001082.

    Abstract

    While most research on scalar implicature has focused on the lexical scale “some” vs “all,” here we investigated an understudied scale formed by two syntactic constructions: categorizations (e.g., “Wilma is a nurse”) and comparisons (“Wilma is like a nurse”). An experimental study by Rubio-Fernandez et al. (2017) showed high rates of logical responses to superordinate comparisons, even though they are underinformative when interpreted pragmatically (e.g., “A robin is like a bird” implies that a robin is not a bird). Based on recent studies on enrichment priming, we predicted that including “some” and “all” statements (which typically elicit high rates of pragmatic responses) in sentence verification and sentence evaluation tasks would introduce an informativity bias, increasing pragmatic responses to superordinate comparisons. The results of three Web-based experiments supported our predictions, showing that different scalar expressions not only give rise to different rates of scalar implicatures, but can also affect the degree to which an experimental task elicits pragmatic reasoning.
  • Slim, M. S., Lauwers, P., & Hartsuiker, R. J. (2021). Monolingual and bilingual logical representations of quantificational scope: Evidence from priming in language comprehension. Journal of Memory and Language, 116: 104184. doi:10.1016/j.jml.2020.104184.

    Abstract

    A doubly quantified sentence, such as All hikers climbed a hill, allows two interpretations: Did all hikers climb different hills, or did they climb the same hill? Previous work has shown that comprehenders construct disambiguated logical representations of these interpretations (Raffray & Pickering, 2010). We extended this line of research by investigating whether bilingual logical representations are shared between languages or separate per language. We conducted four sentence-picture matching experiments in which we primed interpretations of doubly quantified sentences in Dutch and French monolingual and bilingual language comprehension. These experiments showed that bilinguals have fully shared logical representations and that logical representations constructed in the L1 and the L2 are comparable. Moreover, a control experiment ruled out that the priming effects were driven by visual overlap between prime and target pictures. We discuss these findings in terms of a language-dependent account of logical representations, although these findings can also be reconciled with the idea that logical representations involve conceptual mental models of sentence meaning.
  • Slivac, K., Hervais-Adelman, A., Hagoort, P., & Flecken, M. (2021). Linguistic labels cue biological motion perception and misperception. Scientific Reports, 11: 17239. doi:10.1038/s41598-021-96649-1.

    Abstract

    Linguistic labels exert a particularly strong top-down influence on perception. The potency of this influence has been ascribed to their ability to evoke category-diagnostic features of concepts. In doing this, they facilitate the formation of a perceptual template concordant with those features, effectively biasing perceptual activation towards the labelled category. In this study, we employ a cueing paradigm with moving, point-light stimuli across three experiments, in order to examine how the number of biological motion features (form and kinematics) encoded in lexical cues modulates the efficacy of lexical top-down influence on perception. We find that the magnitude of lexical influence on biological motion perception rises as a function of the number of biological motion-relevant features carried by both cue and target. When lexical cues encode multiple biological motion features, this influence is robust enough to mislead participants into reporting erroneous percepts, even when a masking level yielding high performance is used.
  • Slonimska, A., Ozyurek, A., & Capirci, O. (2021). Using depiction for efficient communication in LIS (Italian Sign Language). Language and Cognition, 13(3), 367 -396. doi:10.1017/langcog.2021.7.

    Abstract

    Meanings communicated with depictions constitute an integral part of how speakers and signers actually use language (Clark, 2016). Recent studies have argued that, in sign languages, depicting strategy like constructed action (CA), in which a signer enacts the referent, is used for referential purposes in narratives. Here, we tested the referential function of CA in a more controlled experimental setting and outside narrative context. Given the iconic properties of CA we hypothesized that this strategy could be used for efficient information transmission. Thus, we asked if use of CA increased with the increase in the information required to be communicated. Twenty-three deaf signers of LIS described unconnected images, which varied in the amount of information represented, to another player in a director–matcher game. Results revealed that participants used CA to communicate core information about the images and also increased the use of CA as images became informatively denser. The findings show that iconic features of CA can be used for referential function in addition to its depictive function outside narrative context and to achieve communicative efficiency.
  • Slonimska, A., Özyürek, A., & Capirci, O. (2022). Simultaneity as an emergent property of efficient communication in language: A comparison of silent gesture and sign language. Wiley Interdisciplinary Reviews: Cognitive Science, 46(5): 13133. doi:10.1111/cogs.13133.

    Abstract

    Sign languages use multiple articulators and iconicity in the visual modality which allow linguistic units to be organized not only linearly but also simultaneously. Recent research has shown that users of an established sign language such as LIS (Italian Sign Language) use simultaneous and iconic constructions as a modality-specific resource to achieve communicative efficiency when they are required to encode informationally rich events. However, it remains to be explored whether the use of such simultaneous and iconic constructions recruited for communicative efficiency can be employed even without a linguistic system (i.e., in silent gesture) or whether they are specific to linguistic patterning (i.e., in LIS). In the present study, we conducted the same experiment as in Slonimska et al. with 23 Italian speakers using silent gesture and compared the results of the two studies. The findings showed that while simultaneity was afforded by the visual modality to some extent, its use in silent gesture was nevertheless less frequent and qualitatively different than when used within a linguistic system. Thus, the use of simultaneous and iconic constructions for communicative efficiency constitutes an emergent property of sign languages. The present study highlights the importance of studying modality-specific resources and their use for linguistic expression in order to promote a more thorough understanding of the language faculty and its modality-specific adaptive capabilities.
  • Smeets, C. J. L. M., Ma, K. Y., Fisher, S. E., & Verbeek, D. S. (2021). Cerebellar developmental deficits underlie neurodegenerative disorder spinocerebellar ataxia type 23. Brain Pathology, 31(2), 239-252. doi:10.1111/bpa.12905.

    Abstract

    Spinocerebellar ataxia type 23 (SCA23) is a late‐onset neurodegenerative disorder characterized by slowly progressive gait and limb ataxia, for which there is no therapy available. It is caused by pathogenic variants in PDYN, which encodes prodynorphin (PDYN). PDYN is processed into the opioid peptides α‐neoendorphin and dynorphins (Dyn) A and B; inhibitory neurotransmitters that function in pain signaling, stress‐induced responses and addiction. Variants causing SCA23 mostly affect Dyn A, leading to loss of secondary structure and increased peptide stability. PDYNR212W mice express human PDYN containing the SCA23 variant p.R212W. These mice show progressive motor deficits from 3 months of age, climbing fiber (CF) deficits from 3 months of age, and Purkinje cell (PC) loss from 12 months of age. A mouse model for SCA1 showed similar CF deficits, and a recent study found additional developmental abnormalities, namely increased GABAergic interneuron connectivity and non‐cell autonomous disruption of PC function. As SCA23 mice show a similar pathology to SCA1 mice in adulthood, we hypothesized that SCA23 may also follow SCA1 pathology during development. Examining PDYNR212W cerebella during development, we uncovered developmental deficits from 2 weeks of age, namely a reduced number of GABAergic synapses on PC soma, possibly leading to the observed delay in early phase CF elimination between 2 and 3 weeks of age. Furthermore, CFs did not reach terminal height, leaving proximal PC dendrites open to be occupied by parallel fibers (PFs). The observed increase in vGlut1 protein—a marker for PF‐PC synapses—indicates that PFs indeed take over CF territory and have increased connectivity with PCs. Additionally, we detected altered expression of several critical Ca2+ channel subunits, potentially contributing to altered Ca2+ transients in PDYNR212W cerebella. These findings indicate that developmental abnormalities contribute to the SCA23 pathology and uncover a developmental role for PDYN in the cerebellum.
  • Smith, A. C., Monaghan, P., & Huettig, F. (2021). The effect of orthographic systems on the developing reading system: Typological and computational analyses. Psychological Review, 128(1), 125-159. doi:10.1037/rev0000257.

    Abstract

    Orthographic systems vary dramatically in the extent to which they encode a language’s phonological and lexico-semantic structure. Studies of the effects of orthographic transparency suggest that such variation is likely to have major implications for how the reading system operates. However, such studies have been unable to examine in isolation the contributory effect of transparency on reading due to co-varying linguistic or socio-cultural factors. We first investigated the phonological properties of languages using the range of the world’s orthographic systems (alphabetic; alphasyllabic; consonantal; syllabic; logographic), and found that, once geographical proximity is taken into account, phonological properties do not relate to orthographic system. We then explored the processing implications of orthographic variation by training a connectionist implementation of the triangle model of reading on the range of orthographic systems whilst controlling for phonological and semantic structure. We show that the triangle model is effective as a universal model of reading, able to replicate key behavioural and neuroscientific results. Importantly, the model also generates new predictions deriving from an explicit description of the effects of orthographic transparency on how reading is realised and defines the consequences of orthographic systems on reading processes.
  • Smith, M. R., Cutler, A., Butterfield, S., & Nimmo-Smith, I. (1989). The perception of rhythm and word boundaries in noise-masked speech. Journal of Speech and Hearing Research, 32, 912-920.

    Abstract

    The present experiment tested the suggestion that human listeners may exploit durational information in speech to parse continuous utterances into words. Listeners were presented with six-syllable unpredictable utterances under noise-masking, and were required to judge between alternative word strings as to which best matched the rhythm of the masked utterances. For each utterance there were four alternative strings: (a) an exact rhythmic and word boundary match, (b) a rhythmic mismatch, and (c) two utterances with the same rhythm as the masked utterance, but different word boundary locations. Listeners were clearly able to perceive the rhythm of the masked utterances: The rhythmic mismatch was chosen significantly less often than any other alternative. Within the three rhythmically matched alternatives, the exact match was chosen significantly more often than either word boundary mismatch. Thus, listeners both perceived speech rhythm and used durational cues effectively to locate the position of word boundaries.
  • Snijders Blok, L., Goosen, Y. M., Haaften, L., Hulst, K., Fisher, S. E., Brunner, H. G., Egger, J. I. M., & Kleefstra, T. (2021). Speech‐language profiles in the context of cognitive and adaptive functioning inSATB2‐associated syndrome. Genes, Brain and Behavior, 20(7): e12761. doi:10.1111/gbb.12761.

    Abstract

    SATB2-associated syndrome (SAS) is a neurodevelopmental disorder caused by heterozygous pathogenic variants in the SATB2 gene, and is typically characterized by intellectual disability and severely impaired communication skills. The goal of this study was to contribute to the understanding of speech and language impairments in SAS, in the context of general developmental skills and cognitive and adaptive functioning. We performed detailed oral motor, speech and language profiling in combination with neuropsychological assessments in 23 individuals with a molecularly confirmed SAS diagnosis: 11 primarily verbal individuals and 12 primarily nonverbal individuals, independent of their ages. All individuals had severe receptive language delays. For all verbal individuals, we were able to define underlying speech conditions. While childhood apraxia of speech was most prevalent, oral motor problems appeared frequent as well and were more present in the nonverbal group than in the verbal group. For seven individuals, age-appropriate Wechsler indices could be derived, showing that the level of intellectual functioning of these individuals varied from moderate–mild ID to mild ID-borderline intellectual functioning. Assessments of adaptive functioning with the Vineland Screener showed relatively high scores on the domain “daily functioning” and relatively low scores on the domain “communication” in most individuals. Altogether, this study provides a detailed delineation of oral motor, speech and language skills and neuropsychological functioning in individuals with SAS, and can provide families and caregivers with information to guide diagnosis, management and treatment approaches.

    Additional information

    supporting information

Share this page