Publications

Abstract

During spoken language comprehension, listeners make use of both knowledge-based and signal-based sources of information, but little is known about how cues from these distinct levels of representational hierarchy are weighted and integrated online. In an eye-tracking experiment using the visual world paradigm, we investigated the flexible weighting and integration of morphosyntactic gender marking (a knowledge-based cue) and contextual speech rate (a signal-based cue). We observed that participants used the morphosyntactic cue immediately to make predictions about upcoming referents, even in the presence of uncertainty about the cue’s reliability. Moreover, we found speech rate normalization effects in participants’ gaze patterns even in the presence of preceding morphosyntactic information. These results demonstrate that cues are weighted and integrated flexibly online, rather than adhering to a strict hierarchy. We further found rate normalization effects in the looking behavior of participants who showed a strong behavioral preference for the morphosyntactic gender cue. This indicates that rate normalization effects are robust and potentially automatic. We discuss these results in light of theories of cue integration and the two-stage model of acoustic context effects

Abstract

Neural oscillations track linguistic information during speech comprehension (e.g., Ding et al., 2016; Keitel et al., 2018), and are known to be modulated by acoustic landmarks and speech intelligibility (e.g., Doelling et al., 2014; Zoefel & VanRullen, 2015). However, studies investigating linguistic tracking have either relied on non-naturalistic isochronous stimuli or failed to fully control for prosody. Therefore, it is still unclear whether low frequency activity tracks linguistic structure during natural speech, where linguistic structure does not follow such a palpable temporal pattern. Here, we measured electroencephalography (EEG) and manipulated the presence of semantic and syntactic information apart from the timescale of their occurrence, while carefully controlling for the acoustic-prosodic and lexical-semantic information in the signal. EEG was recorded while 29 adult native speakers (22 women, 7 men) listened to naturally-spoken Dutch sentences, jabberwocky controls with morphemes and sentential prosody, word lists with lexical content but no phrase structure, and backwards acoustically-matched controls. Mutual information (MI) analysis revealed sensitivity to linguistic content: MI was highest for sentences at the phrasal (0.8-1.1 Hz) and lexical timescale (1.9-2.8 Hz), suggesting that the delta-band is modulated by lexically-driven combinatorial processing beyond prosody, and that linguistic content (i.e., structure and meaning) organizes neural oscillations beyond the timescale and rhythmicity of the stimulus. This pattern is consistent with neurophysiologically inspired models of language comprehension (Martin, 2016, 2020; Martin & Doumas, 2017) where oscillations encode endogenously generated linguistic content over and above exogenous or stimulus-driven timing and rhythm information.

Abstract

This article presents a psycholinguistically inspired approach to the syntax of clause-level coordination and coordinate ellipsis. It departs from the assumption that coordinations are structurally similar to so-called appropriateness repairs — an important type of self-repairs in spontaneous speech. Coordinate structures and appropriateness repairs can both be viewed as “update” constructions. Updating is defined as a special sentence production mode that efficiently revises or augments existing sentential structure in response to modifications in the speaker's communicative intention. This perspective is shown to offer an empirically satisfactory and theoretically parsimonious account of two prominent types of coordinate ellipsis, in particular “forward conjunction reduction” (FCR) and “gapping” (including “long-distance gapping” and “subgapping”). They are analyzed as different manifestations of “incremental updating” — efficient updating of only part of the existing sentential structure. Based on empirical data from Dutch and German, novel treatments are proposed for both types of clausal coordinate ellipsis. The coordination-as-updating perspective appears to explain some general properties of coordinate structure: the existence of the well-known “coordinate structure constraint”, and the attractiveness of three-dimensional representations of coordination. Moreover, two other forms of coordinate ellipsis — SGF (“subject gap in finite clauses with fronted verb”), and “backward conjunction reduction” (BCR) (also known as “right node raising” or RNR) — are shown to be incompatible with the notion of incremental updating. Alternative theoretical interpretations of these phenomena are proposed. The four types of clausal coordinate ellipsis — SGF, gapping, FCR and BCR — are argued to originate in four different stages of sentence production: Intending (i.e., preparing the communicative intention), conceptualization, grammatical encoding, and phonological encoding, respectively.

Abstract

The Max Planck Institute for Psycholinguistics in Nijmegen, The Netherlands, is creating a state-of-the-art web environment for the ISO TC 37 (terminology and other language and content resources) metadata registry. This Data Category Registry (DCR) is called ISOcat and encompasses data categories for a broad range of language resources. Under the governance of the DCR Board, ISOcat provides an open work space for creating data category specifications, defining Data Category Selections (DCSs) (domain-specific groups of data categories), and standardising selected data categories and DCSs. Designers visualise future interactivity among the DCR, reference registries and ontological knowledge spaces

Abstract

This article makes the case for the universality of the sequence organization observable in informal human conversational interaction. Using the descriptive schema developed by Schegloff (2007), we examine the major patterns of action-sequencing in a dozen nearly all unrelated languages. What we find is that these patterns are instantiated in very similar ways for the most part right down to the types of different action sequences. There are also some notably different cultural exploitations of the patterns, but the patterns themselves look strongly universal. Recent work in gestural communication in the great apes suggests that sequence organization may have been a crucial route into the development of language. Taken together with the fundamental role of this organization in language acquisition, sequential behavior of this kind seems to have both phylogenetic and ontogenetic priority, which probably puts substantial functional pressure on language form.

Abstract

Autosomal recessive Stargardt disease (STGD1) is associated with variants in the ABCA4 gene. The phenotypes range from early-onset STGD1, that clinically resembles severe cone-rod dystrophy, to intermediate STGD1 and late-onset STGD1. These different phenotypes can be correlated with different combinations of ABCA4 variants which can be classified according to their degree of severity. A significant fraction of STGD1 cases, particularly late-onset STGD1 cases, were shown to carry only a single ABCA4 variant. A frequent coding variant (p.Asn1868Ile) was recently identified which – in combination with a severe ABCA4 variant – is generally associated with late-onset STGD1. In addition, an increasing number of rare deep-intronic variants have been found and some of these are also associated with late-onset STGD1. The effect of these and other variants on ABCA4 RNA was tested using in vitro assays in human kidney cells using specially designed midigenes. With stem cells and photoreceptor progenitor cells derived from patient skin or blood cells, retina-specific splice defects can be assessed. With expert clinical examination to distinguish STGD1 cases from other maculopathies, as well as in-depth genomics and transcriptomics data, it is now possible to identify both mutant ABCA4 alleles in > 95% of cases.

Abstract

Noncanonical splice-site mutations are an important cause of inherited diseases. Based on in vitro and stem-cell-based studies, some splice-site variants show a stronger splice defect than expected based on their predicted effects, suggesting that other sequence motifs influence the outcome. We investigated whether splice defects due to human-inherited-disease-associated variants in noncanonical splice-site sequences in ABCA4, DMD, and TMC1 could be rescued by strengthening the splice site on the other side of the exon. Noncanonical 5′- and 3′-splice-site variants were selected. Rescue variants were introduced based on an increase in predicted splice-site strength, and the effects of these variants were analyzed using in vitro splice assays in HEK293T cells. Exon skipping due to five variants in noncanonical splice sites of exons in ABCA4, DMD, and TMC1 could be partially or completely rescued by increasing the predicted strengths of the other splice site of the same exon. We named this mechanism “splicing interdependency”, and it is likely based on exon recognition by splicing machinery. Awareness of this interdependency is of importance in the classification of noncanonical splice-site variants associated with disease and may open new opportunities for treatments

Abstract

Humans vary in almost every dimension imaginable, and language is no
exception. In this article, we review the past research that has focused on
individual differences (IDs) in first language acquisition. We first consider
how different theoretical traditions in language acquisition treat IDs, and
we argue that a focus on IDs is important given its potential to reveal the
developmental dynamics and architectural constraints of the linguistic system.
We then review IDs research that has examined variation in children’s
linguistic input, early speech perception, and vocabulary and grammatical
development. In each case, we observe systematic and meaningful variation,
such that variation in one domain (e.g., early auditory and speech
processing) has meaningful developmental consequences for development
in higher-order domains (e.g., vocabulary). The research suggests a high
degree of integration across the linguistic system, in which development
across multiple linguistic domains is tightly coupled.

Abstract

Children must possess some ability to process input in a meaningful manner to acquire language. The present study reports on data from an experiment investigating 3- to 5-year-old English-speaking children's understanding of restrictive relative clauses manipulated for embeddedness and focus. The results of the study showed that English-speaking children acquire right-branching before center-embedded structures. Comparisons made with data from Portuguese-speaking children suggest general-cognitive and language-specific constraints on development, and with respect to English, a “clause expansion” approach to processing in development

Abstract

Statistical learning (SL) has been a prominent focus of research in developmental and adult populations, guided by the assumption that it is a fundamental component of learning underlying higher-order cognition. In developmental populations, however, there have been recent concerns regarding the degree to which many current tasks reliably measure SL, particularly in younger children. In the current article, we present the results of two studies that measured auditory statistical learning (ASL) of linguistic stimuli in children aged 5–8 years. Children listened to 6 min of continuous syllables comprising four trisyllabic pseudowords. Following the familiarization phase, children completed (a) a two-alternative forced-choice task and (b) a serial recall task in which they repeated either target sequences embedded during familiarization or foils, manipulated for sequence length. Results showed that, although both measures consistently revealed learning at the group level, the recall task better captured learning across the full range of abilities and was more reliable at the individual level. We conclude that, as has also been demonstrated in adults, the method holds promise for future studies of individual differences in ASL of linguistic stimuli.

Abstract

This study attempts to reveal the mechanisms behind the online formation of Wh-Filler-Gap Dependencies (WhFGD). Specifically, we aim to uncover the way in which maintenance and retrieval work in WhFGD processing, by paying special attention to the information that is retrieved when the gap is recognized. We use the agreement attraction phenomenon (Wagers, M. W., Lau, E. F., & Phillips, C. (2009). Agreement attraction in comprehension: Representations and processes. Journal of Memory and Language, 61(2), 206-237) as a probe. The first and second experiments examined the type of information that is maintained and how maintenance is motivated, investigating the retrieved information at the gap for reactivated fillers and definite NPs. The third experiment examined the role of the retrieval, comparing reactivated and active fillers. We contend that the information being accessed reflects the extent to which the filler is maintained, where the reader is able to access fine-grained information including category information as well as a representation of both the head and the modifier at the verb.

Abstract

In John has left London, it is clear that the event in question, John's leaving London, has occurred in the past, for example yesterday at ten. Why is it impossible, then, to make this the event time more explicit by such an adverbial, as in Yesterday at ten, John has left London? Any solution of this puzzle crucially hinges on the meaning assigned to the perfect, and the present perfect in particular. Two such solutions, a scope solution and the 'current relevance'-solution, are discussed and shown to be inadequate. A new, strictly compositional analysis of the English perfect is suggested, and it is argued that the imcompatibility of the present perfect and most past tense adverbials has neither syntactic nor semantic reasons but follows from a simple pragmatical constraint, called here the 'position-definiteness constraint'. It is the very same constraint, which also makes an utterance such as At ten, John had left at nine pragmatically odd, even if John indeed had left at nine, and hence the utterance is true.

Abstract

Vocal development of cranes (Gruidae) has attracted scientifc interest due to its special stage, voice breaking. During voice breaking, chicks of diferent crane species produce calls with two fundamental frequencies that correspond to those in adult low-frequency and juvenile high-frequency vocalizations. However, triggers that afect voice breaking in cranes are mainly unknown. Here we studied the voice breaking in the Siberian Crane (Leucogeranus leucogeranus) and test its relation to the body mass and testosterone level. We analyzed 5846 calls, 39 body mass measurements and 60 blood samples from 11
Siberian Crane chicks in 8 ages from 2.5 to 18 months of life together with 90 body mass measurements and 61 blood samples from 24 Siberian Crane adults. The individual duration of voice breaking and dates of its onset, culmination and completion depended neither on the body mass nor on the testosterone level at various ages. But we found correlation between the testosterone level and mean deltas of percentages of the high and low frequency components in Siberian Crane calls between the closest recording sessions. We also observed some coincidence in time between the mean dates of voice breaking onset and the termination of body mass gain (at 7.5 months of age), and between the mean dates of voice breaking completion and the start of a new breeding season. Similar relations have been shown previously for some other crane species. We also showed for the frst time that the mean dates of voice breaking culmination correlated with the signifcant increase of the testosterone level (at 10.5 months of age). So, we suggest that voice breaking in cranes may be triggered by the end of chicks’ body
growth, is stimulated by the increase of testosterone level and ends soon after adult cranes stop taking care of their chicks.

Abstract

Vocal-based monitoring is increasingly being used as a non-invasive method for identifying individuals within avian populations and is promising for the Siberian Crane, Leucogeranus leucogeranus. This is a poorly studied, long-lived, secretive and critically endangered bird species that breeds in the Arctic tundra of western and eastern regions of Siberia. We assessed between- and within-year stability of individual-specific vocal features in duets of Siberian Crane and tested the effect of pair-mate change on their stability. Previous findings showed that duets are specific to different pairs of birds; however, it is still unknown how long pair-specific traits of duets remain and if they change in the course of a year or when birds re-mate. We recorded duets of 15 reproductively active pairs in the Oka Crane Breeding Centre in 2003–2006 and 2013–2017. We found that pair-specific vocal signatures remained stable both within the year and across ~ 10 years. After a change of mate, most of the variables we measured in the call did not change in any of the birds. Our data suggest that the stability of the
individually specific vocal features may enable Siberian Cranes to be reliably identified by their duets over the birds’ lifetime. We believe that our work can increase confidence in the use of acoustic recognition techniques for endangered crane monitoring programs. Our results also suggest that Siberian Cranes may use their duets to form long-term social bonds between neighbours.

Abstract

Objectives: To investigate the time resolution of different methods for the computation of event-related desynchronization/synchronization (ERD/ERS), including one based on Hilbert transform. Methods: In order to better understand the time resolution of ERD/ERS, which is a function of factors such as the exact computation method, the frequency under study, the number of trials, and the sampling frequency, we simulated sudden changes in oscillation amplitude as well as very short and closely spaced events. Results: Hilbert-based ERD yields very similar results to ERD integrated over predefined time intervals (block ERD), if the block length is half the period length of the studied frequency. ERD predicts the onset of a change in oscillation amplitude with an error margin of only 10–30 ms. On the other hand, the time the ERD response needs to climb to its full height after a sudden change in oscillation amplitude is quite long, i.e. between 200 and 500 ms. With respect to sensitivity to short oscillatory events, the ratio between sampling frequency and electroencephalographic frequency band plays a major role. Conclusions: (1) The optimal time interval for the computation of block ERD is half a period of the frequency under investigation. (2) Due to the slow impulse response, amplitude effects in the ERD may in reality be caused by duration differences. (3) Although ERD based on the Hilbert transform does not yield any significant advantages over classical ERD in terms of time resolution, it has some important practical advantages.

Abstract

In everyday conversation, turns often follow each other immediately or overlap in time. It has been proposed that speakers achieve this tight temporal coordination between their turns by engaging in linguistic dual-tasking, i.e., by beginning to plan their utterance during the preceding turn. This raises the question of how speakers manage to co-ordinate speech planning and listening with each other. Experimental work addressing this issue has mostly concerned the capacity demands and interference arising when speakers retrieve some content words while listening to others. However, many contributions to conversations are not content words, but backchannels, such as “hm”. Backchannels do not provide much conceptual content and are therefore easy to plan and respond to. To estimate how much they might facilitate speech planning in conversation, we determined their frequency in a Dutch and a German corpus of conversational speech. We found that 19% of the contributions in the Dutch corpus, and 16% of contributions in the German corpus were backchannels. In addition, many turns began with fillers or particles, most often translation equivalents of “yes” or “no,” which are likewise easy to plan.We proposed that to generate comprehensive models of using language in conversation psycholinguists should study not only the generation and processing of content words, as is commonly done, but also consider backchannels, fillers, and particles.

Abstract

We aimed at investigating whether formal schooling and literacy favor progress in verbal serial-order short-term memory (STM). In Experiment 1, we presented children varying on age, school level, and socioeconomic background with a serial-order reconstruction task and observed differences related to both age and school level. Two subsequent experiments aimed at separating schooling- and literacy-related effects from age-related ones. In Experiment 2 we compared, on the one hand, performance of children of similar age but different school levels and, on the other hand, performance of children of same school level but different ages. We observed a schooling effect but no age effect on serial-order reconstruction: the youngest first-graders outperformed age-matched kindergartners but performed similarly as older first-graders of the same literacy level. Furthermore, children’s literacy abilities were strongly correlated to their serial-order reconstruction performance, even after controlling for the effects of non-verbal reasoning and vocabulary. In Experiment 3 we examined low socio-economic background adults presenting varying (correlated) levels of schooling and literacy: some had attended school in childhood for only a few years and were either illiterate or very poor readers, whereas others had attended school for at least 12 years. In addition to serial-order memory, item STM was assessed by a delayed single nonword repetition task. The groups differed on both STM tasks, which both correlated with their literacy abilities. Thus, literacy and schooling do not impact only order memory, but more generally verbal STM. Moreover, comparison between the adults’ and children’s data strongly suggests that it is schooling and/or literacy rather than age per se that matters for serial-order memory.

Abstract

A pivotal question in modern neuroscience is which genes regulate brain circuits that underlie cognitive functions. However, the field is still in its infancy. Here we report an integrated investigation of the high-level language network (i.e., sentence processing network) in the human cerebral cortex, combining regional gene expression profiles, task fMRI, large-scale neuroimaging meta-analysis, and resting-state functional network approaches. We revealed reliable gene expression-functional network correlations using three different network definition strategies, and identified a consensus set of genes related to connectivity within the sentence-processing network. The genes involved showed enrichment for neural development and actin-related functions, as well as association signals with autism, which can involve disrupted language functioning. Our findings help elucidate the molecular basis of the brain’s infrastructure for language. The integrative approach described here will be useful to study other complex cognitive traits.

Abstract

Objective

Lateralized dysfunction has been suggested in Obsessive-Compulsive Disorder (OCD). However, it is currently unclear whether OCD is characterized by abnormal patterns of structural brain asymmetry. Here we carried out by far the largest study of brain structural asymmetry in OCD.
Method

We studied a collection of 16 pediatric datasets (501 OCD patients and 439 healthy controls), as well as 30 adult datasets (1777 patients and 1654 controls) from the OCD Working Group within the ENIGMA (Enhancing Neuro-Imaging Genetics through Meta-Analysis) consortium. Asymmetries of the volumes of subcortical structures, and of regional cortical thickness and surface area measures, were assessed based on T1-weighted MRI scans, using harmonized image analysis and quality control protocols. We investigated possible alterations of brain asymmetry in OCD patients. We also explored potential associations of asymmetry with specific aspects of the disorder and medication status.
Results

In the pediatric datasets, the largest case-control differences were observed for volume asymmetry of the thalamus (more leftward; Cohen’s d = 0.19) and the pallidum (less leftward; d = -0.21). Additional analyses suggested putative links between these asymmetry patterns and medication status, OCD severity, and/or anxiety and depression comorbidities. No significant case-control differences were found in the adult datasets.
Conclusions

The results suggest subtle changes of the average asymmetry of subcortical structures in pediatric OCD, which are not detectable in adults with the disorder. These findings may reflect altered neurodevelopmental processes in OCD.

Abstract

Many companies recruit employees from different parts of the globe, and faking behavior by
potential employees is a ubiquitous phenomenon. It seems that applicants from some
countries are more prone to faking compared to others, but the reasons for these differences
are largely unexplored. This study relates country-level economic variables to faking
behavior in hiring processes. In a cross-national study across 20 countries, participants (N =
3839) reported their faking behavior in their last job interview. This study used the random
response technique (RRT) to ensure participants anonymity and to foster honest answers
regarding faking behavior. Results indicate that general economic indicators (gross domestic
product per capita [GDP] and unemployment rate) show negligible correlations with faking
across the countries, whereas economic inequality is positively related to the extent of
applicant faking to a substantial extent. These findings imply that people are sensitive to
inequality within countries and that inequality relates to faking, because inequality might
actuate other psychological processes (e.g., envy) which in turn increase the probability for
unethical behavior in many forms.

Abstract

To compare abstract structural and lexicalist accounts of syntactic processes in sentence formulation, we examined the effectiveness of nonidiomatic and idiomatic phrasal verbs in inducing structural generalizations. Three experiments made use of a syntactic priming paradigm in which participants recalled sentences they had read in rapid serial visual presentation. Prime and target sentences contained phrasal verbs with particles directly following the verb (pull off a sweatshirt) or following the direct object (pull a sweatshirt off). Idiomatic primes used verbs whose figurative meaning cannot be straightforwardly derived from the literal meaning of the main verb (e.g., pull off a robbery) and are commonly treated as stored lexical units. Particle placement in sentences was primed by both nonidiomatic and idiomatic verbs. Experiment 1 showed that the syntax of idiomatic and nonidiomatic phrasal verbs is amenable to priming, and Experiments 2 and 3 compared the priming patterns created by idiomatic and nonidiomatic primes. Despite differences in idiomaticity and structural flexibility, both types of phrasal verbs induced structural generalizations and differed little in their ability to do so. The findings are interpreted in terms of the role of abstract structural processes in language production.

Abstract

Source monitoring can be influenced by information that is external to the study context, such as beliefs and general knowledge (Johnson, Hashtroudi, & Lindsay, 1993). We investigated the extent to which metamnemonic judgments predict memory for items and sources when schematic information about the sources is or is not provided at encoding. Participants made judgments of learning (JOLs) to statements presented by two speakers and were informed of the occupation of each speaker either before or after the encoding session. Replicating earlier work, prior knowledge decreased participants' tendency to erroneously attribute statements to schematically consistent but episodically incorrect speakers. The origin of this effect can be understood by examining the relationship between JOLs and performance: JOLs were equally predictive of item and source memory in the absence of prior knowledge, but were exclusively predictive of source memory when participants knew of the relationship between speakers and statements during study. Background knowledge determines the information that people solicit in service of metamnemonic judgments, suggesting that these judgments reflect control processes during encoding that reduce schematic errors.

Abstract

Recognizing word boundaries in continuous speech requires detailed knowledge of the native language. In the first year of life, infants acquire considerable word segmentation abilities. Infants at this early stage in word segmentation rely to a large extent on the metrical pattern of their native language, at least in stress-based languages. In Dutch and English (both languages with a preferred trochaic stress pattern), segmentation of strong-weak words develops rapidly between 7 and 10 months of age. Nevertheless, trochaic languages contain not only strong-weak words but also words with a weak-strong stress pattern. In this article, we present electrophysiological evidence of the beginnings of weak-strong word segmentation in Dutch 10-month-olds. At this age, the ability to combine different cues for efficient word segmentation does not yet seem to be completely developed. We provide evidence that Dutch infants still largely rely on strong syllables, even for the segmentation of weak-strong words.

Abstract

The paper investigates the use of manner verbs (e.g. marcher 'to walk', courir 'to run') with so-called locative prepositions (e.g. dans 'in', sous 'under') in the descriptions of motion in French, as in Il a couru dans le bureau 'He ran in (to) the office', to explore the type of events such constructions express and the factors that influence their interpretation. Based on an extensive corpus survey, the study shows that, contrary to the general claim according to which such constructions express typically motion in some location, they are also frequently used to express change of location. The study discusses the interplay of various factors that contribute to the interpretation of these constructions, including semantic, aspectual and pragmatic factors.

Abstract

Recent neuroimaging evidence suggests that the frequency of entrained oscillations in auditory cortices influences the perceived duration of speech segments, impacting word perception (Kösem et al. 2018). We further tested the causal influence of neural entrainment frequency during speech processing, by manipulating entrainment with continuous transcranial alternating
current stimulation (tACS) at distinct oscillatory frequencies (3 Hz and 5.5 Hz) above the auditory cortices. Dutch participants listened to speech and were asked to report their percept of a target Dutch word, which contained a vowel with an ambiguous duration. Target words
were presented either in isolation (first experiment) or at the end of spoken sentences (second experiment). We predicted that the tACS frequency would influence neural entrainment and
therewith how speech is perceptually sampled, leading to a perceptual over- or underestimation of the vowel’s duration. Whereas results from Experiment 1 did not confirm this prediction, results from experiment 2 suggested a small effect of tACS frequency on target word
perception: Faster tACS lead to more long-vowel word percepts, in line with the previous neuroimaging findings. Importantly, the difference in word perception induced by the different tACS frequencies was significantly larger in experiment 1 vs. experiment 2, suggesting that the
impact of tACS is dependent on the sensory context. tACS may have a stronger effect on spoken word perception when the words are presented in continuous speech as compared to when they are isolated, potentially because prior (stimulus-induced) entrainment of brain oscillations
might be a prerequisite for tACS to be effective.

Abstract

Little is known about the genetic contribution to individual differences in neural networks subserving cognition function. In this functional magnetic resonance imaging (fMRI) twin study, we found a significant genetic influence on brain activation in neural networks supporting digit working memory tasks. Participants activating frontal-parietal networks responded faster than individuals relying more on language-related brain networks.There were genetic influences on brain activation in language-relevant brain circuits that were atypical for numerical working memory tasks as such. This suggests that differences in cognition might be related to brain activation patterns that differ qualitatively among individuals.

Abstract

As in the case of other non-English languages, the study of the acquisition of Turkish has mostly focused on aspects of grammatical morphology and syntax, largely neglecting the study of the effect of interactional factors on child morphosyntax. This paper reviews indications from past research that studying input and adult-child discourse can facilitate the study of the acquisition of morphosyntax in the Turkish language. It also provides some recent studies of Turkish child language on the relationship of child-directed speech to the early acquisition of morphosyntax, and on the pragmatic features of a certain kind of discourse form in child-directed speech called variation sets.

Abstract

Heterozygous mutations of the human FOXP2 gene cause a developmental disorder involving impaired learning and production of fluent spoken language. Previous investigations of its aetiology have focused on disturbed function of neural circuits involved in motor control. However, Foxp2 expression has been found in the cochlea and auditory brain centers and deficits in auditory processing could contribute to difficulties in speech learning and production. Here, we recorded auditory brainstem responses (ABR) to assess two heterozygous mouse models carrying distinct Foxp2 point mutations matching those found in humans with FOXP2-related speech/language impairment. Mice which carry a Foxp2-S321X nonsense mutation, yielding reduced dosage of Foxp2 protein, did not show systematic ABR differences from wildtype littermates. Given that speech/language disorders are observed in heterozygous humans with similar nonsense mutations (FOXP2-R328X), our findings suggest that auditory processing deficits up to the midbrain level are not causative for FOXP2-related language impairments. Interestingly, however, mice harboring a Foxp2-R552H missense mutation displayed systematic alterations in ABR waves with longer latencies (significant for waves I, III, IV) and smaller amplitudes (significant for waves I, IV) suggesting that either the synchrony of synaptic transmission in the cochlea and in auditory brainstem centers is affected, or fewer auditory nerve fibers and fewer neurons in auditory brainstem centers are activated compared to wildtypes. Therefore, the R552H mutation uncovers possible roles for Foxp2 in the development and/or function of the auditory system. Since ABR audiometry is easily accessible in humans, our data call for systematic testing of auditory functions in humans with FOXP2 mutations.

Abstract

A growing number of studies support the partial compositionality of idiomatic phrases, while idioms are thought to vary in their syntactic flexibility. Some idioms, like kick the bucket, have been classified as inflexible and incapable of being passivized without losing their figurative interpretation (i.e., the bucket was kicked ≠ died). Crucially, this has never been substantiated by empirical findings. In the current study, we used eye-tracking to examine whether the passive forms of (flexible and inflexible) idioms retain or lose their figurative meaning. Active and passivized idioms (he kicked the bucket/the bucket was kicked) and incongruous active and passive control phrases (he kicked the apple/the apple was kicked) were inserted in sentences biasing the figurative meaning of the respective idiom (die). Active idioms served as a baseline. We hypothesized that if passivized idioms retain their figurative meaning (the bucket was kicked = died), they should be processed more efficiently than the control phrases, since their figurative meaning would be congruous in the context. If, on the other hand, passivized idioms lose their figurative interpretation (the bucket was kicked = the pail was kicked), then their meaning should be just as incongruous as that of both control phrases, in which case we would expect no difference in their processing. Eye movement patterns demonstrated a processing advantage for passivized idioms (flexible and inflexible) over control phrases, thus indicating that their figurative meaning was not compromised. These findings challenge classifications of idiom flexibility and highlight the creative nature of language.

Abstract

Individuals affected with developmental disorders of speech and language have substantial difficulty acquiring expressive and/or receptive language in the absence of any profound sensory or neurological impairment and despite adequate intelligence and opportunity. Although studies of twins consistently indicate that a significant genetic component is involved, most families segregating speech and language deficits show complex patterns of inheritance, and a gene that predisposes individuals to such disorders has not been identified. We have studied a unique three-generation pedigree, KE, in which a severe speech and language disorder is transmitted as an autosomal-dominant monogenic trait. Our previous work mapped the locus responsible, SPCH1, to a 5.6-cM interval of region 7q31 on chromosome 7 (ref. 5). We also identified an unrelated individual, CS, in whom speech and language impairment is associated with a chromosomal translocation involving the SPCH1 interval. Here we show that the gene FOXP2, which encodes a putative transcription factor containing a polyglutamine tract and a forkhead DNA-binding domain, is directly disrupted by the translocation breakpoint in CS. In addition, we identify a point mutation in affected members of the KE family that alters an invariant amino-acid residue in the forkhead domain. Our findings suggest that FOXP2 is involved in the developmental process that culminates in speech and language

Abstract

Vocal production learning (VPL), or the ability to modify vocalizations through the imitation of sounds, is a rare trait in the animal kingdom. While humans are exceptional vocal learners, few other mammalian species share this trait. Owing to their singular ecology and lifestyle, bats are highly specialized for the precise emission and reception of acoustic signals. This specialization makes them ideal candidates for the study of vocal learning, and several bat species have previously shown evidence supportive of vocal learning. Here we use a sophisticated automated set-up and a contingency training paradigm to explore the vocal learning capacity of pale spear-nosed bats. We show that these bats are capable of directional change of the fundamental frequency of their calls according to an auditory target. With this study, we further highlight the importance of bats for the study of vocal learning and provide evidence for the VPL capacity of the pale spear-nosed bat.

Abstract

We present a coding system combined with an annotation tool for the analysis of gestural behavior. The NEUROGES coding system consists of three modules that progress from gesture kinetics to gesture function. Grounded on empirical neuropsychological and psychological studies, the theoretical assumption behind NEUROGES is that its main kinetic and functional movement categories are differentially associated with specific cognitive, emotional, and interactive functions. ELAN is a free, multimodal annotation tool for digital audio and video media. It supports multileveled transcription and complies with such standards as XML and Unicode. ELAN allows gesture categories to be stored with associated vocabularies that are reusable by means of template files. The combination of the NEUROGES coding system and the annotation tool ELAN creates an effective tool for empirical research on gestural behavior.

Abstract

The present study investigates hemispheric specialisation in the use of space in communicative gestures. For this purpose, we investigate split-brain patients in whom spontaneous and distinct right hand gestures can only be controlled by the left hemisphere and vice versa, the left hand only by the right hemisphere. On this anatomical basis, we can infer hemispheric specialisation from the performances of the right and left hands. In contrast to left hand dyspraxia in tasks that require language processing, split-brain patients utilise their left hands in a meaningful way in visuo-constructive tasks such as copying drawings or block-design. Therefore, we conjecture that split-brain patients are capable of using their left hands for the communication of the content of visuo-spatial animations via gestural demonstration. On this basis, we further examine the use of space in communicative gestures by the right and left hands. McNeill and Pedelty (1995) noted for the split-brain patient N.G. that her iconic right hand gestures were exclusively displayed in the right personal space. The present study investigates systematically if there is indication for neglect of the left personal space in right hand gestures in split-brain patients.

Abstract

The present study investigates hemispheric specialisation in the use of space in communicative gestures. For this purpose, we investigate split-brain patients in whom spontaneous and distinct right hand gestures can only be controlled by the left hemisphere and vice versa, the left hand only by the right hemisphere. On this anatomical basis, we can infer hemispheric specialisation from the performances of the right and left hands. In contrast to left hand dyspraxia in tasks that require language processing, split-brain patients utilise their left hands in a meaningful way in visuo-constructive tasks such as copying drawings or block-design. Therefore, we conjecture that split-brain patients are capable of using their left hands for the communication of the content of visuo-spatial animations via gestural demonstration. On this basis, we further examine the use of space in communicative gestures by the right and left hands. McNeill and Pedelty (1995) noted for the split-brain patient N.G. that her iconic right hand gestures were exclusively displayed in the right personal space. The present study investigates systematically if there is indication for neglect of the left personal space in right hand gestures in split-brain patients.

Abstract

This paper presents a new approach to functional magnetic resonance imaging (FMRI) data analysis. The main difference lies in the view of what comprises an observation. Here we treat the data from one scanning session (comprising t volumes, say) as one observation. This is contrary to the conventional way of looking at the data where each session is treated as t different observations. Thus instead of viewing the v voxels comprising the 3D volume of the brain as the variables, we suggest the usage of the vt hypervoxels comprising the 4D volume of the brain-over-session as the variables. A linear model is fitted to the 4D volumes originating from different sessions. Parameter estimation and hypothesis testing in this model can be performed with standard techniques. The hypothesis testing generates 4D statistical images (SIs) to which any relevant test statistic can be applied. In this paper we describe two test statistics, one voxel based and one cluster based, that can be used to test a range of hypotheses. There are several benefits in treating the data from each session as one observation, two of which are: (i) the temporal characteristics of the signal can be investigated without an explicit model for the blood oxygenation level dependent (BOLD) contrast response function, and (ii) the observations (sessions) can be assumed to be independent and hence inference on the 4D SI can be made by nonparametric or Monte Carlo methods. The suggested 4D approach is applied to FMRI data and is shown to accurately detect the expected signal

Abstract

In 3 ERP experiments, we investigated how experienced L2 speakers process natural and correct syntactic input that deviates from their own, sometimes incorrect, syntactic representations. Our previous study (Lemhöfer, Schriefers, & Indefrey, 2014) had shown that L2 speakers do engage in native-like syntactic processing of gender agreement but base this processing on their own idiosyncratic (and sometimes incorrect) grammars. However, as in other standard ERP studies, but different from realistic L2 input, the materials in that study contained a large proportion of incorrect sentences. In the present study, German speakers of Dutch read exclusively objectively correct Dutch sentences that did or did not contain subjective determiner “errors” (e.g., de boot “the boat,” which conflicts with the intuition of many German speakers that the correct phrase should be het boot). During reading for comprehension (Experiment 1), no syntax-related ERP responses for subjectively incorrect compared to correct phrases were observed. The same was true even when participants explicitly attended to and learned from the determiners in the sentences (Experiment 2). Only when participants judged the correctness of determiners in each sentence (Experiment 3) did a clear P600 appear. These results suggest that the full and native-like use of subjective grammars, as reflected in the P600 to subjective violations, occurs only when speakers have reason to mistrust the grammaticality of the input, either because of the nature of the task (grammaticality judgments) or because of the salient presence of incorrect sentences.

Abstract

Successful communication is important for both society and people’s personal life. Here we show that people can improve their communication skills by interacting with multiple others, and that this improvement seems to come about by a greater tendency to take the addressee’s perspective when there are multiple partners. In Experiment 1, during a training phase, participants described figures to a new partner in each round or to the same partner in all rounds. Then all participants interacted with a new partner and their recordings from that round were presented to naïve listeners. Participants who had interacted with multiple partners during training were better understood. This occurred despite the fact that the partners had not provided the participants with any input other than feedback on comprehension during the interaction. In Experiment 2, participants were asked to provide descriptions to a different future participant in each round or to the same future participant in all rounds. Next they performed a surprise memory test designed to tap memory for global details, in line with the addressee’s perspective. Those who had provided descriptions for multiple future participants performed better. These results indicate that people can improve their communication skills by interacting with multiple people, and that this advantage might be due to a greater tendency to take the addressee’s perspective in such cases. Our findings thus show how the social environment can influence our communication skills by shaping our own behavior during interaction in a manner that promotes the development of our communication skills.

Abstract

This commentary on Alario et al. (2002) addresses two issues: (1) Different from what the authors suggest, there are no theories of production claiming the phonological word to be the upper bound of advance planning before the onset of articulation; (2) Their picture naming study of word frequency effects on speech onset is inconclusive by lack of a crucial control, viz., of object recognition latency. This is a perennial problem in picture naming studies of word frequency and age of acquisition effects

Abstract

This paper introduces a special issue of Cognition on lexical access in speech production. Over the last quarter century, the psycholinguistic study of speaking, and in particular of accessing words in speech, received a major new impetus from the analysis of speech errors, dysfluencies and hesitations, from aphasiology, and from new paradigms in reaction time research. The emerging theoretical picture partitions the accessing process into two subprocesses, the selection of an appropriate lexical item (a “lemma”) from the mental lexicon, and the phonological encoding of that item, that is, the computation of a phonetic program for the item in the context of utterance. These two theoretical domains are successively introduced by outlining some core issues that have been or still have to be addressed. The final section discusses the controversial question whether phonological encoding can affect lexical selection. This partitioning is also followed in this special issue as a whole. There are, first, four papers on lexical selection, then three papers on phonological encoding, and finally one on the interaction between selection and phonological encoding.

Abstract

In 1976, the German Max Planck Society established a new research enterprise in psycholinguistics, which became the Max Planck Institute for Psycholinguistics in Nijmegen, the Netherlands. I was fortunate enough to be invited to direct this institute. It enabled me, with my background in visual and auditory psychophysics and the theory of formal grammars and automata, to develop a long-term chronometric endeavor to dissect the process of speaking. It led, among other work, to my book Speaking (1989) and to my research team's article in Brain and Behavioral Sciences “A Theory of Lexical Access in Speech Production” (1999). When I later became president of the Royal Netherlands Academy of Arts and Sciences, I helped initiate the Women for Science research project of the Inter Academy Council, a project chaired by my physicist sister at the National Institute of Standards and Technology. As an emeritus I published a comprehensive History of Psycholinguistics (2013). As will become clear, many people inspired and joined me in these undertakings.

Abstract

A core operation in speech production is the preparation of words from a semantic base. The theory of lexical access reviewed in this article covers a sequence of processing stages beginning with the speaker’s focusing on a target concept and ending with the initiation of articulation. The initial stages of preparation are concerned with lexical selection, which is zooming in on the appropriate lexical item in the mental lexicon. The following stages concern form encoding, i.e., retrieving a word’s morphemic phonological codes, syllabifying the word, and accessing the corresponding articulatory gestures. The theory is based on chronometric measurements of spoken word production, obtained, for instance, in picture-naming tasks. The theory is largely computationally implemented. It provides a handle on the analysis of multiword utterance production as well as a guide to the analysis and design of neuroimaging studies of spoken utterance production.

Abstract

Recent work on sentence recognition suggests that listeners use their knowledge of the language to directly infer deep structure syntactic relations from surface structure markers. Suffixes may be such clues, especially in agglutinative languages. A cross-language (Dutch-Finnish) experiment is reported, designed to investigate whether the suffix structure of Finnish words (as opposed to suffixless Dutch words) can facilitate prompted recall of sentences in case these suffixes differentiate between possible deep structures. The experiment, in which 80 subjects recall sentences at the occasion of prompt words, gives only slight confirmatory evidence. Meanwhile, another prompted recall effect (Blumenthal's) could not be replicated.

Abstract

The present paper studies how, in deictic expressions, the temporal interdependency of speech and gesture is realized in the course of motor planning and execution. Two theoretical positions were compared. On the “interactive” view the temporal parameters of speech and gesture are claimed to be the result of feedback between the two systems throughout the phases of motor planning and execution. The alternative “ballistic” view, however, predicts that the two systems are independent during the phase of motor execution, the temporal parameters having been preestablished in the planning phase. In four experiments subjects were requested to indicate which of an array of referent lights was momentarily illuminated. This was done by pointing to the light and/or by using a deictic expression (this/that light). The temporal and spatial course of the pointing movement was automatically registered by means of a Selspot opto-electronic system. By analyzing the moments of gesture initiation and apex, and relating them to the moments of speech onset, it was possible to show that, for deictic expressions, the ballistic view is very nearly correct.

Abstract

In his paper, MacKay reviews his Node Structure theory of error detection, but precedes it with a critical discussion of the Perceptual Loop theory of self-monitoring proposed in Levelt (1983, 1989). The present commentary is concerned with this latter critique and shows that there are more than casual problems with MacKay’s argumentation.

Abstract

Li and Gleitman (Turning the tables: language and spatial reasoning. Cognition, in press) seek to undermine a large-scale cross-cultural comparison of spatial language and cognition which claims to have demonstrated that language and conceptual coding in the spatial domain covary (see, for example, Space in language and cognition: explorations in linguistic diversity. Cambridge: Cambridge University Press, in press; Language 74 (1998) 557): the most plausible interpretation is that different languages induce distinct conceptual codings. Arguing against this, Li and Gleitman attempt to show that in an American student population they can obtain any of the relevant conceptual codings just by varying spatial cues, holding language constant. They then argue that our findings are better interpreted in terms of ecologically-induced distinct cognitive styles reflected in language. Linguistic coding, they argue, has no causal effects on non-linguistic thinking – it simply reflects antecedently existing conceptual distinctions. We here show that Li and Gleitman did not make a crucial distinction between frames of spatial reference relevant to our line of research. We report a series of experiments designed to show that they have, as a consequence, misinterpreted the results of their own experiments, which are in fact in line with our hypothesis. Their attempts to reinterpret the large cross-cultural study, and to enlist support from animal and infant studies, fail for the same reasons. We further try to discern exactly what theory drives their presumption that language can have no cognitive efficacy, and conclude that their position is undermined by a wide range of considerations.

Abstract

This short report draws attention to an interesting kind of configuration in the lexicon that seems to have escaped theoretical or systematic descriptive attention. These configurations, which we dub SEMPLATES, consist of an abstract structure or template, which is recurrently instantiated in a number of lexical sets, typically of different form classes. A number of examples from different language families are adduced, and generalizations made about the nature of semplates, which are contrasted to other, perhaps similar, phenomena

Abstract

The notion of efficient trade-offs is frequently used in functional linguis-tics in order to explain language use and structure. In this paper I argue that this notion is more confusing than enlightening. Not every negative correlation between parameters represents a real trade-off. Moreover, trade-offs are usually reported between pairs of variables, without taking into account the role of other factors. These and other theoretical issues are illustrated in a case study of linguistic cues used in expressing “who did what to whom”: case marking, rigid word order and medial verb posi-tion. The data are taken from the Universal Dependencies corpora in 30 languages and annotated corpora of online news from the Leipzig Corpora collection. We find that not all cues are correlated negatively, which ques-tions the assumption of language as a zero-sum game. Moreover, the cor-relations between pairs of variables change when we incorporate the third variable. Finally, the relationships between the variables are not always bi-directional. The study also presents a causal model, which can serve as a more appropriate alternative to trade-offs.

Abstract

Background

Posterior cingulate cortex (PCC) is a key aspect of the default mode network (DMN). Aberrant PCC functional connectivity (FC) is implicated in schizophrenia, but the potential for PCC related changes as biological classifier of schizophrenia has not yet been evaluated.
Methods

We conducted a data-driven approach using resting-state functional MRI data to explore differences in PCC-based region- and voxel-wise FC patterns, to distinguish between patients with first-episode schizophrenia (FES) and demographically matched healthy controls (HC). Discriminative PCC FCs were selected via false discovery rate estimation. A gradient boosting classifier was trained and validated based on 100 FES vs. 93 HC. Subsequently, classification models were tested in an independent dataset of 87 FES patients and 80 HC using resting-state data acquired on a different MRI scanner.
Results

Patients with FES had reduced connectivity between PCC and frontal areas, left parahippocampal regions, left anterior cingulate cortex, and right inferior parietal lobule, but hyperconnectivity with left lateral temporal regions. Predictive voxel-wise clusters were similar to region-wise selected brain areas functionally connected with PCC in relation to discriminating FES from HC subject categories. Region-wise analysis of FCs yielded a relatively high predictive level for schizophrenia, with an average accuracy of 72.28% in the independent samples, while selected voxel-wise connectivity yielded an accuracy of 68.72%.
Conclusion

FES exhibited a pattern of both increased and decreased PCC-based connectivity, but was related to predominant hypoconnectivity between PCC and brain areas associated with DMN, that may be a useful differential feature revealing underpinnings of neuropathophysiology for schizophrenia.

Abstract

We study to what extent linguistic differences in grammatical aspect systems and verb lexicalisation patterns of Dutch and mandarin Chinese affect how speakers conceptualise the path of motion in motion events, using description and memory tasks. We hypothesised that speakers of the two languages would show different preferences towards the selection of endpoint-, trajectory- or location-information in Endpoint-oriented (not reached) events, whilst showing a similar bias towards encoding endpoints in Endpoint-reached events. Our findings show that (1) groups did not differ in endpoint encoding and memory for both event types; (2) Dutch speakers conceptualised Endpoint-oriented motion focusing on the trajectory, whereas Chinese speakers focused on the location of the moving entity. In addition, we report detailed linguistic patterns of how grammatical aspect, verb semantics and adjuncts containing path-information are combined in the two languages. Results are discussed in relation to typologies of motion expression and event cognition theory.

Abstract

Most neuroimaging studies are performed using one imaging method only, either functional magnetic resonance imaging (fMRI), electroencephalography (EEG), or magnetoencephalography (MEG). Information on both location and timing has been sought by recording fMRI and EEG, simultaneously, or MEG and fMRI in separate sessions. Such approaches assume similar active areas whether detected via hemodynamic or electrophysiological signatures. Direct comparisons, after independent analysis of data from each imaging modality, have been conducted primarily on low-level sensory processing. Here, we report MEG (timing and location) and fMRI (location) results in 11 subjects when they named pictures that depicted an action or an object. The experimental design was exactly the same for the two imaging modalities. The MEG data were analyzed with two standard approaches: a set of equivalent current dipoles and a distributed minimum norm estimate. The fMRI blood-oxygenlevel dependent (BOLD) data were subjected to the usual random-effect contrast analysis. At the group level, MEG and fMRI data showed fairly good convergence, with both overall activation patterns and task effects localizing to comparable cortical regions. There were some systematic discrepancies, however, and the correspondence was less compelling in the individual subjects. The present analysis should be helpful in reconciling results of fMRI and MEG studies on high-level cognitive functions

Abstract

The fact that many sub-populations do not take part in research, especially participants fromlower socioeconomic (SES) backgrounds, is a serious problem in education research. Toincrease the participation of such groups we must discover what social, economic andpractical factors prevent participation, and how to overcome these barriers. In the currentpaper, we review the literature on this topic, before describing a case study that demonstratesfour potential solutions to four barriers to participation in a shared reading intervention forfamilies from lower SES backgrounds. We discuss the implications of our findings forfamily-based interventions more generally, and the difficulty of balancing strategies toencourage participation with adhering to the methodological integrity of a research study

Abstract

Background: Shared reading interventions can impact positively on preschool children’s
language development and on their caregiver’s attitudes/behaviours towards
reading. However, a number of barriers may discourage families from engaging with
these interventions, particularly families from lower socio-economic status (SES)
backgrounds. We investigated how families from such backgrounds responded to an
intervention designed explicitly to overcome these barriers.
Methods: In a preregistered cluster randomised controlled trial, 85 lower SES families
and their 3-year-old to 4-year-old children from 10 different preschools were randomly
allocated to take part in The Reader’s Shared Reading programme
(intervention) or an existing ‘Story Time’ group at a library (control) once a week
for 8 weeks. Three outcome measures were assessed at baseline and post intervention:
(1) attendance, (2) enjoyment of the reading groups and (3) caregivers’ knowledge of,
attitudes and behaviours towards reading. A fourth children’s vocabulary – was
assessed at baseline and 4 weeks post intervention.
Results: Families were significantly more likely to attend the intervention group and
rated it more favourably, compared with the control group. However, there were no
significant effects on caregivers’ knowledge, attitudes and behaviours or on children’s
language.
Conclusion: The intervention was only successful in engaging families from disadvantaged
backgrounds in shared reading. Implications for the use, duration and intensity
of shared reading interventions are discussed.

Abstract

One of the defining features of human language is displacement, the ability to make reference to absent entities. Here we show that prelinguistic, 12-month-old infants already can use a nonverbal pointing gesture to make reference to absent entities. We also show that chimpanzees—who can point for things they want humans to give them—do not point to refer to absent entities in the same way. These results demonstrate that the ability to communicate about absent but mutually known entities depends not on language, but rather on deeper social-cognitive skills that make acts of linguistic reference possible in the first place. These nonlinguistic skills for displaced reference emerged apparently only after humans' divergence from great apes some 6 million years ago.