Publications

Abstract

It is an important feature of the human sentence production system that semantic and syntactic processes may overlap in time and do not proceed strictly serially. That is, the process of building the syntactic form of an utterance does not always wait until the complete semantic content for that utterance has been decided upon. On the contrary, speakers will often start pronouncing the first words of a sentence while still working on further details of its semantic content. An important advantage is memory economy. Semantic and syntactic fragments do not have to occupy working memory until complete semantic and syntactic structures for an utterance have been computed. Instead, each semantic and syntactic fragment is processed as soon as possible and is kept in working memory for a minimum period of time. This raises the question of how the sentence production system can maintain syntactic coherence across syntactic fragments. Presumably there are processes of "syntactic bookkeeping" which (1) store in working memory those syntactic properties of a fragmentary sentence which are needed to eliminate ungrammatical continuations, and (2) check whether a prospective continuation is indeed compatible with the sentence constructed so far. In reaction time experiments where subjects described, under time pressure, simple static pictures of an action performed by an actor, the second aspect of syntactic bookkeeping could be demonstrated. This evidence is used for modelling bookkeeping processes as part of a computational sentence generator which aims at simulating the syntactic operations people carry out during spontaneous speech.

Abstract

Human speakers often produce sentences incrementally. They can start speaking having in mind only a fragmentary idea of what they want to say, and while saying this they refine the contents underlying subsequent parts of the utterance. This capability imposes a number of constraints on the design of a syntactic processor. This paper explores these constraints and evaluates some recent computational sentence generators from the perspective of incremental production.

Abstract

A new cognitive architecture is proposed for the syntactic aspects of human sentence processing. The architecture, called Unification Space, is biologically inspired but not based on neural nets. Instead it relies on biosynthesis as a basic metaphor. We use simulated annealing as an optimization technique which searches for the best configuration of isolated syntactic segments or subtrees in the final parse tree. The gradually decaying activation of individual syntactic nodes determines the ‘global excitation level’ of the system. This parameter serves the function of ‘computational temperature’ in simulated annealing. We have built a computer implementation of the architecture which simulates well-known sentence understanding phenomena. We report successful simulations of the psycholinguistic effects of clause embedding, minimal attachment, right association and lexical ambiguity. In addition, we simulated impaired sentence understanding as observable in agrammatic patients. Since the Unification Space allows for contextual (semantic and pragmatic) influences on the syntactic tree formation process, it belongs to the class of interactive sentence processing models.

Abstract

Remarques sur les facteurs intervenant dans le processus de formulation des énoncés.

Abstract

The study develops a neurocomputational architecture for grammatical processing in language production and language comprehension (grammatical encoding and decoding, respectively). It seeks to answer two questions. First, how is online syntactic structure formation of the complexity required by natural-language grammars possible in a fixed, preexisting neural network without the need for online creation of new connections or associations? Second, is it realistic to assume that the seemingly disparate instantiations of syntactic structure formation in grammatical encoding and grammatical decoding can run on the same neural infrastructure? This issue is prompted by accumulating experimental evidence for the hypothesis that the mechanisms for grammatical decoding overlap with those for grammatical encoding to a considerable extent, thus inviting the hypothesis of a single “grammatical coder.” The paper answers both questions by providing the blueprint for a syntactic structure formation mechanism that is entirely based on prewired circuitry (except for referential processing, which relies on the rapid learning capacity of the hippocampal complex), and can subserve decoding as well as encoding tasks. The model builds on the “Unification Space” model of syntactic parsing developed by Vosse & Kempen (2000, 2008, 2009). The design includes a neurocomputational mechanism for the treatment of an important class of grammatical movement phenomena.

Abstract

The psychology of language as developed by Wilhelm Wundt in his fundamental work Die Sprache (1900) has a strongly mentalistic character. The dominating positions held by behaviorism in psychology and structuralism in linguistics have overruled Wundt’s language theory to the effect that it has remained relatively unknown. This situation has changed recently under the influence of transformational linguistics and cognitive psychology. The paper discusses how Wundt applied the basic psychological concepts of apperception and association to language behavior, in particular to the construction and production of sentences during unprepared speech. The final part of the paper is devoted to the work, published in 1917, of the Dutch linguistic scholar Jacques van Ginneken, who elaborated Wundt’s ideas towards an explanation of some syntactic phenomena during the language acquisition of children.

Abstract

Requesting and offering are closely related, insofar as they are activities associated with someone’s need for assistance. It has been supposed (e.g., Schegloff 2007) that requests and offers are not equivalent actions – specifically that offers are preferred actions and requests are dispreferred. We review the evidence for this claim across a corpus of requests and offers and demonstrate that the empirical evidence does not support the claim for a putative preference for offers over requests. Further consideration of the often symbiotic relationships between requesting and offering, particularly in face-to-face interactions, reveals a more complex picture of the ways in which people recruit others to help, or in which others are mobilized to help.

Abstract

For real-time and embedded systems, limiting the consumption of time and memory resources is often an important part of the requirements. Being able to predict bounds on the consumption of such resources during the development process of the code can be of great value. In this paper, we focus mainly on memory-related bounds. Recent research results have advanced the state of the art of resource consumption analysis. In this paper, we present a toolset that makes it possible to apply these research results in practice for (real-time) systems enabling JAVA developers to analyse symbolic loop bounds, symbolic bounds on heap size and both symbolic and numeric bounds on stack size. We describe which theoretical additions were needed in order to achieve this. We give an overview of the capabilities of the RESANA (Radboud University Nijmegen, The Netherlands) toolset that is the result of this effort. The toolset can not only perform generally applicable analyses, but it also contains a part of the analysis that is dedicated to the developers' (real-time) virtual machine, such that the results apply directly to the actual development environment that is used in practice

Abstract

Gesture is an integral part of face-to-face communication, and provides a rich area for cross-cultural comparison. “Locally-anchored spatial gestures” are gestures that are roughly oriented to the actual geographical direction of referents. For example, such gestures may point to a location or a thing, trace the shape of a path, or indicate the direction of a particular area. The goal of this task is to elicit locally-anchored spatial gestures across different cultures. The task follows an interview format, where one participant prompts another to talk in detail about a specific area that the main speaker knows well. The data can be used for additional purposes such as the investigation of demonstratives.

Abstract

Since Battison (1978), it has been noted in many signed languages that the Symmetry Condition constrains the form of two-handed signs in which two hands move independently. The Condition states that the form features (e.g., the handshapes and movements) of the two hands are 'symmetrical'. The Symmetry Condition has been regarded in the literature as a part of signed language phonology. In this study, we examine the linguistic status of the Symmetry Condition by comparing the degree of symmetry in signs from Sign Language of the Netherlands and speech-accompanying representational gestures produced by Dutch speakers. Like signed language, such gestures use hand movements to express concepts, but they do not constitute a linguistic system in their own right. We found that the Symmetry Condition holds equally well for signs and spontaneous gestures. This indicates that this condition is a general cognitive constraint, rather than a constraint specific to language. We suggest that the Symmetry Condition is a manifestation of the mind having one active 'mental articulator' when expressing a concept with hand movements

Abstract

The VALID Data Archive is an open multimedia data archive (under construction) with data from speakers suffering from language impairments. We report on a pilot project in the CLARIN-NL framework in which five data resources were curated. For all data sets concerned, written informed consent from the participants or their caretakers has been obtained. All materials were anonymized. The audio files were converted into wav (linear PCM) files and the transcriptions into CHAT or ELAN format. Research data that consisted of test, SPSS and Excel files were documented and converted into CSV files. All data sets obtained appropriate CMDI metadata files. A new CMDI metadata profile for this type of data resources was established and care was taken that ISOcat metadata categories were used to optimize interoperability. After curation all data are deposited at the Max Planck Institute for Psycholinguistics Nijmegen where persistent identifiers are linked to all resources. The content of the transcriptions in CHAT and plain text format can be searched with the TROVA search engine

Abstract

In the first, critical part of this study, a small sample of simple German sentences with their empirically determined pitch contours is used to demonstrate the incorrectness of numerous currently hold views of German sentence intonation. In the second, more constructive part, several interrogative sentence types are analysed and an attempt is made to show that intonation, besides other functions, indicates the permantently changing 'thematic score' in on-going discourse as well as certain validity claims.

Abstract

Tense is traditionally assumed to express temporal relations between the time of the event and the moment of speech, whereas aspect expresses various views on one and the same event. In Klein (1994), it was argued that the intuitions which underlie this viewing metaphor can be made precise by a time-relational analysis as well. In his article “Aspect vs. relative tense: the case reopened”, Jürgen Bohnemeyer challenges one important point of this analysis, the equation of aspect and relative tense in the English perfect and in temporal forms of few other languages. In the present comment, it is argued that this is indeed a simplification, which does not speak, however, against a time-relational analysis of aspect in general. The main lines of such an analysis for the English perfect are sketched. It is shown that it naturally accounts for differences between the simple past and the present perfect, as well as for the oddity of constructions such as Einstein has visited Princeton or Ira has left yesterday at five.

Abstract

Starting with Ross (1970), various proposals have been made to classify elliptical coordinations and to characterize different languages according to the types of ellipses which they admit. Sanders (1977) discusses four of these proposals, shows that they are inadequate on various grounds and proposes a fifth typology whose central claim is 'evidently correct', as he states (p. 258). In the following, I shall briefly outline this typology and then show that it is inadequate, too. Since there is only one language 1 know — German — I will take all my examples from this language. Moreover, all examples will be straightforward and easy to be judged.

Abstract

The vocal development of cranes (Gruidae) has attracted scientific interest due to a
special stage, so-called voice breaking. During voice breaking, chicks produce both
adult low-frequency and juvenile high-frequency vocalizations. The triggers that affect voice breaking are unknown. For the first time, we study the vocal development of the Demoiselle Crane (Anthropoides virgo). We describe the age and possible drivers of
the onset of voice breaking. We analyse the calls of 21 Demoiselle Crane chicks, and
compare them with the calls of six adult birds, noting the day when adult low-frequency calls are first recorded as the day when voice breaking begins. The age of voice
breaking onset does not depend on hatching date, clutch order or chick body mass. Thus, there is no correlation between body growth and the onset of voice breaking for individual Demoiselle Crane chicks. However, there is a strong relationship between body mass and voice breaking among different crane species. Demoiselle Cranes stop intense body growth at the age of 2 months and start voice breaking at 70 ^ 46 days. By way of comparison, Red-crowned Cranes finish the period of intense body growth at the age of 7 months and start voice breaking at 211 ^ 60 days. Thus, we show that the Demoiselle Crane has a sudden vocal development, similar to other crane species, and we suggest that the end of intense body growth is the trigger for the onset of voice breaking in cranes.

Abstract

The direction of object enumeration reflects children’s enculturation but previous work on the development of such spatial preferences has been inconsistent. Therefore, we documented directional preferences in finger counting, object counting, and picture naming for children (4 groups from 3 to 6 years, N = 104) and adults (N = 56). We found a right-side preference for finger counting in 3- to 6-year-olds and a left-side preference for counting objects and naming pictures by 6 years of age. Children were consistent in their special preferences when comparing object counting and picture naming, but not in other task pairings. Finally, spatial preferences were not related to cardinality comprehension. These results, together with other recent work, suggest a gradual development of spatial-numerical associations from early non-directional mappings into culturally constrained directional mappings.

Abstract

Diffusion-weighted Magnetic Resonance Imaging (DW-MRI) has emerged as the most popular neuroimaging technique used to depict the biological microstructural properties of human brain white matter. However, like other MRI techniques, traditional DW-MRI data remains subject to head motion artifacts during scanning. For example, previous studies have indicated that, with traditional DW-MRI data, head motion artifacts significantly affect the evaluation of diffusion metrics. Actually, DW-MRI data scanned with higher sampling rate are important for accurately evaluating diffusion metrics because it allows for full-brain coverage through the acquisition of multiple slices simultaneously and more gradient directions. Here, we employed a publicly available multiband DW-MRI dataset to investigate the association between motion and diffusion metrics with the standard pipeline, tract-based spatial statistics (TBSS). The diffusion metrics used in this study included not only the commonly used metrics (i.e., FA and MD) in DW-MRI studies, but also newly proposed inter-voxel metric, local diffusion homogeneity (LDH). We found that the motion effects in FA and MD seems to be mitigated to some extent, but the effect on MD still exists. Furthermore, the effect in LDH is much more pronounced. These results indicate that researchers shall be cautious when conducting data analysis and interpretation. Finally, the motion-diffusion association is discussed.

Abstract

Magnetic resonance imaging (MRI) provides valuable data for understanding the human mind and brain disorders, but in-scanner head motion introduces systematic and spurious biases. For example, differences in MRI measures (e.g., network strength, white matter integrity) between patient and control groups may be due to the differences in their head motion. To determine whether head motion is an important variable in itself, or just simply a confounding variable, we explored individual differences in psychological traits that may predispose some people to move more than others during an MRI scan. In the first two studies, we demonstrated in both children (N  =  245) and adults (N  =  581) that head motion, estimated from resting-state functional MRI and diffusion tensor imaging, was reliably correlated with impulsivity scores. Further, the difference in head motion between children with attention deficit hyperactivity disorder (ADHD) and typically developing children was largely due to differences in impulsivity. Finally, in the third study, we confirmed the observation that the regression approach, which aims to deal with motion issues by regressing out motion in the group analysis, would underestimate the effect of interest. Taken together, the present findings provide empirical evidence that links in-scanner head motion to psychological traits.

Abstract

Background Although local features of brain morphology have been widely investigated in neuroscience, the inter-regional relations in brain morphology have rarely been investigated, especially not for individual participants. New method In this paper, we proposed a novel framework for investigating this relation based on an individual's magnetic resonance imaging (MRI) data. The key idea was to estimate the probability density function (PDF) of local morphological features within a brain region to provide a global description of this region. Then, the inter-regional relations were quantified by calculating the similarity of the PDFs for pairs of regions based on the Kullback–Leibler (KL) divergence. Results For illustration, we applied this approach to a pre-post intervention study to investigate the longitudinal changes in morphological relations after long-term sleep deprivation. The results suggest the potential application of this new method for studies on individual differences in brain structure. Comparison with existing methods The current method can be employed to estimate individual morphological relations between regions, which have been largely ignored by previous studies. Conclusions Our morphological relation metric, as a novel quantitative biomarker, can be used to investigate normal individual variability and even within-individual alterations/abnormalities in brain structure.

Abstract

Sentence production requires mapping preverbal messages onto linguistic structures. Because sentences are normally built incrementally, the information encoded in a sentence-initial increment is critical for explaining how the mapping process starts and for predicting its timecourse. Two experiments tested whether and when speakers prioritize encoding of different types of information at the outset of formulation by comparing production of descriptions of transitive events (e.g., A dog is chasing the mailman) that differed on two dimensions: the ease of naming individual characters and the ease of apprehending the event gist (i.e., encoding the relational structure of the event). To additionally manipulate ease of encoding, speakers described the target events after receiving lexical primes (facilitating naming; Experiment 1) or structural primes (facilitating generation of a linguistic structure; Experiment 2). Both properties of the pictured events and both types of primes influenced the form of target descriptions and the timecourse of formulation: character-specific variables increased the probability of speakers encoding one character with priority at the outset of formulation, while the ease of encoding event gist and of generating a syntactic structure increased the likelihood of early encoding of information about both characters. The results show that formulation is flexible and highlight some of the conditions under which speakers might employ different planning strategies.

Abstract

ime perception is a critical component of conscious experience. To be in synchrony with the environment, the brain must deal not only with differences in the speed of light and sound but also with its computational and neural transmission delays. Here, we asked whether the brain could actively compensate for temporal delays by changing its processing time. Specifically, can changes in neural timing or in the phase of neural oscillation index perceived timing? For this, a lag-adaptation paradigm was used to manipulate participants' perceived audiovisual (AV) simultaneity of events while they were recorded with magnetoencephalography (MEG). Desynchronized AV stimuli were presented rhythmically to elicit a robust 1 Hz frequency-tagging of auditory and visual cortical responses. As participants' perception of AV simultaneity shifted, systematic changes in the phase of entrained neural oscillations were observed. This suggests that neural entrainment is not a passive response and that the entrained neural oscillation shifts in time. Crucially, our results indicate that shifts in neural timing in auditory cortices linearly map participants' perceived AV simultaneity. To our knowledge, these results provide the first mechanistic evidence for active neural compensation in the encoding of sensory event timing in support of the emergence of time awareness.

Abstract

Objective Recently, de novo SCN8A missense mutations have been identified as a rare dominant cause of epileptic encephalopathies. Functional studies on the first described case demonstrated gain-of-function effects of the mutation. We describe a novel de novo mutation of SCN8A in a patient with epileptic encephalopathy, and functional characterization of the mutant protein. Design Whole exome sequencing was used to discover the variant. We generated a mutant cDNA, transfected HEK293 cells, and performed Western blotting to assess protein stability. To study channel functional properties, patch-clamp experiments were carried out in transfected neuronal ND7/23 cells. Results The proband exhibited seizure onset at 6 months of age, diffuse brain atrophy, and more profound developmental impairment than the original case. The mutation p.Arg233Gly in the voltage sensing transmembrane segment D1S4 was present in the proband and absent in both parents. This mutation results in a temperature-sensitive reduction in protein expression as well as reduced sodium current amplitude and density and a relative increased response to a slow ramp stimulus, though this did not result in an absolute increased current at physiological temperatures. Conclusion The new de novo SCN8A mutation is clearly deleterious, resulting in an unstable protein with reduced channel activity. This differs from the gain-of-function attributes of the first SCN8A mutation in epileptic encephalopathy, pointing to heterogeneity of mechanisms. Since Nav1.6 is expressed in both excitatory and inhibitory neurons, a differential effect of a loss-of-function of Nav1.6 Arg223Gly on inhibitory interneurons may underlie the epilepsy phenotype in this patient.