Publications

Displaying 601 - 667 of 667
  • Tzekov, R., Quezada, A., Gautier, M., Biggins, D., Frances, C., Mouzon, B., Jamison, J., Mullan, M., & Crawford, F. (2014). Repetitive mild traumatic brain injury causes optic nerve and retinal damage in a mouse model. Journal of Neuropathology and Experimental Neurology, 73(4), 345-361. doi:10.1097/NEN.0000000000000059.

    Abstract

    There is increasing evidence that long-lasting morphologic and
    functional consequences can be present in the human visual system
    after repetitive mild traumatic brain injury (r-mTBI). The exact lo-
    cation and extent of the damage in this condition are not well un-
    derstood. Using a recently developed mouse model of r-mTBI, we
    assessed the effects on the retina and optic nerve using histology and
    immunohistochemistry, electroretinography (ERG), and spectral-
    domain optical coherence tomography (SD-OCT) at 10 and 13 weeks
    after injury. Control mice received repetitive anesthesia alone (r-sham).
    We observed decreased optic nerve diameters and increased cellularity
    and areas of demyelination in optic nerves in r-mTBI versus r-sham
    mice. There were concomitant areas of decreased cellularity in the
    retinal ganglion cell layer and approximately 67% decrease in brain-
    specific homeobox/POU domain protein 3AYpositive retinal ganglion
    cells in retinal flat mounts. Furthermore, SD-OCT demonstrated a de-
    tectable thinning of the inner retina; ERG demonstrated a decrease in
    the amplitude of the photopic negative response without any change in
    a- or b-wave amplitude or timing. Thus, the ERG and SD-OCT data
    correlated well with changes detected by morphometric, histologic,
    and immunohistochemical methods, thereby supporting the use of
    these noninvasive methods in the assessment of visual function and
    morphology in clinical cases of mTBI.
  • Ünal, E., Mamus, E., & Özyürek, A. (2023). Multimodal encoding of motion events in speech, gesture, and cognition. Language and Cognition. Advance online publication. doi:10.1017/langcog.2023.61.

    Abstract

    How people communicate about motion events and how this is shaped by language typology are mostly studied with a focus on linguistic encoding in speech. Yet, human communication typically involves an interactional exchange of multimodal signals, such as hand gestures that have different affordances for representing event components. Here, we review recent empirical evidence on multimodal encoding of motion in speech and gesture to gain a deeper understanding of whether and how language typology shapes linguistic expressions in different modalities, and how this changes across different sensory modalities of input and interacts with other aspects of cognition. Empirical evidence strongly suggests that Talmy’s typology of event integration predicts multimodal event descriptions in speech and gesture and visual attention to event components prior to producing these descriptions. Furthermore, variability within the event itself, such as type and modality of stimuli, may override the influence of language typology, especially for expression of manner.
  • van der Burght, C. L., Numssen, O., Schlaak, B., Goucha, T., & Hartwigsen, G. (2023). Differential contributions of inferior frontal gyrus subregions to sentence processing guided by intonation. Human Brain Mapping, 44(2), 585-598. doi:10.1002/hbm.26086.

    Abstract

    Auditory sentence comprehension involves processing content (semantics), grammar (syntax), and intonation (prosody). The left inferior frontal gyrus (IFG) is involved in sentence comprehension guided by these different cues, with neuroimaging studies preferentially locating syntactic and semantic processing in separate IFG subregions. However, this regional specialisation and its functional relevance has yet to be confirmed. This study probed the role of the posterior IFG (pIFG) for syntactic processing and the anterior IFG (aIFG) for semantic processing with repetitive transcranial magnetic stimulation (rTMS) in a task that required the interpretation of the sentence’s prosodic realisation. Healthy participants performed a sentence completion task with syntactic and semantic decisions, while receiving 10 Hz rTMS over either left aIFG, pIFG, or vertex (control). Initial behavioural analyses showed an inhibitory effect on accuracy without task-specificity. However, electrical field simulations revealed differential effects for both subregions. In the aIFG, stronger stimulation led to slower semantic processing, with no effect of pIFG stimulation. In contrast, we found a facilitatory effect on syntactic processing in both aIFG and pIFG, where higher stimulation strength was related to faster responses. Our results provide first evidence for the functional relevance of left aIFG in semantic processing guided by intonation. The stimulation effect on syntactic responses emphasises the importance of the IFG for syntax processing, without supporting the hypothesis of a pIFG-specific involvement. Together, the results support the notion of functionally specialised IFG subregions for diverse but fundamental cues for language processing.

    Additional information

    supplementary information
  • Van Hoey, T., Thompson, A. L., Do, Y., & Dingemanse, M. (2023). Iconicity in ideophones: Guessing, memorizing, and reassessing. Cognitive Science, 47(4): e13268. doi:10.1111/cogs.13268.

    Abstract

    Iconicity, or the resemblance between form and meaning, is often ascribed to a special status and contrasted with default assumptions of arbitrariness in spoken language. But does iconicity in spoken language have a special status when it comes to learnability? A simple way to gauge learnability is to see how well something is retrieved from memory. We can further contrast this with guessability, to see (1) whether the ease of guessing the meanings of ideophones outperforms the rate at which they are remembered; and (2) how willing participants’ are to reassess what they were taught in a prior task—a novel contribution of this study. We replicate prior guessing and memory tasks using ideophones and adjectives from Japanese, Korean, and Igbo. Our results show that although native Cantonese speakers guessed ideophone meanings above chance level, they memorized both ideophones and adjectives with comparable accuracy. However, response time data show that participants took significantly longer to respond correctly to adjective–meaning pairs—indicating a discrepancy in a cognitive effort that favored the recognition of ideophones. In a follow-up reassessment task, participants who were taught foil translations were more likely to choose the true translations for ideophones rather than adjectives. By comparing the findings from our guessing and memory tasks, we conclude that iconicity is more accessible if a task requires participants to actively seek out sound-meaning associations.
  • Van Wonderen, E., & Nieuwland, M. S. (2023). Lexical prediction does not rationally adapt to prediction error: ERP evidence from pre-nominal articles. Journal of Memory and Language, 132: 104435. doi:10.1016/j.jml.2023.104435.

    Abstract

    People sometimes predict upcoming words during language comprehension, but debate remains on when and to what extent such predictions indeed occur. The rational adaptation hypothesis holds that predictions develop with expected utility: people predict more strongly when predictions are frequently confirmed (low prediction error) rather than disconfirmed. However, supporting evidence is mixed thus far and has only involved measuring responses to supposedly predicted nouns, not to preceding articles that may also be predicted. The current, large-sample (N = 200) ERP study on written discourse comprehension in Dutch therefore employs the well-known ‘pre-nominal prediction effect’: enhanced N400-like ERPs for articles that are unexpected given a likely upcoming noun’s gender (i.e., the neuter gender article ‘het’ when people expect the common gender noun phrase ‘de krant’, the newspaper) compared to expected articles. We investigated whether the pre-nominal prediction effect is larger when most of the presented stories contain predictable article-noun combinations (75% predictable, 25% unpredictable) compared to when most stories contain unpredictable combinations (25% predictable, 75% unpredictable). Our results show the pre-nominal prediction effect in both contexts, with little evidence to suggest that this effect depended on the percentage of predictable combinations. Moreover, the little evidence suggesting such a dependence was primarily observed for unexpected, neuter-gender articles (‘het’), which is inconsistent with the rational adaptation hypothesis. In line with recent demonstrations (Nieuwland, 2021a,b), our results suggest that linguistic prediction is less ‘rational’ or Bayes optimal than is often suggested.
  • Van Turennout, M., Hagoort, P., & Brown, C. M. (1998). Brain activitity during speaking: From syntax to phonology in 40 milliseconds. Science, 280, 572-574.

    Abstract

    In normal conversation, speakers translate thoughts into words at high speed. To enable this speed, the retrieval of distinct types of linguistic knowledge has to be orchestrated with millisecond precision. The nature of this orchestration is still largely unknown. This report presents dynamic measures of the real-time activation of two basic types of linguistic knowledge, syntax and phonology. Electrophysiological data demonstrate that during noun-phrase production speakers retrieve the syntactic gender of a noun before its abstract phonological properties. This two-step process operates at high speed: the data show that phonological information is already available 40 milliseconds after syntactic properties have been retrieved.
  • Van Turennout, M., Hagoort, P., & Brown, C. M. (1998). Brain activity during speaking: From syntax to phonology in 40 milliseconds. Science, 280(5363), 572-574. doi:10.1126/science.280.5363.572.
  • Van Wijk, C., & Kempen, G. (1987). A dual system for producing self-repairs in spontaneous speech: Evidence from experimentally elicited corrections. Cognitive Psychology, 19, 403-440. doi:10.1016/0010-0285(87)90014-4.

    Abstract

    This paper presents a cognitive theory on the production and shaping of selfrepairs during speaking. In an extensive experimental study, a new technique is tried out: artificial elicitation of self-repairs. The data clearly indicate that two mechanisms for computing the shape of self-repairs should be distinguished. One is based on the repair strategy called reformulation, the second one on lemma substitution. W. Levelt’s (1983, Cognition, 14, 41- 104) well-formedness rule, which connects self-repairs to coordinate structures, is shown to apply only to reformulations. In case of lemma substitution, a totally different set of rules is at work. The linguistic unit of central importance in reformulations is the major syntactic constituent; in lemma substitutions it is a prosodic unit. the phonological phrase. A parametrization of the model yielded a very satisfactory fit between observed and reconstructed scores.
  • Van Leeuwen, E. J. C., Cronin, K. A., & Haun, D. B. M. (2014). A group-specific arbitrary tradition in chimpanzees (Pan troglodytes). Animal Cognition, 17, 1421-1425. doi:10.1007/s10071-014-0766-8.

    Abstract

    Social learning in chimpanzees has been studied extensively and it is now widely accepted that chimpanzees have the capacity to learn from conspecifics through a multitude of mechanisms. Very few studies, however, have documented the existence of spontaneously emerged 'traditions' in chimpanzee communities. While the rigor of experimental studies is helpful to investigate social learning mechanisms, documentation of naturally occurring traditions is necessary to understand the relevance of social learning in the real lives of animals. In this study, we report on chimpanzees spontaneously copying a seemingly non-adaptive behaviour ("grass-in- ear behaviour"). The behaviour entailed chimpanzees selecting a stiff, straw-like blade of grass, inserting the grass into one of their own ears, adjusting the position, and then leaving it in their ear during subsequent activities. Using a daily focal follow procedure, over the course of one year, we observed 8 (out of 12) group members engaging in this peculiar behaviour. Importantly, in the 3 neighbouring groups of chimpanzees (n=82), this behaviour was only observed once, indicating that ecological factors were not determiners of the prevalence of this behaviour. These observations show that chimpanzees have a tendency to copy each other's behaviour, even when the adaptive value of the behaviour is presumably absent.
  • Van Leeuwen, E. J. C., & Haun, D. B. M. (2014). Conformity without majority? The case for demarcating social from majority influences. Animal Behaviour, 96, 187-194. doi:10.1016/j.anbehav.2014.08.004.

    Abstract

    In this review, we explore the extent to which the recent evidence for conformity in nonhuman animals may alternatively be explained by the animals' preference for social information regardless of the number of individuals demonstrating the respective behaviour. Conformity as a research topic originated in human psychology and has been described as the phenomenon in which individuals change their behaviour to match the behaviour displayed by the majority of group members. Recent studies have aimed to investigate the same process in nonhuman animals; however, most of the adopted designs have not been able to control for social influences independent of any majority influence and some studies have not even incorporated a majority in their designs. This begs the question to what extent the ‘conformity interpretation’ is preliminary and should be revisited in light of animals' general susceptibility to social influences. Similarly, demarcating social from majority influences sheds new light on the original findings in human psychology and motivates reinterpretation of the reported behavioural patterns in terms of social instead of majority influences. Conformity can have profound ramifications for individual fitness and group dynamics; identifying the exact source responsible for animals' behavioural adjustments is essential for understanding animals' learning biases and interpreting cross-species data in terms of evolutionary processes.
  • Van der Zande, P., Jesse, A., & Cutler, A. (2014). Cross-speaker generalisation in two phoneme-level perceptual adaptation processes. Journal of Phonetics, 43, 38-46. doi:10.1016/j.wocn.2014.01.003.

    Abstract

    Speech perception is shaped by listeners' prior experience with speakers. Listeners retune their phonetic category boundaries after encountering ambiguous sounds in order to deal with variations between speakers. Repeated exposure to an unambiguous sound, on the other hand, leads to a decrease in sensitivity to the features of that particular sound. This study investigated whether these changes in the listeners' perceptual systems can generalise to the perception of speech from a novel speaker. Specifically, the experiments looked at whether visual information about the identity of the speaker could prevent generalisation from occurring. In Experiment 1, listeners retuned auditory category boundaries using audiovisual speech input. This shift in the category boundaries affected perception of speech from both the exposure speaker and a novel speaker. In Experiment 2, listeners were repeatedly exposed to unambiguous speech either auditorily or audiovisually, leading to a decrease in sensitivity to the features of the exposure sound. Here, too, the changes affected the perception of both the exposure speaker and the novel speaker. Together, these results indicate that changes in the perceptual system can affect the perception of speech from a novel speaker and that visual speaker identity information did not prevent this generalisation.
  • Van den Heuvel, H., Sanders, E., Klatter-Folmer, J., Van Hout, R., Fikkert, P., Baker, A., De Jong, J., Wijnen, F., & Trilsbeek, P. (2014). Data curation for a VALID archive of Dutch language impairment data. Dutch journal of applied linguistics, 3(2), 127-135. doi:10.1075/dujal.3.2.02heu.

    Abstract

    The VALID Data Archive is an open multimedia data archive in which data from children and adults with language and/or communication problems are brought together. A pilot project, funded by CLARIN-NL, was carried out in which five existing data sets were curated. This pilot enabled us to build up experience in conserving different kinds of pathological language data in a searchable and persistent manner. These data sets reflect current research in language pathology rather well, both in the range of designs and the variety in pathological problems, such as Specific Language Impairment, deafness, dyslexia, and ADHD. In this paper, we present the VALID initiative, explain the curation process and discuss the materials of the data sets.

    Files private

    Request files
  • Van Wijk, C., & Kempen, G. (1982). De ontwikkeling van syntactische formuleervaardigheid bij kinderen van 9 tot 16 jaar. Nederlands Tijdschrift voor de Psychologie en haar Grensgebieden, 37(8), 491-509.

    Abstract

    An essential phenomenon in the development towards syntactic maturity after early childhood is the increasing use of so-called sentence-combining transformations. Especially by using subordination, complex sentences are produced. The research reported here is an attempt to arrive at a more adequate characterization and explanation. Our starting point was an analysis of 280 texts written by Dutch-speaking pupils of the two highest grades of the primary school and the four lowest grades of three different types of secondary education. It was examined whether systematic shifts in the use of certain groups of so-called function words could be traced. We concluded that the development of the syntactic formulating ability can be characterized as an increase in connectivity: the use of all kinds of function words which explicitly mark logico-semantic relations between propositions. This development starts by inserting special adverbs and coordinating conjunctions resulting in various types of coordination. In a later stage, the syntactic patterning of the sentence is affected as well (various types of subordination). The increase in sentence complexity is only one aspect of the entire development. An explanation for the increase in connectivity is offered based upon a distinction between narrative and expository language use. The latter, but not the former, is characterized by frequent occurrence of connectives. The development in syntactic formulating ability includes a high level of skill in expository language use. Speed of development is determined by intensity of training, e.g. in scholastic and occupational settings.
  • Van Leeuwen, E. J. C., Chitalu Mulenga, I., & Lisensky Chidester, D. (2014). Early social deprivation negatively affects social skill acquisition in chimpanzees (Pan troglodytes). Animal Cognition, 17(2), 407-414. doi:10.1007/s10071-013-0672-5.

    Abstract

    In a highly social species like chimpanzees, the process by which individuals become attuned to their social environment may be of vital importance to their chances of survival. Typically, this socializing process, defined by all acquisition experiences and fine-tuning efforts of social interaction patterns during ontogeny, occurs in large part through parental investment. In this study, we investigated whether maternal presence would enhance the socializing process in chimpanzees by comparing the social interactions of orphaned and mother-reared individuals at the Chimfunshi Wildlife Orphanage Trust in Zambia. As response variables, we selected social interactions during which an elaborate level of fine-tuning is assumed to be necessary for sustaining the interaction and preventing escalation: social play. Comparing orphaned (n=8) to sex- and age-matched mother-reared juvenile chimpanzees (n=9), we hypothesized that the orphaned juveniles would play less frequently than the mother-reared and would be less equipped for fine-tuning social play (which we assayed by rates of aggression) because of the lack of a safe and facilitating social environment provided by the mother. First, contrary to our hypothesis, results showed that the orphaned juveniles engaged in social play more frequently than the mother-reared juveniles, although for significantly shorter amounts of time. Second, in support of our hypothesis, results showed that social play of the orphaned juveniles more often resulted in aggression than social play of the mother-reared juveniles. In conjunction, these results may indicate that, just like in humans, chimpanzee mothers provide their offspring with adequate social skills that might be of pivotal importance for future challenges like successful group-living and securing competitive fitness advantages.
  • Van de Geer, J. P., & Levelt, W. J. M. (1963). Detection of visual patterns disturbed by noise: An exploratory study. Quarterly Journal of Experimental Psychology, 15, 192-204. doi:10.1080/17470216308416324.

    Abstract

    An introductory study of the perception of stochastically specified events is reported. The initial problem was to determine whether the perceiver can split visual input data of this kind into random and determined components. The inability of subjects to do so with the stimulus material used (a filmlike sequence of dot patterns), led to the more general question of how subjects code this kind of visual material. To meet the difficulty of defining the subjects' responses, two experiments were designed. In both, patterns were presented as a rapid sequence of dots on a screen. The patterns were more or less disturbed by “noise,” i.e. the dots did not appear exactly at their proper places. In the first experiment the response was a rating on a semantic scale, in the second an identification from among a set of alternative patterns. The results of these experiments give some insight in the coding systems adopted by the subjects. First, noise appears to be detrimental to pattern recognition, especially to patterns with little spread. Second, this shows connections with the factors obtained from analysis of the semantic ratings, e.g. easily disturbed patterns show a large drop in the semantic regularity factor, when only a little noise is added.
  • Van der Goot, M. H., Tomasello, M., & Liszkowski, U. (2014). Differences in the nonverbal requests of Great Apes and human infants. Child Development, 85(2), 444-455. doi:10.1111/cdev.12141.

    Abstract

    This study investigated how great apes and human infants use imperative pointing to request objects. In a series of three experiments (infants, N = 44; apes, N = 12), subjects were given the opportunity to either point to a desired object from a distance or else to approach closer and request it proximally. The apes always approached close to the object, signaling their request through instrumental actions. In contrast, the infants quite often stayed at a distance, directing the experimenters' attention to the desired object through index-finger pointing, even when the object was in the open and they could obtain it by themselves. Findings distinguish 12-month-olds' imperative pointing from ontogenetic and phylogenetic earlier forms of ritualized reaching.
  • Van Schouwenburg, M. R., Onnink, A. M. H., Ter Huurne, N., Kan, C. C., Zwiers, M. P., Hoogman, M., Franke, B., Buitelaar, J. K., & Cools, R. (2014). Cognitive flexibility depends on white matter microstructure of the basal ganglia. Neuropsychologia, 53, 171-177. doi:10.1016/j.neuropsychologia.2013.11.015.

    Abstract

    Ample evidence shows that the basal ganglia play an important role in cognitive flexibility. However, traditionally, cognitive processes have most commonly been associated with the prefrontal cortex. Indeed, current theoretical models of basal ganglia function suggest the basal ganglia interact with the prefrontal cortex and thalamus, via anatomical fronto-striato-thalamic circuits, to implement cognitive flexibility. Here we aimed to assess this hypothesis in humans by associating individual differences in cognitive flexibility with white matter microstructure of the basal ganglia. To this end we employed an attention switching paradigm in adults with ADHD and controls, leading to a broad range in task performance. Attention switching performance could be predicted based on individual differences in white matter microstructure in/around the basal ganglia. Crucially, local white matter showing this association projected to regions in the prefrontal cortex and thalamus. Our findings highlight the crucial role of the basal ganglia and the fronto-striato-thalamic circuit for cognitive flexibility.
  • Van Berkum, J. J. A., Hijne, H., De Jong, T., Van Joolingen, W. R., & Njoo, M. (1991). Aspects of computer simulations in education. Education & Computing, 6(3/4), 231-239.

    Abstract

    Computer simulations in an instructional context can be characterized according to four aspects (themes): simulation models, learning goals, learning processes and learner activity. The present paper provides an outline of these four themes. The main classification criterion for simulation models is quantitative vs. qualitative models. For quantitative models a further subdivision can be made by classifying the independent and dependent variables as continuous or discrete. A second criterion is whether one of the independent variables is time, thus distinguishing dynamic and static models. Qualitative models on the other hand use propositions about non-quantitative properties of a system or they describe quantitative aspects in a qualitative way. Related to the underlying model is the interaction with it. When this interaction has a normative counterpart in the real world we call it a procedure. The second theme of learning with computer simulation concerns learning goals. A learning goal is principally classified along three dimensions, which specify different aspects of the knowledge involved. The first dimension, knowledge category, indicates that a learning goal can address principles, concepts and/or facts (conceptual knowledge) or procedures (performance sequences). The second dimension, knowledge representation, captures the fact that knowledge can be represented in a more declarative (articulate, explicit), or in a more compiled (implicit) format, each one having its own advantages and drawbacks. The third dimension, knowledge scope, involves the learning goal's relation with the simulation domain; knowledge can be specific to a particular domain, or generalizable over classes of domains (generic). A more or less separate type of learning goal refers to knowledge acquisition skills that are pertinent to learning in an exploratory environment. Learning processes constitute the third theme. Learning processes are defined as cognitive actions of the learner. Learning processes can be classified using a multilevel scheme. The first (highest) of these levels gives four main categories: orientation, hypothesis generation, testing and evaluation. Examples of more specific processes are model exploration and output interpretation. The fourth theme of learning with computer simulations is learner activity. Learner activity is defined as the ‘physical’ interaction of the learner with the simulations (as opposed to the mental interaction that was described in the learning processes). Five main categories of learner activity are distinguished: defining experimental settings (variables, parameters etc.), interaction process choices (deciding a next step), collecting data, choice of data presentation and metacontrol over the simulation.
  • Van Goch, M., McQueen, J. M., & Verhoeven, L. (2014). Learning phonologically specific new words fosters rhyme awareness in Dutch preliterate children. Scientific Studies of Reading, 18(3), 155-172. doi:10.1080/10888438.2013.827199.

    Abstract

    How do children use phonological knowledge about spoken language in acquiring literacy? Phonological precursors of literacy include phonological awareness, speech decoding skill, and lexical specificity (i.e., the richness of phonological representations in the mental lexicon). An intervention study investigated whether early literacy skills can be enhanced by training lexical specificity. Forty-two prereading 4-year-olds were randomly assigned to either an experimental group that was taught pairs of new words that differed minimally or a control group that received numeracy training. The experimental group gained on a rhyme awareness task, suggesting that learning phonologically specific new words fosters phonological awareness.
  • Van Leeuwen, E. J. C., Call, J., & Haun, D. (2014). Human children rely more on social information than chimpanzees do. Biology Letters, 10(11): 20140487. doi:10.1098/rsbl.2014.0487.

    Abstract

    Human societies are characterized by more cultural diversity than chimpanzee communities. However, it is currently unclear what mechanism might be driving this difference. Because reliance on social information is a pivotal characteristic of culture, we investigated individual and social information reliance in children and chimpanzees. We repeatedly presented subjects with a reward-retrieval task on which they had collected conflicting individual and social information of equal accuracy in counterbalanced order. While both species relied mostly on their individual information, children but not chimpanzees searched for the reward at the socially demonstrated location more than at a random location. Moreover, only children used social information adaptively when individual knowledge on the location of the reward had not yet been obtained. Social information usage determines information transmission and in conjunction with mechanisms that create cultural variants, such as innovation, it facilitates diversity. Our results may help explain why humans are more culturally diversified than chimpanzees

    Files private

    Request files
  • Van Gijn, R., Hammond, J., Matić, D., Van Putten, S., & Galucio, A. V. (Eds.). (2014). Information structure and reference tracking in complex sentences. Amsterdam: Benjamins.

    Abstract

    This volume is dedicated to exploring the crossroads where complex sentences and information management – more specifically information structure and reference tracking – come together. Complex sentences are a highly relevant but understudied domain for studying notions of IS and RT. On the one hand, a complex sentence can be studied as a mini-unit of discourse consisting of two or more elements describing events, situations, or processes, with its own internal information-structural and referential organization. On the other hand, complex sentences can be studied as parts of larger discourse structures, such as narratives or conversations, in terms of how their information-structural characteristics relate to this wider context. The book offers new perspectives for the study of the interaction between complex sentences and information management, and moreover adds typological breadth by focusing on lesser studied languages from several parts of the world.
  • Van Berkum, J. J. A., & De Jong, T. (1991). Instructional environments for simulations. Education & Computing, 6(3/4), 305-358.

    Abstract

    The use of computer simulations in education and training can have substantial advantages over other approaches. In comparison with alternatives such as textbooks, lectures, and tutorial courseware, a simulation-based approach offers the opportunity to learn in a relatively realistic problem-solving context, to practise task performance without stress, to systematically explore both realistic and hypothetical situations, to change the time-scale of events, and to interact with simplified versions of the process or system being simulated. However, learners are often unable to cope with the freedom offered by, and the complexity of, a simulation. As a result many of them resort to an unsystematic, unproductive mode of exploration. There is evidence that simulation-based learning can be improved if the learner is supported while working with the simulation. Constructing such an instructional environment around simulations seems to run counter to the freedom the learner is allowed to in ‘stand alone’ simulations. The present article explores instructional measures that allow for an optimal freedom for the learner. An extensive discussion of learning goals brings two main types of learning goals to the fore: conceptual knowledge and operational knowledge. A third type of learning goal refers to the knowledge acquisition (exploratory learning) process. Cognitive theory has implications for the design of instructional environments around simulations. Most of these implications are quite general, but they can also be related to the three types of learning goals. For conceptual knowledge the sequence and choice of models and problems is important, as is providing the learner with explanations and minimization of error. For operational knowledge cognitive theory recommends learning to take place in a problem solving context, the explicit tracing of the behaviour of the learner, providing immediate feedback and minimization of working memory load. For knowledge acquisition goals, it is recommended that the tutor takes the role of a model and coach, and that learning takes place together with a companion. A second source of inspiration for designing instructional environments can be found in Instructional Design Theories. Reviewing these shows that interacting with a simulation can be a part of a more comprehensive instructional strategy, in which for example also prerequisite knowledge is taught. Moreover, information present in a simulation can also be represented in a more structural or static way and these two forms of presentation provoked to perform specific learning processes and learner activities by tutor controlled variations in the simulation, and by tutor initiated prodding techniques. And finally, instructional design theories showed that complex models and procedures can be taught by starting with central and simple elements of these models and procedures and subsequently presenting more complex models and procedures. Most of the recent simulation-based intelligent tutoring systems involve troubleshooting of complex technical systems. Learners are supposed to acquire knowledge of particular system principles, of troubleshooting procedures, or of both. Commonly encountered instructional features include (a) the sequencing of increasingly complex problems to be solved, (b) the availability of a range of help information on request, (c) the presence of an expert troubleshooting module which can step in to provide criticism on learner performance, hints on the problem nature, or suggestions on how to proceed, (d) the option of having the expert module demonstrate optimal performance afterwards, and (e) the use of different ways of depicting the simulated system. A selection of findings is summarized by placing them under the four themes we think to be characteristic of learning with computer simulations (see de Jong, this volume).
  • Van de Velde, M., Meyer, A. S., & Konopka, A. E. (2014). Message formulation and structural assembly: Describing "easy" and "hard" events with preferred and dispreferred syntactic structures. Journal of Memory and Language, 71(1), 124-144. doi:10.1016/j.jml.2013.11.001.

    Abstract

    When formulating simple sentences to describe pictured events, speakers look at the referents they are describing in the order of mention. Accounts of incrementality in sentence production rely heavily on analyses of this gaze-speech link. To identify systematic sources of variability in message and sentence formulation, two experiments evaluated differences in formulation for sentences describing “easy” and “hard” events (more codable and less codable events) with preferred and dispreferred structures (actives and passives). Experiment 1 employed a subliminal cuing manipulation and a cumulative priming manipulation to increase production of passive sentences. Experiment 2 examined the influence of event codability on formulation without a cuing manipulation. In both experiments, speakers showed an early preference for looking at the agent of the event when constructing active sentences. This preference was attenuated by event codability, suggesting that speakers were less likely to prioritize encoding of a single character at the outset of formulation in “easy” events than in “harder” events. Accessibility of the agent influenced formulation primarily when an event was “harder” to describe. Formulation of passive sentences in Experiment 1 also began with early fixations to the agent but changed with exposure to passive syntax: speakers were more likely to consider the patient as a suitable sentential starting point after cumulative priming. The results show that the message-to-language mapping in production can vary with the ease of encoding an event structure and of generating a suitable linguistic structure.
  • Van der Zande, P., Jesse, A., & Cutler, A. (2014). Hearing words helps seeing words: A cross-modal word repetition effect. Speech Communication, 59, 31-43. doi:10.1016/j.specom.2014.01.001.

    Abstract

    Watching a speaker say words benefits subsequent auditory recognition of the same words. In this study, we tested whether hearing words also facilitates subsequent phonological processing from visual speech, and if so, whether speaker repetition influences the magnitude of this word repetition priming. We used long-term cross-modal repetition priming as a means to investigate the underlying lexical representations involved in listening to and seeing speech. In Experiment 1, listeners identified auditory-only words during exposure and visual-only words at test. Words at test were repeated or new and produced by the exposure speaker or a novel speaker. Results showed a significant effect of cross-modal word repetition priming but this was unaffected by speaker changes. Experiment 2 added an explicit recognition task at test. Listeners’ lipreading performance was again improved by prior exposure to auditory words. Explicit recognition memory was poor, and neither word repetition nor speaker repetition improved it. This suggests that cross-modal repetition priming is neither mediated by explicit memory nor improved by speaker information. Our results suggest that phonological representations in the lexicon are shared across auditory and visual processing, and that speaker information is not transferred across modalities at the lexical level.
  • Van den Stock, J., Tamietto, M., Zhan, M. Y., Heinecke, A., Hervais-Adelman, A., Legrand, L. B., Pegna, A. J., & de Gelder, B. (2014). Neural correlates of body and face perception following bilateral destruction of the primary visual cortices. Frontiers in Behavioral Neuroscience, 8: 30. doi:10.3389/fnbeh.2014.00030.

    Abstract

    Non-conscious visual processing of different object categories was investigated in a rare patient with bilateral destruction of the visual cortex (V1) and clinical blindness over the entire visual field. Images of biological and non-biological object categories were presented consisting of human bodies, faces, butterflies, cars, and scrambles. Behaviorally, only the body shape induced higher perceptual sensitivity, as revealed by signal detection analysis. Passive exposure to bodies and faces activated amygdala and superior temporal sulcus. In addition, bodies also activated the extrastriate body area, insula, orbitofrontal cortex (OFC) and cerebellum. The results show that following bilateral damage to the primary visual cortex and ensuing complete cortical blindness, the human visual system is able to process categorical properties of human body shapes. This residual vision may be based on V1-independent input to body-selective areas along the ventral stream, in concert with areas involved in the representation of bodily states, like insula, OFC, and cerebellum.
  • Van Leeuwen, T. M., Lamers, M. J. A., Petersson, K. M., Gussenhoven, C., Poser, B., & Hagoort, P. (2014). Phonological markers of information structure: An fMRI study. Neuropsychologia, 58(1), 64-74. doi:10.1016/j.neuropsychologia.2014.03.017.

    Abstract

    In this fMRI study we investigate the neural correlates of information structure integration during sentence comprehension in Dutch. We looked into how prosodic cues (pitch accents) that signal the information status of constituents to the listener (new information) are combined with other types of information during the unification process. The difficulty of unifying the prosodic cues into overall sentence meaning was manipulated by constructing sentences in which the pitch accent did (focus-accent agreement), and sentences in which the pitch accent did not (focus-accent disagreement) match the expectations for focus constituents of the sentence. In case of a mismatch, the load on unification processes increases. Our results show two anatomically distinct effects of focus-accent disagreement, one located in the posterior left inferior frontal gyrus (LIFG, BA6/44), and one in the more anterior-ventral LIFG (BA 47/45). Our results confirm that information structure is taken into account during unification, and imply an important role for the LIFG in unification processes, in line with previous fMRI studies.

    Additional information

    mmc1.doc
  • Van de Geer, J. P., Levelt, W. J. M., & Plomp, R. (1962). The connotation of musical consonance. Acta Psychologica, 20, 308-319.

    Abstract

    As a preliminary to further research on musical consonance an explanatory investigation was made on the different modes of judgment of musical intervals. This was done by way of a semantic differential. Subjects rated 23 intervals against 10 scales. In a factor analysis three factors appeared: pitch, evaluation and fusion. The relation between these factors and some physical characteristics has been investigated. The scale consonant-dissonant showed to be purely evaluative (in opposition to Stumpf's theory). This evaluative connotation is not in accordance with the musicological meaning of consonance. Suggestions to account for this difference have been given.
  • Van de Velde, M., & Meyer, A. S. (2014). Syntactic flexibility and planning scope: The effect of verb bias on advance planning during sentence recall. Frontiers in Psychology, 5: 1174. doi:10.3389/fpsyg.2014.01174.

    Abstract

    In sentence production, grammatical advance planning scope depends on contextual factors (e.g., time pressure), linguistic factors (e.g., ease of structural processing), and cognitive factors (e.g., production speed). The present study tests the influence of the availability of multiple syntactic alternatives (i.e., syntactic flexibility) on the scope of advance planning during the recall of Dutch dative phrases. We manipulated syntactic flexibility by using verbs with a strong bias or a weak bias toward one structural alternative in sentence frames accepting both verbs (e.g., strong/weak bias: De ober schotelt/serveert de klant de maaltijd [voor] “The waiter dishes out/serves the customer the meal”). To assess lexical planning scope, we varied the frequency of the first post-verbal noun (N1, Experiment 1) or the second post-verbal noun (N2, Experiment 2). In each experiment, 36 speakers produced the verb phrases in a rapid serial visual presentation (RSVP) paradigm. On each trial, they read a sentence presented one word at a time, performed a short distractor task, and then saw a sentence preamble (e.g., De ober…) which they had to complete to form the presented sentence. Onset latencies were compared using linear mixed effects models. N1 frequency did not produce any effects. N2 frequency only affected sentence onsets in the weak verb bias condition and especially in slow speakers. These findings highlight the dependency of planning scope during sentence recall on the grammatical properties of the verb and the frequency of post-verbal nouns. Implications for utterance planning in everyday speech are discussed.
  • Van Wijk, C., & Kempen, G. (1982). Syntactische formuleervaardigheid en het schrijven van opstellen. Pedagogische Studiën, 59, 126-136.

    Abstract

    Meermalen is getracht om syntactische formuleenuuirdigheid direct en objectief te meten aan de hand van gesproken of geschreven teksten. Uitgangspunt hierbij vormde in de regel de syntactische complexiteit van de geproduceerde taaluitingen. Dit heeft echter niet geleid tot een plausibele, duidelijk omschreven en praktisch bruikbare index. N.a.v. een kritische bespreking van de notie complexiteit wordt in dit artikel als nieuw criterium voorgesteld de connectiviteit van de taaluitingen; de expliciete aanduiding van logiscli-scmantische relaties tussen proposities. Connectiviteit is gemakkelijk scoorbaar aan de hand van functiewoorden die verschillende vormen van nevenschikkend en onderschikkend zinsverband markeren. Deze nieuwe index ondetrangt de kritiek die op complexiteit gegeven kon worden, blijkt duidelijk te discrimineren tussen groepen leerlingen die van elkaar verschillen naar leeftijd en opleidingsniveau, en sluit aan bij recente taalpsychologische en sociolinguïstische theorie. Tot besluit worden enige onderwijskundige implicaties aangegeven.
  • Van der Veer, G. C., Bagnara, S., & Kempen, G. (1991). Preface. Acta Psychologica, 78, ix. doi:10.1016/0001-6918(91)90002-H.
  • Van Rijswijk, R., & Muntendam, A. (2014). The prosody of focus in the Spanish of Quechua-Spanish bilinguals: A case study on noun phrases. International Journal of Bilingualism, 18(6), 614-632. doi:10.1177/1367006912456103.

    Abstract

    This study examines the prosody of focus in the Spanish of 16 Quechua-Spanish bilinguals near Cusco, Peru. Data come from a dialogue game that involved noun phrases consisting of a noun and an adjective. The questions in the game elicited broad focus, contrastive focus on the noun (non-final position) and contrastive focus on the adjective (final position). The phonetic analysis in Praat included peak alignment, peak height, local range and duration of the stressed syllable and word. The study revealed that Cusco Spanish differs from other Spanish varieties. In other Spanish varieties, contrastive focus is marked by early peak alignment, whereas broad focus involves a late peak on the non-final word. Furthermore, in other Spanish varieties contrastive focus is indicated by a higher F0 maximum, a wider local range, post-focal pitch reduction and a longer duration of the stressed syllable/word. For Cusco Spanish no phonological contrast between early and late peak alignment was found. However, peak alignment on the adjective in contrastive focus was significantly earlier than in the two other contexts. For women, similar results were found for the noun in contrastive focus. An additional prominence-lending feature marking contrastive focus concerned duration of the final word. Furthermore, the results revealed a higher F0 maximum for broad focus than for contrastive focus. The findings suggest a prosodic change, which is possibly due to contact with Quechua. The study contributes to research on information structure, prosody and contact-induced language change.
  • Van der Werf, O. J., Schuhmann, T., De Graaf, T., Ten Oever, S., & Sack, A. T. (2023). Investigating the role of task relevance during rhythmic sampling of spatial locations. Scientific Reports, 13: 12707. doi:10.1038/s41598-023-38968-z.

    Abstract

    Recently it has been discovered that visuospatial attention operates rhythmically, rather than being stably employed over time. A low-frequency 7–8 Hz rhythmic mechanism coordinates periodic windows to sample relevant locations and to shift towards other, less relevant locations in a visual scene. Rhythmic sampling theories would predict that when two locations are relevant 8 Hz sampling mechanisms split into two, effectively resulting in a 4 Hz sampling frequency at each location. Therefore, it is expected that rhythmic sampling is influenced by the relative importance of locations for the task at hand. To test this, we employed an orienting task with an arrow cue, where participants were asked to respond to a target presented in one visual field. The cue-to-target interval was systematically varied, allowing us to assess whether performance follows a rhythmic pattern across cue-to-target delays. We manipulated a location’s task relevance by altering the validity of the cue, thereby predicting the correct location in 60%, 80% or 100% of trials. Results revealed significant 4 Hz performance fluctuations at cued right visual field targets with low cue validity (60%), suggesting regular sampling of both locations. With high cue validity (80%), we observed a peak at 8 Hz towards non-cued targets, although not significant. These results were in line with our hypothesis suggesting a goal-directed balancing of attentional sampling (cued location) and shifting (non-cued location) depending on the relevance of locations in a visual scene. However, considering the hemifield specificity of the effect together with the absence of expected effects for cued trials in the high valid conditions we further discuss the interpretation of the data.

    Additional information

    supplementary information
  • van der Burght, C. L., Friederici, A. D., Maran, M., Papitto, G., Pyatigorskaya, E., Schroen, J., Trettenbrein, P., & Zaccarella, E. (2023). Cleaning up the brickyard: How theory and methodology shape experiments in cognitive neuroscience of language. Journal of Cognitive Neuroscience, 35(12), 2067-2088. doi:10.1162/jocn_a_02058.

    Abstract

    The capacity for language is a defining property of our species, yet despite decades of research evidence on its neural basis is still mixed and a generalized consensus is difficult to achieve. We suggest that this is partly caused by researchers defining “language” in different ways, with focus on a wide range of phenomena, properties, and levels of investigation. Accordingly, there is very little agreement amongst cognitive neuroscientists of language on the operationalization of fundamental concepts to be investigated in neuroscientific experiments. Here, we review chains of derivation in the cognitive neuroscience of language, focusing on how the hypothesis under consideration is defined by a combination of theoretical and methodological assumptions. We first attempt to disentangle the complex relationship between linguistics, psychology, and neuroscience in the field. Next, we focus on how conclusions that can be drawn from any experiment are inherently constrained by auxiliary assumptions, both theoretical and methodological, on which the validity of conclusions drawn rests. These issues are discussed in the context of classical experimental manipulations as well as study designs that employ novel approaches such as naturalistic stimuli and computational modelling. We conclude by proposing that a highly interdisciplinary field such as the cognitive neuroscience of language requires researchers to form explicit statements concerning the theoretical definitions, methodological choices, and other constraining factors involved in their work.
  • Veenstra, A., Acheson, D. J., Bock, K., & Meyer, A. S. (2014). Effects of semantic integration on subject–verb agreement: Evidence from Dutch. Language, Cognition and Neuroscience, 29(3), 355-380. doi:10.1080/01690965.2013.862284.

    Abstract

    The generation of subject–verb agreement is a central component of grammatical encoding. It is sensitive to conceptual and grammatical influences, but the interplay between these factors is still not fully understood. We investigate how semantic integration of the subject noun phrase (‘the secretary of/with the governor’) and the Local Noun Number (‘the secretary with the governor/governors’) affect the ease of selecting the verb form. Two hypotheses are assessed: according to the notional hypothesis, integration encourages the assignment of the singular notional number to the noun phrase and facilitates the choice of the singular verb form. According to the lexical interference hypothesis, integration strengthens the competition between nouns within the subject phrase, making it harder to select the verb form when the nouns mismatch in number. In two experiments, adult speakers of Dutch completed spoken preambles (Experiment 1) or selected appropriate verb forms (Experiment 2). Results showed facilitatory effects of semantic integration (fewer errors and faster responses with increasing integration). These effects did not interact with the effects of the Local Noun Number (slower response times and higher error rates for mismatching than for matching noun numbers). The findings thus support the notional hypothesis and a model of agreement where conceptual and lexical factors independently contribute to the determination of the number of the subject noun phrase and, ultimately, the verb.
  • Veenstra, A., Acheson, D. J., & Meyer, A. S. (2014). Keeping it simple: Studying grammatical encoding with lexically-reduced item sets. Frontiers in Psychology, 5: 783. doi:10.3389/fpsyg.2014.00783.

    Abstract

    Compared to the large body of work on lexical access, little research has been done on grammatical encoding in language production. An exception is the generation of subject-verb agreement. Here, two key findings have been reported: (1) Speakers make more agreement errors when the head and local noun of a phrase mismatch in number than when they match (e.g., the key to the cabinet(s)); and (2) this attraction effect is asymmetric, with stronger attraction for singular than for plural head nouns. Although these findings are robust, the cognitive processes leading to agreement errors and their significance for the generation of correct agreement are not fully understood. We propose that future studies of agreement, and grammatical encoding in general, may benefit from using paradigms that tightly control the variability of the lexical content of the material. We report two experiments illustrating this approach. In both of them, the experimental items featured combinations of four nouns, four color adjectives, and two prepositions. In Experiment 1, native speakers of Dutch described pictures in sentences such as the circle next to the stars is blue. In Experiment 2, they carried out a forced-choice task, where they read subject noun phrases (e.g., the circle next to the stars) and selected the correct verb-phrase (is blue or are blue) with a button press. Both experiments showed an attraction effect, with more errors after subject phrases with mismatching, compared to matching head and local nouns. This effect was stronger for singular than plural heads, replicating the attraction asymmetry. In contrast, the response times recorded in Experiment 2 showed similar attraction effects for singular and plural head nouns. These results demonstrate that critical agreement phenomena can be elicited reliably in lexically-reduced contexts. We discuss the theoretical implications of the findings and the potential and limitations of studies using lexically simple materials.
  • Verga, L., D’Este, G., Cassani, S., Leitner, C., Kotz, S. A., Ferini-Strambi, L., & Galbiati, A. (2023). Sleeping with time in mind? A literature review and a proposal for a screening questionnaire on self-awakening. PLoS One, 18(3): e0283221. doi:10.1371/journal.pone.0283221.

    Abstract

    Some people report being able to spontaneously “time” the end of their sleep. This ability to self-awaken challenges the idea of sleep as a passive cognitive state. Yet, current evidence on this phenomenon is limited, partly because of the varied definitions of self-awakening and experimental approaches used to study it. Here, we provide a review of the literature on self-awakening. Our aim is to i) contextualise the phenomenon, ii) propose an operating definition, and iii) summarise the scientific approaches used so far. The literature review identified 17 studies on self-awakening. Most of them adopted an objective sleep evaluation (76%), targeted nocturnal sleep (76%), and used a single criterion to define the success of awakening (82%); for most studies, this corresponded to awakening occurring in a time window of 30 minutes around the expected awakening time. Out of 715 total participants, 125 (17%) reported to be self-awakeners, with an average age of 23.24 years and a slight predominance of males compared to females. These results reveal self-awakening as a relatively rare phenomenon. To facilitate the study of self-awakening, and based on the results of the literature review, we propose a quick paper-and-pencil screening questionnaire for self-awakeners and provide an initial validation for it. Taken together, the combined results of the literature review and the proposed questionnaire help in characterising a theoretical framework for self-awakenings, while providing a useful tool and empirical suggestions for future experimental studies, which should ideally employ objective measurements.
  • Verga, L., Kotz, S. A., & Ravignani, A. (2023). The evolution of social timing. Physics of Life Reviews, 46, 131-151. doi:10.1016/j.plrev.2023.06.006.

    Abstract

    Sociality and timing are tightly interrelated in human interaction as seen in turn-taking or synchronised dance movements. Sociality and timing also show in communicative acts of other species that might be pleasurable, but also necessary for survival. Sociality and timing often co-occur, but their shared phylogenetic trajectory is unknown: How, when, and why did they become so tightly linked? Answering these questions is complicated by several constraints; these include the use of divergent operational definitions across fields and species, the focus on diverse mechanistic explanations (e.g., physiological, neural, or cognitive), and the frequent adoption of anthropocentric theories and methodologies in comparative research. These limitations hinder the development of an integrative framework on the evolutionary trajectory of social timing and make comparative studies not as fruitful as they could be. Here, we outline a theoretical and empirical framework to test contrasting hypotheses on the evolution of social timing with species-appropriate paradigms and consistent definitions. To facilitate future research, we introduce an initial set of representative species and empirical hypotheses. The proposed framework aims at building and contrasting evolutionary trees of social timing toward and beyond the crucial branch represented by our own lineage. Given the integration of cross-species and quantitative approaches, this research line might lead to an integrated empirical-theoretical paradigm and, as a long-term goal, explain why humans are such socially coordinated animals.
  • Vergani, F., Mahmood, S., Morris, C., Mitchell, P., & Forkel, S. J. (2014). Intralobar fibres of the occipital lobe: A post mortem dissection study. Cortex, 56, 145-156. doi:10.1016/j.cortex.2014.03.002.

    Abstract

    Introduction

    The atlas by Heinrich Sachs (1892) provided an accurate description of the intralobar fibres of the occipital lobe, with a detailed representation of the short associative tracts connecting different parts of the lobe. Little attention has been paid to the work of Sachs since its publication. In this study, we present the results of the dissection of three hemispheres, performed according to the Klingler technique (1935). Our anatomical findings are then compared to the original description of the occipital fibres anatomy as detailed by Sachs.
    Methods

    Three hemispheres were dissected according to Klingler's technique (1935). Specimens were fixed in 10% formalin and frozen at −15 °C for two weeks. After defreezing, dissection of the white matter fibres was performed with blunt dissectors. Coronal sections were obtained according to the cuts originally described by Sachs. In addition, medial to lateral and lateral to medial dissection of the white matter of the occipital lobe was also performed.

    Results

    A network of short association fibres was demonstrated in the occipital lobe, comprising intralobar association fibres and U-shaped fibres, which are connecting neighbouring gyri. Lateral to the ventricles, longitudinal fibres of the stratum sagittale were also identified that are arranged as external and internal layers. Fibres of the forceps major were also found to be in direct contact with the ventricular walls. We were able to replicate all tracts originally described by Sachs. In addition, a previously unrecognised tract, connecting the cuneus to the lingual gyrus, was identified. This tract corresponds to the “sledge runner”, described in tractography studies.

    Conclusions

    The occipital lobe shows a rich network of intralobar fibres, arranged around the ventricular wall. Good concordance was observed between the Klingler dissection technique and the histological preparations of Sachs.
  • Verkerk, A. (2014). Diachronic change in Indo-European motion event encoding. Journal of Historical Linguistics, 4, 40-83. doi:10.1075/jhl.4.1.02ver.

    Abstract

    There are many different syntactic constructions that languages can use to encode motion events. In recent decades, great advances have been made in the description and study of these syntactic constructions from languages spoken around the world (Talmy 1985, 1991, Slobin 1996, 2004). However, relatively little attention has been paid to historical change in these systems (exceptions are Vincent 1999, Dufresne, Dupuis & Tremblay 2003, Kopecka 2006 and Peyraube 2006). In this article, diachronic change of motion event encoding systems in Indo-European is investigated using the available historical–comparative data and phylogenetic comparative methods adopted from evolutionary biology. It is argued that Proto-Indo-European was not satellite-framed, as suggested by Talmy (2007) and Acedo Matellán and Mateu (2008), but had a mixed motion event encoding system, as is suggested by the available historical–comparative data
  • Verkerk, A. (2014). The correlation between motion event encoding and path verb lexicon size in the Indo-European language family. Folia Linguistica Historica, 35, 307-358. doi:10.1515/flih.2014.009.

    Abstract

    There have been opposing views on the possibility of a relationship between motion event encoding and the size of the path verb lexicon. Özçalışkan (2004) has proposed that verb-framed and satellite-framed languages should approximately have the same number of path verbs, whereas a review of some of the literature suggests that verb-framed languages typically have a bigger path verb lexicon than satelliteframed languages. In this article I demonstrate that evidence for this correlation can be found through phylogenetic comparative analysis of parallel corpus data from twenty Indo-European languages.
  • Vernes, S. C. (2014). Genome wide identification of fruitless targets suggests a role in upregulating genes important for neural circuit formation. Scientific Reports, 4: 4412. doi:10.1038/srep04412.

    Abstract

    The fruitless gene (fru) encodes a set of transcription factors (Fru) that display sexually dimorphic gene expression in the brain of the fruit-fly;Drosophila melanogaster . Behavioural studies have demonstrated that fru isessentialforcourtshipbehaviour inthemale flyandisthoughttoact bydirectingthe development of sex-specific neural circuitry that encodes this innate behavioural response. This study reports the identification of direct regulatory targets of the sexually dimorphic isoforms of the Fru protein using an in vitro model system. Genome wide binding sites were identified for each of the isoforms using Chromatin Immunoprecipitation coupled to deep sequencing (ChIP-Seq). Putative target genes were found to be involved in processes such as neurotransmission, ion-channel signalling and neuron development. All isoforms showed asignificant bias towards genes located on the X-chromosome,which may reflect a specific role for Fru in regulating x-linked genes. Taken together with expression analysis carried out in Fru positive neurons specifically isolated from the male fly brain, it appears that the Fru protein acts as a transcriptional activator. Understanding the regulatory cascades induced by Fru will help to shed light on the molecular mechanisms that are important for specification of neural circuitry underlying complex behaviour
  • Vessel, E. A., Pasqualette, L., Uran, C., Koldehoff, S., Bignardi, G., & Vinck, M. (2023). Self-relevance predicts the aesthetic appeal of real and synthetic artworks generated via neural style transfer. Psychological Science, 34(9), 1007-1023. doi:10.1177/09567976231188107.

    Abstract

    What determines the aesthetic appeal of artworks? Recent work suggests that aesthetic appeal can, to some extent, be predicted from a visual artwork’s image features. Yet a large fraction of variance in aesthetic ratings remains unexplained and may relate to individual preferences. We hypothesized that an artwork’s aesthetic appeal depends strongly on self-relevance. In a first study (N = 33 adults, online replication N = 208), rated aesthetic appeal for real artworks was positively predicted by rated self-relevance. In a second experiment (N = 45 online), we created synthetic, self-relevant artworks using deep neural networks that transferred the style of existing artworks to photographs. Style transfer was applied to self-relevant photographs selected to reflect participant-specific attributes such as autobiographical memories. Self-relevant, synthetic artworks were rated as more aesthetically appealing than matched control images, at a level similar to human-made artworks. Thus, self-relevance is a key determinant of aesthetic appeal, independent of artistic skill and image features.

    Additional information

    supplementary materials
  • Vingerhoets, G., Verhelst, H., Gerrits, R., Badcock, N., Bishop, D. V. M., Carey, D., Flindall, J., Grimshaw, G., Harris, L. J., Hausmann, M., Hirnstein, M., Jäncke, L., Joliot, M., Specht, K., Westerhausen, R., & LICI consortium (2023). Laterality indices consensus initiative (LICI): A Delphi expert survey report on recommendations to record, assess, and report asymmetry in human behavioural and brain research. Laterality, 28(2-3), 122-191. doi:10.1080/1357650X.2023.2199963.

    Abstract

    Laterality indices (LIs) quantify the left-right asymmetry of brain and behavioural variables and provide a measure that is statistically convenient and seemingly easy to interpret. Substantial variability in how structural and functional asymmetries are recorded, calculated, and reported, however, suggest little agreement on the conditions required for its valid assessment. The present study aimed for consensus on general aspects in this context of laterality research, and more specifically within a particular method or technique (i.e., dichotic listening, visual half-field technique, performance asymmetries, preference bias reports, electrophysiological recording, functional MRI, structural MRI, and functional transcranial Doppler sonography). Experts in laterality research were invited to participate in an online Delphi survey to evaluate consensus and stimulate discussion. In Round 0, 106 experts generated 453 statements on what they considered good practice in their field of expertise. Statements were organised into a 295-statement survey that the experts then were asked, in Round 1, to independently assess for importance and support, which further reduced the survey to 241 statements that were presented again to the experts in Round 2. Based on the Round 2 input, we present a set of critically reviewed key recommendations to record, assess, and report laterality research for various methods.

    Files private

    Request files
  • De Vos, C. (2014). Absolute spatial deixis and proto-toponyms in Kata Kolok. NUSA: Linguistic studies of languages in and around Indonesia, 56, 3-26.

    Abstract

    This paper presents an overview of spatial deictic structures in Kata Kolok, a sign language which is indigenous to a Balinese village community. Sociolinguistic surveys and lexicographic comparisons have indicated that Kata Kolok is unrelated to the signing varieties in other parts of Bali and should be considered a sign language isolate as such. Kata Kolok emerged five generations ago and has been in intimate contact with spoken Balinese from its incipience. The findings from this paper suggest that this cross-modal contact has led to an absolute construction of the signing space, which is radically different in comparison to spatial deixis in other sign languages. Furthermore, Kata Kolok does not seem to have a class of true toponyms, but rather deploys deictic proto-toponyms. The Kata Kolok system on the whole does not exhibit any related linguistic forms or direct calques from spoken Balinese, and this suggests that the conceptual overlap between these two languages may have been facilitated by shared cultural practices as well as gestural communication rather than direct borrowings. Ultimately, this analysis challenges the very notion of a sign language isolate and suggests that Kata Kolok and other emergent signing varieties should be considered in light of the broader semiotic context in which they have evolved.

    Additional information

    http://hdl.handle.net/11372/VC-1001
  • De Vries, B., Eising, E., Broos, L. A. M., Koelewijn, S. C., Todorov, B., Frants, R. R., Boer, J. M., Ferraro, M. D., Thoen, P. A. C., & Van Den Maagdenberg, A. (2014). RNA expression profiling in brains of familial hemiplegic migraine type 1 knock-in mice. Cephalalgia, 34(3), 174-182. doi:10.1177/0333102413502736.

    Abstract

    Background Various CACNA1A missense mutations cause familial hemiplegic migraine type 1 (FHM1), a rare monogenic subtype of migraine with aura. FHM1 mutation R192Q is associated with pure hemiplegic migraine, whereas the S218L mutation causes hemiplegic migraine, cerebellar ataxia, seizures, and mild head trauma-induced brain edema. Transgenic knock-in (KI) migraine mouse models were generated that carried either the FHM1 R192Q or the S218L mutation and were shown to exhibit increased CaV2.1 channel activity. Here we investigated their cerebellar and caudal cortical transcriptome. Methods Caudal cortical and cerebellar RNA expression profiles from mutant and wild-type mice were studied using microarrays. Respective brain regions were selected based on their relevance to migraine aura and ataxia. Relevant expression changes were further investigated at RNA and protein level by quantitative polymerase chain reaction (qPCR) and/or immunohistochemistry, respectively. Results Expression differences in the cerebellum were most pronounced in S218L mice. Particularly, tyrosine hydroxylase, a marker of delayed cerebellar maturation, appeared strongly upregulated in S218L cerebella. In contrast, only minimal expression differences were observed in the caudal cortex of either mutant mice strain. Conclusion Despite pronounced consequences of migraine gene mutations at the neurobiological level, changes in cortical RNA expression in FHM1 migraine mice compared to wild-type are modest. In contrast, pronounced RNA expression changes are seen in the cerebellum of S218L mice and may explain their cerebellar ataxia phenotype
  • Wang, M., Shao, Z., Verdonschot, R. G., Chen, Y., & Schiller, N. O. (2023). Orthography influences spoken word production in blocked cyclic naming. Psychonomic Bulletin & Review, 30, 383-392. doi:10.3758/s13423-022-02123-y.

    Abstract

    Does the way a word is written influence its spoken production? Previous studies suggest that orthography is involved only when the orthographic representation is highly relevant during speaking (e.g., in reading-aloud tasks). To address this issue, we carried out two experiments using the blocked cyclic picture-naming paradigm. In both experiments, participants were asked to name pictures repeatedly in orthographically homogeneous or heterogeneous blocks. In the naming task, the written form was not shown; however, the radical of the first character overlapped between the four pictures in this block type. A facilitative orthographic effect was found when picture names shared part of their written forms, compared with the heterogeneous condition. This facilitative effect was independent of the position of orthographic overlap (i.e., the left, the lower, or the outer part of the character). These findings strongly suggest that orthography can influence speaking even when it is not highly relevant (i.e., during picture naming) and the orthographic effect is less likely to be attributed to strategic preparation.
  • Ward, M. E., McMahon, G., St Pourcain, B., Evans, D. M., Rietveld, C. A., Benjamin, D. J., Koellinger, P. D., Cesarini, D., Smith, G. D., Timpson, N. J., & Consortium}, {. S. G. A. (2014). Genetic variation associated with differential educational attainment in adults has anticipated associations with school performance in children. PLoS ONE, 9(7): e100248. doi:10.1371/journal.pone.0100248.

    Abstract

    Genome-wide association study results have yielded evidence for the association of common genetic variants with crude measures of completed educational attainment in adults. Whilst informative, these results do not inform as to the mechanism of these effects or their presence at earlier ages and where educational performance is more routinely and more precisely assessed. Single nucleotide polymorphisms exhibiting genome-wide significant associations with adult educational attainment were combined to derive an unweighted allele score in 5,979 and 6,145 young participants from the Avon Longitudinal Study of Parents and Children with key stage 3 national curriculum test results (SATS results) available at age 13 to 14 years in English and mathematics respectively. Standardised (z-scored) results for English and mathematics showed an expected relationship with sex, with girls exhibiting an advantage over boys in English (0.433 SD (95%CI 0.395, 0.470), p<10-10) with more similar results (though in the opposite direction) in mathematics (0.042 SD (95%CI 0.004, 0.080), p = 0.030). Each additional adult educational attainment increasing allele was associated with 0.041 SD (95%CI 0.020, 0.063), p = 1.79×10-04 and 0.028 SD (95%CI 0.007, 0.050), p = 0.01 increases in standardised SATS score for English and mathematics respectively. Educational attainment is a complex multifactorial behavioural trait which has not had heritable contributions to it fully characterised. We were able to apply the results from a large study of adult educational attainment to a study of child exam performance marking events in the process of learning rather than realised adult end product. Our results support evidence for common, small genetic contributions to educational attainment, but also emphasise the likely lifecourse nature of this genetic effect. Results here also, by an alternative route, suggest that existing methods for child examination are able to recognise early life variation likely to be related to ultimate educational attainment.
  • Warner, N., McQueen, J. M., & Cutler, A. (2014). Tracking perception of the sounds of English. The Journal of the Acoustical Society of America, 135, 2295-3006. doi:10.1121/1.4870486.

    Abstract

    Twenty American English listeners identified gated fragments of all 2288 possible English within-word and cross-word diphones, providing a total of 538 560 phoneme categorizations. The results show orderly uptake of acoustic information in the signal and provide a view of where information about segments occurs in time. Information locus depends on each speech sound’s identity and phonological features. Affricates and diphthongs have highly localized information so that listeners’ perceptual accuracy rises during a confined time range. Stops and sonorants have more distributed and gradually appearing information. The identity and phonological features (e.g., vowel vs consonant) of the neighboring segment also influences when acoustic information about a segment is available. Stressed vowels are perceived significantly more accurately than unstressed vowels, but this effect is greater for lax vowels than for tense vowels or diphthongs. The dataset charts the availability of perceptual cues to segment identity across time for the full phoneme repertoire of English in all attested phonetic contexts.
  • Weber, A., Di Betta, A. M., & McQueen, J. M. (2014). Treack or trit: Adaptation to genuine and arbitrary foreign accents by monolingual and bilingual listeners. Journal of phonetics, 46, 34-51. doi:10.1016/j.wocn.2014.05.002.

    Abstract

    Two cross-modal priming experiments examined two questions about word recognition in foreign-accented speech: Does accent adaptation occur only for genuine accents markers, and does adaptation depend on language experience? We compared recognition of words spoken with canonical, genuinely-accented and arbitrarily-accented vowels. In Experiment 1, an Italian speaker pronounced vowels in English prime words canonically, or by lengthening /ɪ/ as in a genuine Italian accent (*/tri:k/ for trick), or by arbitrarily shortening /i:/ (*/trɪt/ for treat). Lexical-decision times to subsequent visual target words showed different priming effects in three listener groups. Monolingual native English listeners recognized variants with lengthened but not shortened vowels. Bilingual nonnative Italian-English listeners, who could not reliably distinguish vowel length, recognized both variants. Bilingual nonnative Dutch-English listeners also recognized both variants. In Experiment 2, bilingual Dutch-English listeners recognized Dutch words with genuinely- and arbitrarily-accented vowels (spoken by a native Italian with lengthened and shortened vowels respectively), but recognized words with canonical vowels more easily than words with accented vowels. These results suggest that adaptation to genuine accent markers arises for monolingual and bilingual listeners alike and can occur in native and nonnative languages, but that bilinguals can adapt to arbitrary accent markers better than monolinguals.
  • Wegman, J., Fonteijn, H. M., van Ekert, J., Tyborowska, A., Jansen, C., & Janzen, G. (2014). Gray and white matter correlates of navigational ability in humans. Human Brain Mapping, 35(6), 2561-2572. doi:10.1002/hbm.22349.

    Abstract

    Humans differ widely in their navigational abilities. Studies have shown that self-reports on navigational abilities are good predictors of performance on navigation tasks in real and virtual environments. The caudate nucleus and medial temporal lobe regions have been suggested to subserve different navigational strategies. The ability to use different strategies might underlie navigational ability differences. This study examines the anatomical correlates of self-reported navigational ability in both gray and white matter. Local gray matter volume was compared between a group (N = 134) of good and bad navigators using voxel-based morphometry (VBM), as well as regional volumes. To compare between good and bad navigators, we also measured white matter anatomy using diffusion tensor imaging (DTI) and looked at fractional anisotropy (FA) values. We observed a trend toward higher local GM volume in right anterior parahippocampal/rhinal cortex for good versus bad navigators. Good male navigators showed significantly higher local GM volume in right hippocampus than bad male navigators. Conversely, bad navigators showed increased FA values in the internal capsule, the white matter bundle closest to the caudate nucleus and a trend toward higher local GM volume in the caudate nucleus. Furthermore, caudate nucleus regional volume correlated negatively with navigational ability. These convergent findings across imaging modalities are in line with findings showing that the caudate nucleus and the medial temporal lobes are involved in different wayfinding strategies. Our study is the first to show a link between self-reported large-scale navigational abilities and different measures of brain anatomy.
  • Whelan, L., Dockery, A., Stephenson, K. A. J., Zhu, J., Kopčić, E., Post, I. J. M., Khan, M., Corradi, Z., Wynne, N., O’ Byrne, J. J., Duignan, E., Silvestri, G., Roosing, S., Cremers, F. P. M., Keegan, D. J., Kenna, P. F., & Farrar, G. J. (2023). Detailed analysis of an enriched deep intronic ABCA4 variant in Irish Stargardt disease patients. Scientific Reports, 13: 9380. doi:10.1038/s41598-023-35889-9.

    Abstract

    Over 15% of probands in a large cohort of more than 1500 inherited retinal degeneration patients present with a clinical diagnosis of Stargardt disease (STGD1), a recessive form of macular dystrophy caused by biallelic variants in the ABCA4 gene. Participants were clinically examined and underwent either target capture sequencing of the exons and some pathogenic intronic regions of ABCA4, sequencing of the entire ABCA4 gene or whole genome sequencing. ABCA4 c.4539 + 2028C > T, p.[= ,Arg1514Leufs*36] is a pathogenic deep intronic variant that results in a retina-specific 345-nucleotide pseudoexon inclusion. Through analysis of the Irish STGD1 cohort, 25 individuals across 18 pedigrees harbour ABCA4 c.4539 + 2028C > T and another pathogenic variant. This includes, to the best of our knowledge, the only two homozygous patients identified to date. This provides important evidence of variant pathogenicity for this deep intronic variant, highlighting the value of homozygotes for variant interpretation. 15 other heterozygous incidents of this variant in patients have been reported globally, indicating significant enrichment in the Irish population. We provide detailed genetic and clinical characterization of these patients, illustrating that ABCA4 c.4539 + 2028C > T is a variant of mild to intermediate severity. These results have important implications for unresolved STGD1 patients globally with approximately 10% of the population in some western countries claiming Irish heritage. This study exemplifies that detection and characterization of founder variants is a diagnostic imperative.

    Additional information

    supplemental material
  • Whitmarsh, S., Barendregt, H., Schoffelen, J.-M., & Jensen, O. (2014). Metacognitive awareness of covert somatosensory attention corresponds to contralateral alpha power. NeuroImage, 85(2), 803-809. doi:10.1016/j.neuroimage.2013.07.031.

    Abstract

    Studies on metacognition have shown that participants can report on their performance on a wide range of perceptual, memory and behavioral tasks. We know little, however, about the ability to report on one's attentional focus. The degree and direction of somatosensory attention can, however, be readily discerned through suppression of alpha band frequencies in EEG/MEG produced by the somatosensory cortex. Such top-down attentional modulations of cortical excitability have been shown to result in better discrimination performance and decreased response times. In this study we asked whether the degree of attentional focus is also accessible for subjective report, and whether such evaluations correspond to the amount of somatosensory alpha activity. In response to auditory cues participants maintained somatosensory attention to either their left or right hand for intervals varying randomly between 5 and 32seconds, while their brain activity was recorded with MEG. Trials were terminated by a probe sound, to which they reported their level of attention on the cued hand right before probe-onset. Using a beamformer approach, we quantified the alpha activity in left and right somatosensory regions, one second before the probe. Alpha activity from contra- and ipsilateral somatosensory cortices for high versus low attention trials were compared. As predicted, the contralateral somatosensory alpha depression correlated with higher reported attentional focus. Finally, alpha activity two to three seconds before the probe-onset was correlated with attentional focus. We conclude that somatosensory attention is indeed accessible to metacognitive awareness.
  • Widlok, T., & Burenhult, N. (2014). Sehen, riechen, orientieren. Spektrum der Wissenschaft, June 2014, 76-81.
  • Willems, R. M., Van der Haegen, L., Fisher, S. E., & Francks, C. (2014). On the other hand: Including left-handers in cognitive neuroscience and neurogenetics. Nature Reviews Neuroscience, 15, 193-201. doi:10.1038/nrn3679.

    Abstract

    Left-handers are often excluded from study cohorts in neuroscience and neurogenetics in order to reduce variance in the data. However, recent investigations have shown that the inclusion or targeted recruitment of left-handers can be informative in studies on a range of topics, such as cerebral lateralization and the genetic underpinning of asymmetrical brain development. Left-handed individuals represent a substantial portion of the human population and therefore left-handedness falls within the normal range of human diversity; thus, it is important to account for this variation in our understanding of brain functioning. We call for neuroscientists and neurogeneticists to recognize the potential of studying this often-discarded group of research subjects.
  • Willems, R. M., & Francks, C. (2014). Your left-handed brain. Frontiers for Young Minds, 2: 13. doi:10.3389/frym.2014.00013.

    Abstract

    While most people prefer to use their right hand to brush their teeth, throw a ball, or hold a tennis racket, left-handers prefer to use their left hand. This is the case for around 10 per cent of all people. There was a time (not so long ago) when left-handers were stigmatized in Western (and other) communities: it was considered a bad sign if you were left-handed, and left-handed children were often forced to write with their right hand. This is nonsensical: there is nothing wrong with being left-handed, and trying to write with the non-preferred hand is frustrating for almost everybody. As a matter of fact, science can learn from left-handers, and in this paper, we discuss how this may be the case. We review why some people are left-handed and others are not, how left-handers' brains differ from right-handers’, and why scientists study left-handedness in the first place
  • Witteman, M. J., Weber, A., & McQueen, J. M. (2014). Tolerance for inconsistency in foreign-accented speech. Psychonomic Bulletin & Review, 21, 512-519. doi:10.3758/s13423-013-0519-8.

    Abstract

    Are listeners able to adapt to a foreign-accented speaker who has, as is often the case, an inconsistent accent? Two groups of native Dutch listeners participated in a cross-modal priming experiment, either in a consistent-accent condition (German-accented items only) or in an inconsistent-accent condition (German-accented and nativelike pronunciations intermixed). The experimental words were identical for both groups (words with vowel substitutions characteristic of German-accented speech); additional contextual words differed in accentedness (German-accented or nativelike words). All items were spoken by the same speaker: a German native who could produce the accented forms but could also pass for a Dutch native speaker. Listeners in the consistent-accent group were able to adapt quickly to the speaker (i.e., showed facilitatory priming for words with vocalic substitutions). Listeners in the inconsistent-accent condition showed adaptation to words with vocalic substitutions only in the second half of the experiment. These results indicate that adaptation to foreign-accented speech is rapid. Accent inconsistency slows listeners down initially, but a short period of additional exposure is enough for them to adapt to the speaker. Listeners can therefore tolerate inconsistency in foreign-accented speech.
  • Wnuk, E., & Burenhult, N. (2014). Contact and isolation in hunter-gatherer language dynamics: Evidence from Maniq phonology (Aslian, Malay Peninsula). Studies in Language, 38(4), 956-981. doi:10.1075/sl.38.4.06wnu.
  • Wnuk, E., & Majid, A. (2014). Revisiting the limits of language: The odor lexicon of Maniq. Cognition, 131, 125-138. doi:10.1016/j.cognition.2013.12.008.

    Abstract

    It is widely believed that human languages cannot encode odors. While this is true for English,
    and other related languages, data from some non-Western languages challenge this
    view. Maniq, a language spoken by a small population of nomadic hunter–gatherers in
    southern Thailand, is such a language. It has a lexicon of over a dozen terms dedicated
    to smell. We examined the semantics of these smell terms in 3 experiments (exemplar
    listing, similarity judgment and off-line rating). The exemplar listing task confirmed that
    Maniq smell terms have complex meanings encoding smell qualities. Analyses of the
    similarity data revealed that the odor lexicon is coherently structured by two dimensions.
    The underlying dimensions are pleasantness and dangerousness, as verified by the off-line
    rating study. Ethnographic data illustrate that smell terms have detailed semantics tapping
    into broader cultural constructs. Contrary to the widespread view that languages cannot
    encode odors, the Maniq data show odor can be a coherent semantic domain, thus shedding
    new light on the limits of language.
  • Yang, Y., Dai, B., Howell, P., Wang, X., Li, K., & Lu, C. (2014). White and Grey Matter Changes in the Language Network during Healthy Aging. PLoS One, 9(9): e108077. doi: 10.1371/journal.pone.0108077.

    Abstract

    Neural structures change with age but there is no consensus on the exact processes involved. This study tested the hypothesis that white and grey matter in the language network changes during aging according to a “last in, first out” process. The fractional anisotropy (FA) of white matter and cortical thickness of grey matter were measured in 36 participants whose ages ranged from 55 to 79 years. Within the language network, the dorsal pathway connecting the mid-to-posterior superior temporal cortex (STC) and the inferior frontal cortex (IFC) was affected more by aging in both FA and thickness than the other dorsal pathway connecting the STC with the premotor cortex and the ventral pathway connecting the mid-to-anterior STC with the ventral IFC. These results were independently validated in a second group of 20 participants whose ages ranged from 50 to 73 years. The pathway that is most affected during aging matures later than the other two pathways (which are present at birth). The results are interpreted as showing that the neural structures which mature later are affected more than those that mature earlier, supporting the “last in, first out” theory.
  • Zhang, Y., Ding, R., Frassinelli, D., Tuomainen, J., Klavinskis-Whiting, S., & Vigliocco, G. (2023). The role of multimodal cues in second language comprehension. Scientific Reports, 13: 20824. doi:10.1038/s41598-023-47643-2.

    Abstract

    In face-to-face communication, multimodal cues such as prosody, gestures, and mouth movements can play a crucial role in language processing. While several studies have addressed how these cues contribute to native (L1) language processing, their impact on non-native (L2) comprehension is largely unknown. Comprehension of naturalistic language by L2 comprehenders may be supported by the presence of (at least some) multimodal cues, as these provide correlated and convergent information that may aid linguistic processing. However, it is also the case that multimodal cues may be less used by L2 comprehenders because linguistic processing is more demanding than for L1 comprehenders, leaving more limited resources for the processing of multimodal cues. In this study, we investigated how L2 comprehenders use multimodal cues in naturalistic stimuli (while participants watched videos of a speaker), as measured by electrophysiological responses (N400) to words, and whether there are differences between L1 and L2 comprehenders. We found that prosody, gestures, and informative mouth movements each reduced the N400 in L2, indexing easier comprehension. Nevertheless, L2 participants showed weaker effects for each cue compared to L1 comprehenders, with the exception of meaningful gestures and informative mouth movements. These results show that L2 comprehenders focus on specific multimodal cues – meaningful gestures that support meaningful interpretation and mouth movements that enhance the acoustic signal – while using multimodal cues to a lesser extent than L1 comprehenders overall.

    Additional information

    supplementary materials
  • Wu, S., Zhao, J., de Villiers, J., Liu, X. L., Rolfhus, E., Sun, X. N., Li, X. Y., Pan, H., Wang, H. W., Zhu, Q., Dong, Y. Y., Zhang, Y. T., & Jiang, F. (2023). Prevalence, co-occurring difficulties, and risk factors of developmental language disorder: First evidence for Mandarin-speaking children in a population-based study. The Lancet Regional Health - Western Pacific, 34: 100713. doi:10.1016/j.lanwpc.2023.100713.

    Abstract

    Background: Developmental language disorder (DLD) is a condition that significantly affects children's achievement but has been understudied. We aim to estimate the prevalence of DLD in Shanghai, compare the co-occurrence of difficulties between children with DLD and those with typical development (TD), and investigate the early risk factors for DLD.

    Methods: We estimated DLD prevalence using data from a population-based survey with a cluster random sampling design in Shanghai, China. A subsample of children (aged 5-6 years) received an onsite evaluation, and each child was categorized as TD or DLD. The proportions of children with socio-emotional behavior (SEB) difficulties, low non-verbal IQ (NVIQ), and poor school readiness were calculated among children with TD and DLD. We used multiple imputation to address the missing values of risk factors. Univariate and multivariate regression models adjusted with sampling weights were used to estimate the correlation of each risk factor with DLD.

    Findings: Of 1082 children who were approached for the onsite evaluation, 974 (90.0%) completed the language ability assessments, of whom 74 met the criteria for DLD, resulting in a prevalence of 8.5% (95% CI 6.3-11.5) when adjusted with sampling weights. Compared with TD children, children with DLD had higher rates of concurrent difficulties, including SEB (total difficulties score at-risk: 156 [17.3%] of 900 TD vs. 28 [37.8%] of 74 DLD, p < 0.0001), low NVIQ (3 [0.3%] of 900 TD vs. 8 [10.8%] of 74 DLD, p < 0.0001), and poor school readiness (71 [7.9%] of 900 TD vs. 13 [17.6%] of 74 DLD, p = 0.0040). After accounting for all other risk factors, a higher risk of DLD was associated with a lack of parent-child interaction diversity (adjusted odds ratio [aOR] = 3.08, 95% CI = 1.29-7.37; p = 0.012) and lower kindergarten levels (compared to demonstration and first level: third level (aOR = 6.15, 95% CI = 1.92-19.63; p = 0.0020)).

    Interpretation: The prevalence of DLD and its co-occurrence with other difficulties suggest the need for further attention. Family and kindergarten factors were found to contribute to DLD, suggesting that multi-sector coordinated efforts are needed to better identify and serve DLD populations at home, in schools, and in clinical settings.

    Funding: The study was supported by Shanghai Municipal Education Commission (No. 2022you1-2, D1502), the Innovative Research Team of High-level Local Universities in Shanghai (No. SHSMU-ZDCX20211900), Shanghai Municipal Health Commission (No.GWV-10.1-XK07), and the National Key Research and Development Program of China (No. 2022YFC2705201).
  • Zioga, I., Weissbart, H., Lewis, A. G., Haegens, S., & Martin, A. E. (2023). Naturalistic spoken language comprehension is supported by alpha and beta oscillations. The Journal of Neuroscience, 43(20), 3718-3732. doi:10.1523/JNEUROSCI.1500-22.2023.

    Abstract

    Brain oscillations are prevalent in all species and are involved in numerous perceptual operations. α oscillations are thought to facilitate processing through the inhibition of task-irrelevant networks, while β oscillations are linked to the putative reactivation of content representations. Can the proposed functional role of α and β oscillations be generalized from low-level operations to higher-level cognitive processes? Here we address this question focusing on naturalistic spoken language comprehension. Twenty-two (18 female) Dutch native speakers listened to stories in Dutch and French while MEG was recorded. We used dependency parsing to identify three dependency states at each word: the number of (1) newly opened dependencies, (2) dependencies that remained open, and (3) resolved dependencies. We then constructed forward models to predict α and β power from the dependency features. Results showed that dependency features predict α and β power in language-related regions beyond low-level linguistic features. Left temporal, fundamental language regions are involved in language comprehension in α, while frontal and parietal, higher-order language regions, and motor regions are involved in β. Critically, α- and β-band dynamics seem to subserve language comprehension tapping into syntactic structure building and semantic composition by providing low-level mechanistic operations for inhibition and reactivation processes. Because of the temporal similarity of the α-β responses, their potential functional dissociation remains to be elucidated. Overall, this study sheds light on the role of α and β oscillations during naturalistic spoken language comprehension, providing evidence for the generalizability of these dynamics from perceptual to complex linguistic processes.
  • Zora, H., Tremblay, A. C., Gussenhoven, C., & Liu, F. (Eds.). (2023). Crosstalk between intonation and lexical tones: Linguistic, cognitive and neuroscience perspectives. Lausanne: Frontiers Media SA. doi:10.3389/978-2-8325-3301-7.
  • Zora, H., Wester, J. M., & Csépe, V. (2023). Predictions about prosody facilitate lexical access: Evidence from P50/N100 and MMN components. International Journal of Psychophysiology, 194: 112262. doi:10.1016/j.ijpsycho.2023.112262.

    Abstract

    Research into the neural foundation of perception asserts a model where top-down predictions modulate the bottom-up processing of sensory input. Despite becoming increasingly influential in cognitive neuroscience, the precise account of this predictive coding framework remains debated. In this study, we aim to contribute to this debate by investigating how predictions about prosody facilitate speech perception, and to shed light especially on lexical access influenced by simultaneous predictions in different domains, inter alia, prosodic and semantic. Using a passive auditory oddball paradigm, we examined neural responses to prosodic changes, leading to a semantic change as in Dutch nouns canon [ˈkaːnɔn] ‘cannon’ vs kanon [kaːˈnɔn] ‘canon’, and used acoustically identical pseudowords as controls. Results from twenty-eight native speakers of Dutch (age range 18–32 years) indicated an enhanced P50/N100 complex to prosodic change in pseudowords as well as an MMN response to both words and pseudowords. The enhanced P50/N100 response to pseudowords is claimed to indicate that all relevant auditory information is still processed by the brain, whereas the reduced response to words might reflect the suppression of information that has already been encoded. The MMN response to pseudowords and words, on the other hand, is best justified by the unification of previously established prosodic representations with sensory and semantic input respectively. This pattern of results is in line with the predictive coding framework acting on multiple levels and is of crucial importance to indicate that predictions about linguistic prosodic information are utilized by the brain as early as 50 ms.
  • Zormpa, E., Meyer, A. S., & Brehm, L. (2023). In conversation, answers are remembered better than the questions themselves. Journal of Experimental Psychology: Learning, Memory, and Cognition, 49(12), 1971-1988. doi:10.1037/xlm0001292.

    Abstract

    Language is used in communicative contexts to identify and successfully transmit new information that should be later remembered. In three studies, we used question–answer pairs, a naturalistic device for focusing information, to examine how properties of conversations inform later item memory. In Experiment 1, participants viewed three pictures while listening to a recorded question–answer exchange between two people about the locations of two of the displayed pictures. In a memory recognition test conducted online a day later, participants recognized the names of pictures that served as answers more accurately than the names of pictures that appeared as questions. This suggests that this type of focus indeed boosts memory. In Experiment 2, participants listened to the same items embedded in declarative sentences. There was a reduced memory benefit for the second item, confirming the role of linguistic focus on later memory beyond a simple serial-position effect. In Experiment 3, two participants asked and answered the same questions about objects in a dialogue. Here, answers continued to receive a memory benefit, and this focus effect was accentuated by language production such that information-seekers remembered the answers to their questions better than information-givers remembered the questions they had been asked. Combined, these studies show how people’s memory for conversation is modulated by the referential status of the items mentioned and by the speaker’s roles of the conversation participants.
  • De Zubicaray, G. I., Hartsuiker, R. J., & Acheson, D. J. (2014). Mind what you say—general and specific mechanisms for monitoring in speech production. Frontiers in Human Neuroscience, 8: 514. doi:10.3389%2Ffnhum.2014.00514.

    Abstract

    For most people, speech production is relatively effortless and error-free. Yet it has long been recognized that we need some type of control over what we are currently saying and what we plan to say. Precisely how we monitor our internal and external speech has been a topic of research interest for several decades. The predominant approach in psycholinguistics has assumed monitoring of both is accomplished via systems responsible for comprehending others' speech.

    This special topic aimed to broaden the field, firstly by examining proposals that speech production might also engage more general systems, such as those involved in action monitoring. A second aim was to examine proposals for a production-specific, internal monitor. Both aims require that we also specify the nature of the representations subject to monitoring.
  • Zumer, J. M., Scheeringa, R., Schoffelen, J.-M., Norris, D. G., & Jensen, O. (2014). Occipital alpha activity during stimulus processing gates the information flow to object-selective cortex. PLoS Biology, 12(10): e1001965. doi:10.1371/journal.pbio.1001965.

    Abstract

    Given the limited processing capabilities of the sensory system, it is essential that attended information is gated to downstream areas, whereas unattended information is blocked. While it has been proposed that alpha band (8–13 Hz) activity serves to route information to downstream regions by inhibiting neuronal processing in task-irrelevant regions, this hypothesis remains untested. Here we investigate how neuronal oscillations detected by electroencephalography in visual areas during working memory encoding serve to gate information reflected in the simultaneously recorded blood-oxygenation-level-dependent (BOLD) signals recorded by functional magnetic resonance imaging in downstream ventral regions. We used a paradigm in which 16 participants were presented with faces and landscapes in the right and left hemifields; one hemifield was attended and the other unattended. We observed that decreased alpha power contralateral to the attended object predicted the BOLD signal representing the attended object in ventral object-selective regions. Furthermore, increased alpha power ipsilateral to the attended object predicted a decrease in the BOLD signal representing the unattended object. We also found that the BOLD signal in the dorsal attention network inversely correlated with visual alpha power. This is the first demonstration, to our knowledge, that oscillations in the alpha band are implicated in the gating of information from the visual cortex to the ventral stream, as reflected in the representationally specific BOLD signal. This link of sensory alpha to downstream activity provides a neurophysiological substrate for the mechanism of selective attention during stimulus processing, which not only boosts the attended information but also suppresses distraction. Although previous studies have shown a relation between the BOLD signal from the dorsal attention network and the alpha band at rest, we demonstrate such a relation during a visuospatial task, indicating that the dorsal attention network exercises top-down control of visual alpha activity.

Share this page