Publications

Abstract

Word segmentation, or detecting word boundaries in continuous speech, is not an easy task. Spoken language does not contain silences to indicate word boundaries and words partly overlap due to coarticalution. Still, adults listening to their native language perceive speech as individual words. They are able to combine different distributional cues in the language, such as the statistical distribution of sounds and metrical cues, with lexical information, to efficiently detect word boundaries. Infants in the first year of life do not command these cues. However, already between seven and ten months of age, before they know word meaning, infants learn to segment words from speech. This important step in language acquisition is the topic of this dissertation. In chapter 2, the first Event Related Brain Potential (ERP) study on word segmentation in Dutch ten-month-olds is discussed. The results show that ten-month-olds can already segment words with a strong-weak stress pattern from speech and they need roughly the first half of a word to do so. Chapter 3 deals with segmentation of words beginning with a weak syllable, as a considerable number of words in Dutch do not follow the predominant strong-weak stress pattern. The results show that ten-month-olds still largely rely on the strong syllable in the language, and do not show an ERP response to the initial weak syllable. In chapter 4, seven-month-old infants' segmentation of strong-weak words was studied. An ERP response was found to strong-weak words presented in sentences. However, a behavioral response was not found in an additional Headturn Preference Procedure study. There results suggest that the ERP response is a precursor to the behavioral response that infants show at a later age.

Abstract

Originally published in Cognition International Journal of Cognitive Science, Volume 42, Numbers 1-3, 1992 This paper introduces a special issue of Cognition 011 lexical access in speech production. Over the last quarter century, the psycholinguistic study of speaking, and in particular of accessing words in speech, received a major new impetus from the analysis of speech errors, dysfluencies and hesMions, from aphasiology, and from new paradigms in reaction time research. The emerging theoretical picture partitions the accessing process into two subprocesses, the selection of an appropriate lexical item (and "lemma") from the mental lexicon, and the phonological encoding of that item, that is, the computation of a phonetic program for the item in the context of utterance These two theoretical domains are successively introduced by outlining some core issues that have been or still have to be addressed. The final section discusses the controversial question whether phonological encoding can affect lexical selection. This partitioning is also followed in this special issue as a whole. There are, first, four papers on lexical selection, then three papers on phonological encoding, and finally one on the interaction between selection and phonological encoding.

Abstract

This chapter explicates the requirement in person–reference for balancing demands for recognition, minimalization, explicitness and indirection. This is illustrated with reference to data from repair of failures of person–reference within a particular linguistic/cultural context, namely casual interaction among Rossel Islanders. Rossel Island (PNG) offers a ‘natural experiment’ for studying aspects of person reference, because of a number of special properties: 1. It is a closed universe of 4000 souls, sharing one kinship network, so in principle anyone could be recognizable from a reference. As a result no (complex) descriptions (cf. ‘ the author of Waverly’) are employed. 2. Names, however, are never uniquely referring, since they are drawn from a fixed pool. They are only used for about 25% of initial references, another 25% of initial references being done by kinship triangulation (‘that man’s father–in–law’). Nearly 50% of initial references are semantically underspecified or vague (e.g. ‘that girl’). 3. There are systematic motivations for oblique reference, e.g. kinship–based taboos and other constraints, which partly account for the underspecified references. The ‘natural experiment’ thus reveals some gneral lessons about how person–reference requires optimizing multiple conflicting constraints. Comparison with Sacks and Schegloff’s (1979) treatment of English person reference suggests a way to tease apart the universal and the culturally–particular.

Abstract

There has been a recent spate of work on recursion as a central design feature of language and specifically of syntax. This short report points out that there is little evidence that unlimited recursion, understood as centre embedding, is typical of natural language syntax. Nevertheless, embedded pragmatic construals seem available in every language. Further, much deeper centre embedding can be found in dialogue or conversation structure than can be found in syntax. Existing accounts for the ‘performance’ limitations on centre embedding are thus thrown in doubt. Dialogue materials suggest that centre embedding is perhaps a core part of the human interaction system and is for some reason much more highly restricted in syntax than in other aspects of cognition

Abstract

This chapter provides an overview of the Papuan and the Oceanic languages (a branch of Austronesian) in Northern Island Melanesia, as well as phenomena arising through contact between these groups. It shows how linguistics can contribute to the understanding of the history of languages and speakers, and what the findings of those methods have been. The location of the homeland of speakers of Proto-Oceanic is indicated (in northeast New Britain); many facets of the lives of those speakers are shown; and the patterns of their subsequent spread across Island Melanesia and beyond into Remote Oceania are indicated, followed by a second wave overlaying the first into New Guinea and as far as halfway through the Solomon Islands. Regarding the Papuan languages of this region, at least some are older than the 6,000-10,000 ceiling of the Comparative Method, and their relations are explored with the aid of a database of 125 non-lexical structural features. The results reflect archipelago-based clustering with the Central Solomons Papuan languages forming a clade either with the Bismarcks or with Bougainville languages. Papuan languages in Bougainville are less influenced by Oceanic languages than those in the Bismarcks and the Solomons. The chapter considers a variety of scenarios to account for their findings, concluding that the results are compatible with multiple pre-Oceanic waves of arrivals into the area after initial settlement.

Abstract

This paper investigates infant pointing at 12 months. Three recent experimental studies from our lab are reported and contrasted with existing accounts on infant communicative and social-cognitive abilities. The new results show that infant pointing at 12 months already is a communicative act which involves the intentional transmission of information to share interest with, or provide information for other persons. It is argued that infant pointing is an inherently social and cooperative act which is used to share psychological relations between interlocutors and environment, repairs misunderstandings in proto-conversational turn-taking, and helps others by providing information. Infant pointing builds on an understanding of others as persons with attentional states and attitudes. Findings do not support lean accounts on early infant pointing which posit that it is initially non-communicative, does not serve the function of indicating, or is purely self-centered. It is suggested to investigate the emergence of reference and the motivation to jointly engage with others also before pointing has emerged.

Abstract

There are two tasks for conducting systematic observation of child-caregiver joint attention interactions. Task 1 – a “decorated room” designed to elicit infant and caregiver pointing. Task 2 – videotaped interviews about infant pointing behaviour. The goal of this task is to document the ontogenetic emergence of referential communication in caregiver infant interaction in different cultures, during the critical age of 8-15 months when children come to understand and share others’ intentions. This is of interest to all students of interaction and human communication; it does not require specialist knowledge of children.

Abstract

Models are a flourishing and indispensable area of research in language evolution. Here we
highlight critical issues in using and interpreting models, and suggest viable approaches. First,
contrasting models can explain the same data and similar modelling techniques can lead to
diverging conclusions. This should act as a reminder to use the extreme malleability of
modelling parsimoniously when interpreting results. Second, quantitative techniques similar to
those used in modelling language evolution have proven themselves inadequate in other
disciplines. Cross-disciplinary fertilization is crucial to avoid mistakes which have previously
occurred in other areas. Finally, experimental validation is necessary both to sharpen models'
hypotheses, and to support their conclusions. Our belief is that models should be interpreted as
quantitative demonstrations of logical possibilities, rather than as direct sources of evidence.
Only an integration of theoretical principles, quantitative proofs and empirical validation can
allow research in the evolution of language to progress.

Abstract

In most of our everyday conversations, we not only hear but also see each other talk. Our understanding of speech benefits from having the speaker's face present. This finding immediately necessitates the question of how the information from the different perceptual sources is used to reach the best overall decision. This need for processing of multiple sources of information also exists in auditory speech perception, however. Audiovisual speech simply shifts the focus from intramodal to intermodal sources but does not necessitate a qualitatively different form of processing. It is essential that a model of speech perception operationalizes the concept of processing multiple sources of information so that quantitative predictions can be made. This chapter gives an overview of the main research questions and findings unique to audiovisual speech perception and word recognition research as well as what general questions about speech perception and cognition the research in this field can answer. The main theoretical approaches to explain integration and audiovisual speech perception are introduced and critically discussed. The chapter also provides an overview of the role of visual speech as a language learning tool in multimodal training.

Abstract

This volume is dedicated to exploring the crossroads where complex sentences and information management – more specifically information structure (IS) and reference tracking (RT) – come together. Complex sentences are a highly relevant but understudied domain for studying notions of IS and RT. On the one hand, a complex sentence can be studied as a mini-unit of discourse consisting of two or more elements describing events, situations, or processes, with its own internal information-structural and referential organisation. On the other hand, complex sentences can be studied as parts of larger discourse structures, such as narratives or conversations, in terms of how their information-structural characteristics relate to this wider context.We first focus on the interrelatedness of IS and RT (Section 1) and then define and discuss the notion of complex sentences and their subtypes in Section 2. Section 3 surveys issues of IS in complex sentences, while Section 4 focuses on RT in complex sentences. Sections 5 and 6 briefly consider IS and RT in a wider discourse context. Section 5 discusses the interaction between IS, RT, and other discourse factors, and Section 6 focuses on ways in which a specific RT system, switch reference, can function as an RT device beyond the sentence.

Abstract

No island effects are observable in Tundra Yukaghir questions, which are possible in virtually all syntactic environments. It is argued that this feature of Tundra Yukaghir relates to its capability of explicitly marking focus domains. If a question word occurs in a syntactic island, the whole island is morphologically treated as a focus domain. In order to take scope and function as question markers, question words must remain within the focus domain, i.e. in the island clause. This syntactic configuration is reflected in the semantics of question islands, which are used to inquire about the identity of the whole island, not merely the denotation of the question word.

Abstract

This chapter is a review of the literature in experimental psycholinguistics on spoken word recognition. It is organized around eight questions. 1. Why are psycholinguists interested in spoken word recognition? 2. What information in the speech signal is used in word recognition? 3. Where are the words in the continuous speech stream? 4. Which words did the speaker intend? 5. When, as the speech signal unfolds over time, are the phonological forms of words recognized? 6. How are words recognized? 7. Whither spoken word recognition? 8. Who are the researchers in the field?

Abstract

In this paper, we present two attempts to replicate a widely-cited but never fully published experiment in which German and Spanish speakers were asked to associate adjectives with nouns of masculine and feminine grammati-cal gender (Boroditsky et al. 2003). The researchers claim that speakers associ-ated more stereotypically female adjectives with grammatically feminine nouns and more stereotypically male adjectives with grammatically masculine nouns. We were not able to replicate the results either in a word association task or in an analogous primed lexical decision task. This suggests that the results of the original experiment were either an artifact of some non-documented aspect of the experimental procedure or a statistical fluke. The question whether speakers assign sex-based interpretations to grammatical gender categories at all cannot be answered definitively, as the results in the published literature vary consider-ably. However, our experiments show that if such an effect exists, it is not strong enough to be measured indirectly via the priming of adjectives by nouns.

Abstract

The goal of speech perception is understanding a speaker's message. To achieve this, listeners must recognize the words that comprise a spoken utterance. This in turn implies distinguishing these words from other minimally different words (e.g., word from bird, etc.), and this involves making phonemic distinctions. The article summarizes research on the perception of phonemic distinctions, on how listeners cope with the continuity and variability of speech signals, and on how phonemic information is mapped onto the representations of words. Particular attention is paid to theories of speech perception and word recognition.

Abstract

The present doctoral thesis investigates the temporal characteristics of the retrieval of semantic and syntactic word properties in language comprehension. In particular, an attempt is made to assess the retrieval order of semantic category and grammatical gender information, using the lateralized readiness potential and the inhibition-related N2 effect. Chapter 1 contains a general introduction. Chapter 2 reports an experiment that employs the two-choice go/nogo task in combination with EEG recordings to establish the retrieval order of semantic category and grammatical gender for written words presented in isolation. The results point to a time course where semantic information becomes available before syntactic information. Chapter 3 focuses on the retrieval of grammatical gender. In order to examine whether gender retrieval can be speeded up by context, nouns are presented in gender congruent and gender incongruent prime-target pairs and reaction times for gender decisions are measured. For stimulus onset asynchronies of 100 ms and 0 ms, gender congruent pairs show faster responses than incongruent ones, whereas there is no effect of gender congruity for a stimulus onset asynchrony of 300 ms. A simulation with a localist computational model that implements competition between gender representations (WEAVER; Roelofs, 1992) is able to capture these findings. In chapter 4, the gender congruency manipulation is transferred to another ERP experiment with the two-choice go/nogo task. As the time course of gender retrieval is altered through primes, the order relative to semantic category retrieval is assessed again. The results indicate that with gender congruent primes, grammatical gender becomes available before semantic category. Such a reversal of retrieval order, as compared to chapter 2, implies a parallel rather than a serial discrete arrangement of the retrieval processes, since the latter variant precludes changes in retrieval order. Finally, chapter 5 offers a summary and general discussion of the main findings.

Abstract

The human language processor is conceived as a system that consists of several interrelated subsystems. Each subsystem performs a specific task in the complex process of language comprehension and production. A subsystem receives a particular input, performs certain specific operations on this input and yields a particular output. The subsystems can be characterized in terms of the transformations that relate the input representations to the output representations. An important issue in describing the language processing system is to identify the subsystems and to specify the relations between the subsystems. These relations can be conceived in two different ways. In one conception the subsystems are autonomous. They are related to each other only by the input-output channels. The operations in one subsystem are not affected by another system. The subsystems are modular, that is they are independent. In the other conception, the different subsystems influence each other. A subsystem affects the processes in another subsystem. In this conception there is an interaction between the subsystems.

Abstract

This dissertation documents the emergence of a new language, Light Warlpiri, in the multilingual community of Lajamanu in northern Australia. It then examines the acquisition of Light Warlpiri language, and of the heritage language, Lajamanu Warlpiri, by children. Light Warlpiri has arisen from contact between Lajamanu Warlpiri (a Pama-Nyungan language), Kriol (an English-based creole), and varieties of English. It is a Mixed Language, meaning that none of its source languages can be considered to be the sole parent language. Most verbs and the verbal morphology are from Aboriginal English or Kriol, while most nouns and the nominal morphology are from Warlpiri. The language input to children is complex. Adults older than about thirty speak Lajamanu Warlpiri and code-switch into Aboriginal English or Kriol. Younger adults, the parents of the current cohort of children, speak Light Warlpiri and code-switch into Lajamanu Warlpiri and into Aboriginal English or Kriol. Lajamanu Warlpiri and Light Warlpiri, the two main input languages to children, both indicate A arguments with ergative case-marking (and they share one allomorph of the marker), but Lajamanu Warlpiri includes the marker much more consistently than Light Warlpiri. Word order is variable in both languages. Children learn both languages from birth, but they target Light Warlpiri as the language of their everyday interactions, and they speak it almost exclusively until four to six years of age. Adults and children show similar patterns of ergative marking and word order in Light Warlpiri. But differences between age groups are found in ergative marking in Lajamanu Warlpiri - for the oldest group of adults, ergative marking is obligatory, but for younger adults and children, it is not. Determining when children differentiate between two input languages has been a major goal in the study of bilingual acquisition. The two languages in this study share lexical and grammatical properties, making distinctions between them quite subtle. Both adults and children distribute ergative marking differently in the two languages, but show similar word order patterns in both. However the children show a stronger correlation between ergative marking and word order patterns than do the adults, suggesting that they are spearheading processes of language change. In their comprehension of sentences in both Lajamanu Warlpiri and Light Warlpiri, adults use a case-marking strategy to identify the A argument (i.e. N+erg = A argument, N-erg = O argument). The children are not adult-like in using this strategy at age 5, when they also used a word order strategy, but they gradually move towards being adult-like with increased age.

Abstract

What are the relations between linguistic encoding and gestural representations of events during online speaking? The few studies that have been conducted on this topic have yielded somewhat incompatible results with regard to whether and how gestural representations of events change with differences in the preferred semantic and syntactic encoding possibilities of languages. Here we provide large scale semantic, syntactic and temporal analyses of speech- gesture pairs that depict 10 different motion events from 20 Turkish and 20 English speakers. We find that the gestural representations of the same events differ across languages when they are encoded by different syntactic frames (i.e., verb-framed or satellite-framed). However, where there are similarities across languages, such as omission of a certain element of the event in the linguistic encoding, gestural representations also look similar and omit the same content. The results are discussed in terms of what gestures reveal about the influence of language specific encoding on on-line thinking patterns and the underlying interactions between speech and gesture during the speaking process.

Abstract

This dissertation investigates the expression of spatial relationships in German Sign Language (Deutsche Gebärdensprache, DGS). The analysis focuses on linguistic expression in the spatial domain in two types of discourse: static scene description (location) and event narratives (location and motion). Its primary theoretical objectives are to characterize the structure of locative descriptions in DGS; to explain the use of frames of reference and perspective in the expression of location and motion; to clarify the interrelationship between the systems of frames of reference, signing perspective, and classifier predicates; and to characterize the interplay between iconicity principles, on the one hand, and grammatical and discourse constraints, on the other hand, in the use of these spatial devices. In more general terms, the dissertation provides a usage-based account of iconic mapping in the visual-spatial modality. The use of space in sign language expression is widely assumed to be guided by iconic principles, which are furthermore assumed to hold in the same way across sign languages. Thus, there has been little expectation of variation between sign languages in the spatial domain in the use of spatial devices. Consequently, perhaps, there has been little systematic investigation of linguistic expression in the spatial domain in individual sign languages, and less investigation of spatial language in extended signed discourse. This dissertation provides an investigation of spatial expressions in DGS by investigating the impact of different constraints on iconicity in sign language structure. The analyses have important implications for our understanding of the role of iconicity in the visual-spatial modality, the possible language-specific variation within the spatial domain in the visual-spatial modality, the structure of spatial language in both natural language modalities, and the relationship between spatial language and cognition

Abstract

Literacy and education represent essential aspects of contemporary society and subserve important aspects of socialization and cultural transmission. The study of illiterate subjects represents one approach to investigate the interactions between neurobiological and cultural factors in cognitive development, individual learning, and their influence on the functional organization of the brain. In this chapter we review some recent cognitive, neuroanatomic, and functional neuroimaging results indicating that formal education influences important aspects of the human brain. Taken together this provides strong support for the idea that the brain is modulated by literacy and formal education, which in turn change the brains capacity to interact with its environment, including the individual's contemporary culture. In other words, the individual is able to participate in, interact with, and actively contribute to the process of cultural transmission in new ways through acquired cognitive skills.

Abstract

This dissertation investigates the roles of several probabilistic variables in the production and comprehension of reduced Dutch affixes. The central hypothesis is that linguistic units with a high probability of occurrence are
more likely to be reduced (Jurafsky et al., 2001; Aylett & Turk, 2004). This hypothesis is tested by analyzing the acoustic realizations of affixes, which are meaning-carrying elements embedded in larger lexical units. Most of the results prove to be compatible with the main hypothesis, but some appear to run counter to its predictions. The final chapter of the thesis discusses the implications of these findings for models of speech production, models of speech perception, and probability-based accounts of reduction.

Abstract

This paper compares the acquisition of verb morphology in five Mayan languages, using a comparative method based on historical linguistics to establish precise equivalences between linguistic categories in the five languages. Earlier work on the acquisition of these languages, based on examination of longitudinal samples of naturally-occuring child language, established that in some of the languages (Tzeltal, Tzotzil) bare roots were the predominant forms for children’s early verbs, but in three other languages (Yukatek, K’iche’, Q’anjobal) unanalyzed portions of the final part of the verb were more likely. That is, children acquiring different Mayan languages initially produce different parts of the adult verb forms. In this paper we analyse the structures of verbs in caregiver speech to these same children, using samples from two-year-old children and their caregivers, and assess the degree to which features of the input might account for the children’s early verb forms in these five Mayan languages. We found that the frequency with which adults produce verbal roots at the extreme right of words and sentences influences the frequency with which children produce bare verb roots in their early verb expressions, while production of verb roots at the extreme left does not, suggesting that the children ignore the extreme left of verbs and sentences when extracting verb roots.

Abstract

This chapter describes topic management in the Papuan language Usan. The notion of ‘topic’ is defined by its pre-theoretical meaning ‘what someone’s speech is about’. This notion cannot be restricted to simple clausal or sentential constructions, but requires the wider context of long stretches of natural text. The tracking of a topic is examined in its relationship to clause combining mechanisms. Coordinating clause chaining with its switch reference mechanism is contrasted with subordinating strategies called ‘domain-creating’ constructions. These different strategies are identified by language-specific signals, such as intonation and morphosyntactic cues like nominalizations and scope of negation and other modalities.