Publications

Abstract

The present paper studies how, in deictic expressions, the temporal interdependency of speech and gesture is realized in the course of motor planning and execution. Two theoretical positions were compared. On the “interactive” view the temporal parameters of speech and gesture are claimed to be the result of feedback between the two systems throughout the phases of motor planning and execution. The alternative “ballistic” view, however, predicts that the two systems are independent during the phase of motor execution, the temporal parameters having been preestablished in the planning phase. In four experiments subjects were requested to indicate which of an array of referent lights was momentarily illuminated. This was done by pointing to the light and/or by using a deictic expression (this/that light). The temporal and spatial course of the pointing movement was automatically registered by means of a Selspot opto-electronic system. By analyzing the moments of gesture initiation and apex, and relating them to the moments of speech onset, it was possible to show that, for deictic expressions, the ballistic view is very nearly correct.

Abstract

The process of speaking is traditionally regarded as a mapping of thoughts (intentions, feelings, etc.) onto language. One requirement that this mapping has to meet is that the units of information to be expressed be strictly ordered. The channel of speech largely prohibits the simultaneous expression of multiple propositions: the speaker has a linearization problem - that is, a linear order has to be determined over any knowledge structure to be formulated. This may be relatively simple if the informational structure has itself an intrinsic linear arrangement, as often occurs with event structures, but it requires special procedures if the structure is more complex, as is often the case in two- or three-dimensional spatial patterns. How, for instance, does a speaker proceed in describing his home, or the layout of his town? Two powerful constraints on linearization derive, on the one hand, from 'mutual knowledge' and, on the other, from working memory limitations. Mutual knowledge may play a role in that the listener can be expected to derive different implicatures from different orderings (compare 'she married and became pregnant' with 'she became pregnant and married'). Mutual knowledge determinants of linearization are essentially pragmatic and cultural, and dependent on the content of discourse. Working memory limitations affect linearization in that a speaker's linearization strategy will minimize memory load during the process of formulating. A multidimensional structure is broken up in such a way that the number of 'return addresses' to be kept in memory will be minimized. This is attained by maximizing the connectivity of the discourse, and by backtracking to stored addresses in a first-in-last-out fashion. These memory determinants of linearization are presumably biological, and independent of the domain of discourse. An important question is whether the linearization requirement is enforced by the oral modality of speech or whether it is a deeper modality-independent property of language use.

Abstract

Focuses on the pre-observations on the modeling of dialogue. Assumptions that underlie speech act models of dialogue; Identifiability of utterance units corresponding to unit acts; Capacity of the models to model the actual properties of natural dialogue.

Abstract

On simple intelligibility measures, high-quality synthesiser output now scores almost as well as natural speech. Nevertheless, it is widely agreed that perception of synthetic speech is a harder task for listeners than perception of natural speech; in particular, it has been hypothesized that listeners have difficulty identifying phonemes in synthetic speech. If so, a simple measure of the speed with which a phoneme can be identified should prove a useful tool for comparing perception of synthetic and natural speech. The phoneme detection task was here used in three experiments comparing perception of natural and synthetic speech. In the first, response times to synthetic and natural targets were not significantly different, but in the second and third experiments response times to synthetic targets were significantly slower than to natural targets. A speed-accuracy tradeoff in the third experiment suggests that an important factor in this task is the response criterion adopted by subjects. It is concluded that the phoneme detection task is a useful tool for investigating phonetic processing of synthetic speech input, but subjects must be encouraged to adopt a response criterion which emphasizes rapid responding. When this is the case, significantly longer response times for synthetic targets can indicate a processing disadvantage for synthetic speech at an early level of phonetic analysis.

Abstract

Four experiments examined segmentation of spoken Japanese words by native and non-native listeners. Previous studies suggested that language rhythm determines the segmentation unit most natural to native listeners: French has syllabic rhythm, and French listeners use the syllable in segmentation, while English has stress rhythm, and segmentation by English listeners is based on stress. The rhythm of Japanese is based on a subsyllabic unit, the mora. In the present experiments Japanese listeners′ response patterns were consistent with moraic segmentation; acoustic artifacts could not have determined the results since nonnative (English and French) listeners showed different response patterns with the same materials. Predictions of a syllabic hypothesis were disconfirmed in the Japanese listeners′ results; in contrast, French listeners showed a pattern of responses consistent with the syllabic hypothesis. The results provide further evidence that listeners′ segmentation of spoken words relies on procedures determined by the characteristic phonology of their native language.

Abstract

We report four experiments in which English and Italian monolinguals detected clicks in continous speech in their native language. Two of the experiments used an off-line location task, and two used an on-line reaction time task. Despite there being large differences between English and Italian with respect to rhythmic characteristics, very similar response patterns were found for the two language groups. It is concluded that the process of click detection operates independently from language-specific differences in perceptual processing at the sublexical level.

Abstract

Van den Broeck (1977, 1980) heeft een pragmatische interpretatie voorgesteld voor de verschillende wijzen waarop leden van hogere en lagere sociaal-economische klassen hun taaluitingen syntaktisch struktureren. Ter ondersteuning hiervan presenteerde hij gegevens m.b.t. gemiddelde zinscomplexiteit bij sprekers uit twee sociaal- conomische klassen in formele en informele gesprekssituaties. Het in dit artikel gerapporteerde onderzoek slaagt er niet in van den Broeck's uitkomsten te repliceren. Waarschijnlijk berusten ze op een contaminatie van gesprekssituatie met taalkeuze (standaardtaal vs. lokaal dialekt). Mede op basis van de nieuwe gegevens wordt i.p.v. de pragmatische interpretatie een vaardigheidsinterpretatie voorgesteld. T.g.v. vooropleiding en beroep beschikken leden van verschillende sociaal- economische klassen over uiteenlopende vaardigheidsniveaus in verhalend (narrative) en verklarend (expository) taalgebruik. Dit uit zich in het gebruik van connectieven: funktiewoorden die logischsemantische relaties tussen proposities uitdrukken.

Abstract

When we want to describe a path through space, but do not share a common perceptual field with a conversation partner, language has to work doubly hard. This task investigates how people communicate the navigation of space in the absence of shared visual cues, as well as collecting data on motion verbs and the roles of symmetry and landmarks in route description. Two speakers (separated by a curtain or other barrier) are each given a model of a landscape, and one participant describes standard routes through this landscape for the other to match.

Abstract

The encoding of apparently ‘simple’ movement concepts such as ‘COME’ and ‘GO’ can differ widely across languages (e.g., in regard to specifying direction of motion relative to the speaker). This questionnaire is used to identify the range of use of basic motion verbs in a language, and investigate semantic parameters that are involved in high frequency ‘COME’ and ‘GO’-like terms.

Abstract

In the absence of explicitly marked cues to word boundaries, listeners tend to segment spoken English at the onset of strong syllables. This may suggest that under difficult listening conditions, speech should be easier to recognize where strong syllables are word-initial. We report two experiments in which listeners were presented with sentences which had been time-compressed to make listening difficult. The first study contrasted sentences in which all content words began with strong syllables with sentences in which all content words began with weak syllables. The intelligibility of the two groups of sentences did not differ significantly. Apparent rhythmic effects in the results prompted a second experiment; however, no significant effects of systematic rhythmic manipulation were observed. In both experiments, the strongest predictor of intelligibility was the rated plausibility of the sentences. We conclude that listeners' recognition responses to time-compressed speech may be strongly subject to experiential bias; effects of rhythmic structure are most likely to show up also as bias effects.