PhD position in the Multimodal Language Department

Job description

For successful communication speakers constantly need to make choices to organize linguistic information in ways fitting their and their interlocutors’ communicative needs at the sentence, discourse and dialogic levels. This is called information structure (IS). Devices that mark IS are diverse ranging from prosodic marking to (morpho)syntactic means as well as gesture. Given the multimodal aspect of communication, the present project aims to investigate gesture (hand, head, facial) as means of expressing IS and its interaction with prosody and morphosyntactic choices in a given language. The project takes an integrated production and perception perspective, even though the emphasis will be on production patterns, and aims to account for language-specific characteristics.

The target language to be investigated is Turkish, which is a verb-final language, with relatively flexible word order driven by information structure, and the linguistic phenomenon to be concentrated on is negation. The main questions to be addressed are i) how do interlocutors use gesture, prosody and morphosyntax in an integrated way to mark negation in Turkish, ii) whether and to what extent gestural marking aligns with prosodic marking iii) how does such multimodal patterning of negation information influence the comprehension and interpretation of negation and its scope.

These questions will primarily be investigated using a corpus-driven approach, and a quantitative and qualitative analysis of a video corpus (e.g. YouTube materials, elicited lab data) in order to gain a systematic understanding of the interplay between gesture, prosody and negation markers in sentence, discourse and dialogic contexts. The candidate will also learn to use automatic machine learning tools (e.g. Open Pose) to detect gestural markers of negation in big corpora. The predictions will then be validated by experimental methods of multimodal language comprehension regarding interactions between prosody and gesture. If time allows, (neuro)psycholinguistic investigation of the integration process from multiple channels in dialogue will be carried out and combined with a cross-linguistic approach.

Project will be led by an interdisciplinary team, by Prof. Asli Özyürek 
(https://www.mpi.nl/people/ozyurek-asli), an expert in human crosslinguistic multimodal language use and processing at the Multimodal Language Department of Max Planck Institute for Psycholinguistics and Dr Hatice Zora (https://www.mpi.nl/people/zora-hatice) an expert in use, neural and cognitive processing of prosody and information structure and Dr. Peter Uhrig (https://peter-uhrig.de/), an expert in multimodal corpus and computational linguistics.

If you have questions about the post that you wish to discuss before you apply, please email the Department Director Prof. Asli Ozyurek at asli.ozyurek [at] mpi.nl.

Requirements

Candidates should have

• A high-quality Research Master’s degree (to be obtained by September 1, 2023) in a relevant field (e.g. experimental psychology, cognitive science, cognitive neuroscience, (computational) linguistics, multimodal linguistics (e.g., gesture), phonetics, computer science, data science).
• Linguistic-conceptual knowledge and Turkish proficiency as well as excellent command of written and spoken English.
• A background in corpus linguistics and/or phonetics, gesture (desirable).
• Affinity with programming (such as Python, Presentation, R) and experience with corpus-linguistic methods and tools for data coding and analysis (such as ELAN, Praat, Red Hen Rapid Annotator) (preferred).
• Willingness to work in an interdisciplinary project.
• Willingness to learn neuroscientific or psycholinguistic measures.

Conditions of Employment

• Full-time position (39 hours per week) to start on 1 September 2023.
• Starting gross salary is € 2,721.84 per month. 
• 30 holidays per year, based on a full-time employment. In addition, we honor the Dutch and German public holidays.
• The institute provides research facilities, technical support, as well as a conference and travel budget. PhD students participate in the International Max Planck Research School for Language Sciences, which involves core and individually chosen coursework to complement the PhD research and training in soft skills such as writing and presentation. The PhD students receive appropriate training, personal supervision, and guidance for their research, which will provide an excellent start to an academic career. All research staff have access to state-of-the art research facilities, including High-Performance-Computing systems, state of the art Vicon Motion Capture Lab (to be installed end 2023) and VR labs, training facilities and a generous conference and travel budget. 

How to apply

To apply please use our application portal here.

The deadline for application is April 30, 2023, but can be extended till we find a suitable candidate.

Short-listed candidates will be invited to participate, shortly after the deadline, in an online or in-person interview.

Applications should be in .pdf format and should include:

• Two-page statement of why you are interested in this post and why you consider yourself a good match for the post.
• One-page summary of your MA thesis.
• Examples of published work (if any).
• A CV, which should include a list of publications and the names, email addresses and contact numbers of three referees who would be willing to provide letters of recommendation (referees will not be contacted unless you are invited to an interview). 

Work environment

The MPI in Nijmegen is an internationally recognized, leading research institute, with a stimulating environment and excellent facilities and resources which is totally devoted to understanding the human language faculty. Work in the Multimodal Language Department in particular aims to understand the cognitive and social foundations of the human ability for language by focusing on its multimodal aspect and crosslinguistic diversity. The research at the department combines multiple methods including corpus and computational linguistics, psycho- and neuro-linguistics, machine learning, AI and virtual reality, and is concerned with various populations ranging from speakers of signed and spoken languages, young and older subjects to healthy and pathological individuals. The department provides opportunities for training in a range of neuropsychological, psychological and state of the art multimodal language analysis (such as motion capture and automatic speech recognition), frequent research and public engagement meetings, and support from an excellent team of researchers in linguistics and psycholinguistics. The department also benefits from close connection to the Donders Institute for Brain, Cognition, and Behaviour and Center for Language Studies at Radboud University. Cross-departmental projects and interdisciplinary work are strongly encouraged. For further details of our research, please see our website: https://www.mpi.nl/department/multimodal-language-department/23.

Employer

The Max Planck Institute (MPI) for Psycholinguistics in Nijmegen is a research institute entirely devoted to the study of language. Our goal is to understand how our minds and brains process language, how language interacts with other aspects of mind and with other agents, how multiple modalities (as in speech, gesture and sign) shape language and its use in diverse languages, and how we can learn languages of quite different types. We are situated on the campus of the Radboud University, and have close collaborative links with the Donders Institute for Brain, Cognition and Behavior and the Centre for Language Studies at the Radboud University.  

We are part of the Max Planck Society, an independent non-governmental association of German-funded research institutes dedicated to fundamental research in the natural sciences, life sciences, social sciences, and the humanities. The Max Planck Society is an equal opportunities employer. We recognize the positive value of diversity, promote equality and challenge discrimination. We therefore welcome applications from all suitably qualified candidates, irrespective of gender, disability, marital or parental status, racial, ethnic or social origin, color, religion, belief, or sexual orientation (https://www.mpi.nl/page/equal-opportunities).