A four-year fully funded PhD position in the Multimodal Language Department in collaboration with Information and Computing Sciences Department at Utrecht University.
Doctoral supervisors: Prof. Asli Ozyurek (Max Planck Institute for Psycholinguistics) and Dr. Zerrin Yumak (Information and Computing Sciences Department, Utrecht University).
Virtual humans are becoming part of our daily communication practices as in social media, instructional videos, in health care etc. However, their communicative abilities, especially regarding the use of visual features of communication are far beyond ideal. The aim of the PhD project is to simulate communicatively efficient and believable multimodal language use in interactional contexts in 3D virtual humans - building on findings in human multimodal language research. PhD student will investigate how 3D virtual humans can communicate with humans using speech and gesture (hand gestures, facial expressions, eye gaze) in conversational interactions and in believable ways. To do so it will use state-of-the-art motion capture and virtual reality technologies, statistics and machine learning, computational modeling and experimental design. The project will break into new grounds on the one hand on how human like multimodal interactive communicative behavior can be simulated with 3D virtual humans and on the other hand will investigate whether such features enhance their realism, facilitate and ease humans’ interaction with them (e.g. whether the appearance and animations of the virtual humans lead to intended perception of the gestures, facial expressions and communicative intent).
Project will be led by an interdisciplinary team, by Prof. Asli Ozyurek (https://www.mpi.nl/people/ozyurek-asli), an expert in human multimodal language use and processing at the Multimodal Language Department of Max Planck Institute for Psycholinguistics and Dr Zerrin Yumak (https://www.uu.nl/staff/ZYumak), an expert in synthesizing 3D virtual humans’ social and emotional behavior at the Human-Centered Computing group at the Department of Information and Computing Sciences, Utrecht University. The candidate will share his/her time at both institutes benefiting from the excellent state-of-the art research facilities and expertise of multidisciplinary staff.
We are looking for a candidate that meets the following criteria:
To apply please use our application portal here.
The deadline for application is March 30, 2023, but can be extended till we find a suitable candidate. Short-listed candidates will be invited to participate, short after the deadline, in an online or in-person interview.
Applications should be in .pdf format and should include:
If you have questions about the post that you wish to discuss before you apply, please email the Department Director Prof. Asli Ozyurek at asli.ozyurek [at] mpi.nl and/or Z.Yumak [at] uu.nl.
The Max Planck Institute in Nijmegen is an internationally recognized, leading research institute, with a stimulating environment and excellent facilities and resources for linguistic, psycholinguistic and multimodal language research. The Multimodal Language Department at Max Planck Institute in Nijmegen provides opportunities for training in a range of, frequent research and public engagement meetings, and support from an excellent team of researchers in multimodal linguistics and psycholinguistics. The department also benefits from close connection to the Donders Institute for Brain, Cognition and Behavior and AI Department at Radboud University. Cross-departmental projects and interdisciplinary work are strongly encouraged.
Human-Centered Computing group of the Department of Information and Computing Sciences (led by Prof. Judith Masthoff) at Utrecht University is composed of researchers who are experts in various areas including virtual humans in VR/AR/games and human-robot interaction. The group has a fully equipped Motion Capture and Virtual Reality Lab. For more information, see here: https://www.uu.nl/en/research/interaction/human-centred-computing
The Department of Information and Computing Sciences is nationally and internationally renowned for its fundamental and applied research in computer science and information science. In our constantly changing (digital) society, the department of Information and Computing Sciences is looking for new, realistic ways to push the boundaries of both science and social applications. Utrecht University is a friendly and ambitious university at the heart of an ancient city. We love to welcome new scientists to our city – a thriving cultural hub that is consistently rated as one of the world's happiest cities. We are renowned for our innovative interdisciplinary research and our emphasis on inspirational research and excellent education. We are equally well-known for our informal atmosphere and the can-do mentality of our people. This lively and inspiring academic environment attracts professors, researchers and PhD candidates from all over the globe, making both the University and the Faculty of Science a vibrant international and wonderfully diverse community.
The Max Planck Institute (MPI) for Psycholinguistics in Nijmegen is a research institute entirely devoted to the study of language. Our goal is to understand how our minds and brains process language, how language interacts with other aspects of mind and with other agents, how multiple modalities (as in speech, gesture and sign) shape language and its use in diverse languages, and how we can learn languages of quite different types. We are situated on the campus of the Radboud University, and have close collaborative links with the Donders Institute for Brain, Cognition and Behavior and the Centre for Language Studies at the Radboud University.
We are part of the Max Planck Society, an independent non-governmental association of German-funded research institutes dedicated to fundamental research in the natural sciences, life sciences, social sciences, and the humanities. The Max Planck Society is an equal opportunities employer. We recognize the positive value of diversity, promote equality and challenge discrimination. We therefore welcome applications from all suitably qualified candidates, irrespective of gender, disability, marital or parental status, racial, ethnic or social origin, color, religion, belief, or sexual orientation (https://www.mpi.nl/page/equal-opportunities).
Share this page