Effect of head motion animation on immersion and conversational benefit in turn-taking conversations via telepresence in audiovisual virtual environments
Year: 2024
Type: conference-paper
Abstract: In hearing aid technology, algorithms with high spatial selectivity, direction of arrival estimation and algorithms driven by user behavior require natural user behavior for both the development and evaluation.Here we present a method to increase the ecological validity of gaze and head movement behavior in a laboratory setup.Laboratory studies as a complement to field studies are necessary if a precise measurement technique is to be used, and to achieve the best possible control over measurement conditions.By using virtual reality, an experiment can be tested in different virtual environments with little effort, e.g., to test hearing device benefit in various typical communication situations.In this study, an interactive turn-taking conversation in triads was conducted.The test participant sat in the laboratory, equipped with sensors to record movement behavior.The interlocutors were actually in other rooms.Both their audio signal and the movement behavior were recorded and transmitted to the laboratory with a very short delay.The audio signal was fed into the acoustic simulation of the virtual environments, while the head movement data controlled virtual avatars in real time.It was shown that in this way natural motion and communication behavior of the test subject can be achieved.
Authors: G. Grimm, A. Kothe, V. Hohmann
Institution: Carl von Ossietzky Universität Oldenburg
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
Funder: Deutsche Forschungsgemeinschaft
OpenAlex ID: W4391029151