Year: 2018
Type: conference-paper
Abstract: In this paper we present a framework for evaluating interactions between a human user and an embodied virtual agent that communicates using natural language, gesture, and by executing actions in a shared context created through a visual simulation interface.These interactions take place in real time and demonstrate collaboration between a human and a computer on object interaction and manipulation.Our framework leverages the semantics of language and gesture to assess the level of mutual understanding during the interaction and the ease with which the two agents communicate.We present initial results from trials involving construction tasks in a blocks world scenario and discuss extensions of the evaluation framework to more naturalistic and robust interactions.
Authors: Nikhil Krishnaswamy, James Pustejovsky
Institution: Brandeis University
Language: English
Subfield: Social Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: hybrid
OpenAlex ID: W2807393344