Year: 2015
Type: article
Abstract: When conversing and collaborating in everyday situations, people naturally and interactively align their behaviors with each other across various communication channels, including speech, gesture, posture, and gaze. Having access to a partner's referential gaze behavior has been shown to be particularly important in achieving collaborative outcomes, but the process in which people's gaze behaviors unfold over the course of an interaction and become tightly coordinated is not well understood. In this paper, we present work to develop a deeper and more nuanced understanding of coordinated referential gaze in collaborating dyads. We recruited 13 dyads to participate in a collaborative sandwich-making task and used dual mobile eye tracking to synchronously record each participant's gaze behavior. We used a relatively new analysis technique-epistemic network analysis-to jointly model the gaze behaviors of both conversational participants. In this analysis, network nodes represent gaze targets for each participant, and edge strengths convey the likelihood of simultaneous gaze to the connected target nodes during a given time-slice. We divided collaborative task sequences into discrete phases to examine how the networks of shared gaze evolved over longer time windows. We conducted three separate analyses of the data to reveal (1) properties and patterns of how gaze coordination unfolds throughout an interaction sequence, (2) optimal time lags of gaze alignment within a dyad at different phases of the interaction, and (3) differences in gaze coordination patterns for interaction sequences that lead to breakdowns and repairs. In addition to contributing to the growing body of knowledge on the coordination of gaze behaviors in joint activities, this work has implications for the design of future technologies that engage in situated interactions with human users.
Source: Frontiers in Psychology
Authors: Sean Andrist, Wesley Collier, Michael Gleicher, Bilge Mutlu, David Shaffer
Institution: University of Wisconsin–Madison
Language: English
Subfield: Language and Linguistics
Field: Arts and Humanities
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $3,801
Awards: Professional Practice Simulations for Engaging, Educating and Assessing Undergraduate Engineers, NRI-Small: Perceptually Inspired Dynamics for Robot Arm Motion, CAREER: Alternate Routes to Technology and Science, AutoMentor: Virtual Mentoring and Assessment in Computer Games for STEM Learning, DRK-12: Developing and Testing the Internship-inator, a Virtual Internship in STEM Authorware System, Using a Virtual Engineering Internship to Model the Complexity of Engineering Design Problems, TUES-Type 2: First-year Virtual Internships to Increase Persistence of Underrepresented Groups in Engineering: RescuShell and its Parent Company RescuTek, CAREER: Designing Socially Adept Robots, EAGER Proposal for Research in Measurement and Modeling: Dynamic STEM Assessment through Epistemic Network Analysis, Measuring Complex STEM Thinking Using Epistemic Network Analysis, Collaborative Research: Research Initiation Grants in Engineering Education: Development of Innovation Capacity in Engineering Students Through Virtual Internships
OpenAlex ID: W1677468976