Assessing Collaboration Using Multimodal Signals in a Triadic Puzzle-Solving Task in Virtual Reality
Year: 2024
Type: conference-paper
Abstract: In high-stakes collaborative situations, a decline in collaboration quality can lead to significant adverse events. Although human factors (HF) specialists are effective in identifying and resolving collaboration issues, their analyses are often case-specific and conducted retrospectively. To address these limitations, our research aims to assess collaboration processes in real-time using multimodal signals collected and analyzed during the activity. In this context, we propose a platform that integrates audio, visual, task logs, and spatial metrics computed along the activity, to provide an assessment of various dimensions of the collaboration process. This approach is applied to a triadic collaborative puzzle-solving task in virtual reality.
Institutions: Laboratoire des Sciences du Numérique de Nantes, Laboratoire des Sciences et Techniques de l’Information de la Communication et de la Connaissance, IMT Atlantique, Nantes Université, Commonwealth Scientific and Industrial Research Organisation, University of Illinois Urbana-Champaign, Royal Brisbane and Women's Hospital, Australian e-Health Research Centre
Language: English
Subfield: Social Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W4409763537