Work

British Sign Language in Embodied Music Interaction: An exploratory study of British Sign Language music interpretation

Year: 2026

Type: conference-paper

Abstract: This paper introduces a framework for studying how British Sign Language (BSL) interpreters convey music to hard-of-hearing audiences. It presents a pilot study evaluating the framework and reports initial data analysis. The work emphasises the use of BSL and body movements to communicate a song’s musical and sonic qualities, with or without lyrics. Data collection employed qualitative methods, including online surveys and remote interviews with a music-specialised BSL interpreter, analysed through a grounded theory approach, as well as quantitative methods using custom Python scripts for computer vision and audio analysis. Three BSL professionals specialising in interpreting accessible live concerts for hard-of-hearing audiences participated, providing data for motion capture, facial expressions, hand gestures, and audio analyses (spectral, temporal, and amplitude). The paper discusses framework evaluation, exploratory data analysis, and future research directions. This study offers an initial exploration of how British Sign Language can be used to interpret and communicate musical features, highlighting methodological challenges and opportunities for multimodal accessibility.

Source: International Conference on Movement and Computing (MOCO)

DOI: 10.1145/3802842.3802848

Authors: Balandino Di Donato, Andrea Bolzoni, John McGowan, Iain McGregor

Institutions: Edinburgh Napier University, The Open University

Language: English

Topic: Hearing Impairment and Communication

Subfield: Developmental and Educational Psychology

Field: Psychology

Domain: Social Sciences

SDG: Reduced inequalities

Open Access status: hybrid

Funder: UK Research and Innovation