KneeEcho Box: A real-time sonification interface for improving temporal precision in ballet training
Year: 2025
Type: article
Abstract: In ballet, developing the ability to synchronize movements with the music through conscious attention is fundamental to mastering temporal and spatial precision, which are crucial for both technical execution and artistic expression. However, traditional teaching methods often lack the continuous personalized feedback needed to help younger dancers understand complex movement qualities such as timing, making it difficult for them to anticipate rhythm and align their movements with the music. This paper introduces KneeEcho Box, an interactive sonification interface developed through a user-centered design approach to address this gap in ballet training. Using computer vision techniques, KneeEcho Box translates fundamental ballet movements into dynamic, MIDI-based auditory feedback. The system generates xylophone-like tones, reminiscent of music box chimes, to assist dancers in accurately tracking and synchronizing their knee movements during the "plié." We evaluated KneeEchoBox during a test between subjects that involved 22 young ballet dancers. Our results show that interactive sonification enhances movement accuracy and consistency, particularly among younger dancers, by improving their spatial and temporal awareness. We also uncovered the key movement qualities that better convey time synchronization. The user experience ratings were highly positive, demonstrating the potential of sonification to enrich ballet instruction. The findings suggest that integrating this technology into ballet training could open new avenues for research at the intersection of technology and the performing arts.
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $3,510
Awards: G2138623927, G6453994308
OpenAlex ID: W4413584096