Speech intelligibility in reverberation based on audio-visual scenes recordings reproduced in a 3D virtual environment
Year: 2024
Type: article
Abstract: Audio-Visual scenes were collected in a medium-sized reverberant conference hall through in-field 3rd-order ambisonics impulse response recordings and 360-degree stereoscopic video shootings. The visual scenes included cues on the spatial location of the sound sources without lip-sync-related cues. Speech intelligibility tests based on seven audio-visual scenes were administered inside an immersive virtual 3D environment reproduced through a spherical 16-speaker array synced with a head-mounted display. Forty normal-hearing subjects were engaged to test the effects on speech intelligibility of (i) different listener-to-talker distances, (ii) one-talker noise at various azimuth angles around the listener, (iii) high reverberation with –5 dB signal-to-noise ratio, (iv) self-motion, and (v) visual cues.
Source: Building and Environment
Institution: Politecnico di Torino
Language: English
Topic: Speech and Audio Processing
Subfield: Signal Processing
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $4,200
OpenAlex ID: W4395053395