Work

One Front-End, Two Tasks: How Speech Enhancement Affects ASR on Noisy Indian-Accented English and Speaker Diarization in Meetings

Year: 2026
Type: preprint
Abstract: Speech enhancement is often placed before both automatic speech recognition (ASR) and diarization in meeting systems, on the assumption that enhanced audio helps both tasks. We tested this assumption by comparing raw audio with the output of five enhancers and with blends of the two, using two ASR models (Whisper, Parakeet) on Indian-accented English and two diarizers (pyannote, Sortformer) on AMI meetings. No enhancer helped: most made both tasks worse, and diarization even more so. For example, DeepFilterNet3 raised Whisper's word error rate at 0 dB from 14.6% to 24.5%, and pyannote's diarization error rate on clean audio from 17.1% to 28.8%. In pyannote, enhancement mainly damaged the segmentation stage. Blending at least 50% raw audio with the enhanced audio removed almost all of the damage. Enhancement makes audio sound better, but not better for these models.
Language: English
Open Access status: green
OpenAlex ID: W7236583864
Cites:
Cited by:
Related to: 10