Work

Design and Development of Afan Oromo Speech Recognition and integrating with Dialogue System Using Whisper and RASA

Year: 2026
Type: preprint
Abstract: Automatic Speech Recognition (ASR) for low-resource languages remains a significant challenge due to limited transcribed data and the lack of systematic guidance on model selection. This paper presents the development of an Afan Oromo ASR system using fine-tuned Whisper-small, integrated with a RASA-based conversational agent. We curated a 76.88-hour corpus, implemented persistent dataset splits, applied data augmentation, and developed a robust checkpointing system. The fine-tuned model achieved a Word Error Rate (WER) of 16.88% on the validation set and 17.42% on the held-out test set. We further detail the integration of this model with RASA, creating a complete speech-to-intent pipeline. Our results demonstrate the viability of state-of-the-art ASR for Afan Oromo and provide a practical template for deploying conversational AI in low-resource settings.
Language: English
Open Access status: green
OpenAlex ID: W7226016544
Cites: 6
Cited by:
Related to: 10