Design and Development of Afan Oromo Speech Recognition and integrating with Dialogue System Using Whisper and RASA
Year: 2026
Type: preprint
Abstract: Automatic Speech Recognition (ASR) for low-resource languages remains a significant challenge due to limited transcribed data and the lack of systematic guidance on model selection. This paper presents the development of an Afan Oromo ASR system using fine-tuned Whisper-small, integrated with a RASA-based conversational agent. We curated a 76.88-hour corpus, implemented persistent dataset splits, applied data augmentation, and developed a robust checkpointing system. The fine-tuned model achieved a Word Error Rate (WER) of 16.88% on the validation set and 17.42% on the held-out test set. We further detail the integration of this model with RASA, creating a complete speech-to-intent pipeline. Our results demonstrate the viability of state-of-the-art ASR for Afan Oromo and provide a practical template for deploying conversational AI in low-resource settings.
Source: Research Square
Authors: Teklu Urgessa, Worku Jifara, Adugna Deksiso
Institution: Adama Science and Technology University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7226016544
