Work

Improving Amharic Information Retrieval Using Transformer Based Language Models

Year: 2026
Type: preprint
Abstract: Information retrieval systems are essential for obtaining relevant information from large-scale digital resources. However, current IR systems are language-dependent and have challenges in under-standing the semantic meaning of queries. This study aims to develop a transformer-based semantic information retrieval model for Amharic documents. The model was developed by collecting, cleaning and normalizing 4,372,180 Amharic documents using the design science research methodology. The evaluation was per-formed on three multilingual transformer models, XLM-RoBERTa, mBERT-Cased, and mBERT-Uncased, in different training and testing configurations in Python 3.7. The experimental results show that XLM-RoBERTa achieved the best performance with an F-measure of 92.09% (97.09% precision and 87.64% recall) for an 80/20 train-test split and 91.52% F-measure (94% precision and 88.9% recall) for a 70/30 split. The results demonstrate that transformer-based models are capable of capturing semantic relation-ships in Amharic queries and improving the performance of information retrieval. Further research can investigate advanced transformer architectures and pre-training methods to improve Amharic semantic retrieval systems.
Language: English
Open Access status: green
OpenAlex ID: W7236462599
Cites: 11
Cited by:
Related to: 10