Work

Question-Answering in a Low-resourced Language: Benchmark Dataset and Models for Tigrinya

Year: 2023
Type: conference-paper
Abstract: Question-Answering (QA) has seen significant advances recently, achieving near human-level performance over some benchmarks.However, these advances focus on high-resourced languages such as English, while the task remains unexplored for most other languages, mainly due to the lack of annotated datasets.This work presents a native QA dataset for an East African language, Tigrinya.The dataset contains 10.6K question-answer pairs spanning 572 paragraphs extracted from 290 news articles on various topics.The dataset construction method is discussed, which is applicable to constructing similar resources for related languages.We present comprehensive experiments and analyses of several resource-efficient approaches to QA, including monolingual, cross-lingual, and multilingual setups, along with comparisons against machine-translated silver data.Our strong baseline models reach 76% in the F1 score, while the estimated human performance is 92%, indicating that the benchmark presents a good challenge for future work.We make the dataset, models, and leaderboard publicly available.
Language: English
Open Access status: hybrid
OpenAlex ID: W4385564943
FWCI: 1.062
Cites: 38
Cited by: 6
Related to: 10