Unicorn at NADI 2025 Subtask 3: GEMM3N-DR: Audio-Text Diacritic Restoration via Fine-tuning Multimodal Arabic LLM
Year: 2025
Type: conference-paper
Abstract: We present GEMM3N-DR, a multimodal system for NADI 2025 Subtask 3 (Spoken Arabic Diacritic Restoration).GEMM3N-DR finetunes the Gemma 3N LLM via Low-Rank Adaptation (LoRA) using only the official NADI training data, taking both audio and undiacritized text as input and generating fully diacritized output.We apply data augmentation with the nlpaug and the CATT diacritization model.At inference time, we use a structured Arabic instruction and 7-shot examples.Our system achieved a Word Error Rate (WER) of 64% and Character Error Rate (CER) of 15% on the hidden test set, ranking in 2nd place in the competition.We provide a detailed analysis of model performance, including common error types such as hallucination and incomplete outputs.
Author: Mohamed Lotfy Elrefai
Institution: Ain Shams University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4416037769