NYUAD at MAHED Shared Task: Detecting Hope, Hate, and Emotion in Arabic Textual Speech and Multi-modal Memes Using Large Language Models
Year: 2025
Type: conference-paper
Abstract: The rise of social media and online communication platforms has led to the spread of Arabic textual posts and memes as a key form of digital expression.While these contents can be humorous and informative, they are also increasingly being used to spread offensive language and hate speech.Consequently, there is a growing demand for precise analysis of content in Arabic text and meme.This paper explores the potential of large language models to effectively identify hope, hate speech, offensive language, and emotional expressions within such content.We evaluate the performance of base LLMs, fine-tuned LLMs, and pre-trained embedding models .The evaluation is conducted using a dataset of Arabic textual speech and memes proposed in the ArabicNLP MAHED 2025 challenge.The results underscore the capacity of LLMs such as GPT-4omini, fine-tuned with Arabic textual speech, and Gemini Flash 2.5, fine-tuned with Arabic memes, to deliver the superior performance.They achieve up to 72.1%, 57.8%, and 79.6% macro F1 scores for task 1, 2, and 3, respectively and secure first place overall in the challenge 1 (Zaghouani et al., 2025).The proposed solutions offer a more nuanced understanding of both text and memes for accurate and efficient Arabic content moderation systems.
Authors: Nouar AlDahoul, Yasir Zaki
Institution: New York University Abu Dhabi
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4416037837