Frank at ArAIEval Shared Task: Arabic Persuasion and Disinformation: The Power of Pretrained Models
Year: 2023
Type: conference-paper
Abstract: In this work, we present our systems developed for "ARAIEVAL" shared task of ArabicNLP 2023 (Hasanain et al., 2023a).We used an mBERT transformer for Subtask 1A, which targets persuasion in Arabic tweets, and we used the MARBERT transformer for Subtask 2A to identify disinformation in Arabic tweets.Our persuasion detection system achieved micro-F1 of 0.745 by surpassing the baseline by 13.2%, and registered a macro-F1 of 0.717 based on leaderboard scores.Similarly, our disinformation system recorded a micro-F1 of 0.816, besting the naïve majority by 6.7%, with a macro-F1 of 0.637.Furthermore, we present our preliminary results on a variety of pre-trained models.In terms of overall ranking, our systems placed 7 th out of 16 and 12 th out of 17 teams for Subtasks 1A and 2A, respectively.
Authors: Dilshod Azizov, Jiyong Li, Shangsong Liang
Institution: Sun Yat-sen University
Language: English
Subfield: Sociology and Political Science
Field: Social Sciences
Domain: Social Sciences
Open Access status: hybrid
OpenAlex ID: W4389518191