Performance Assessment of ML and DL Models in Detecting Hate Speech from Mixed English–Roman Urdu Text with Small-Scale Datasets
Year: 2025
Type: article
Abstract: This research evaluates hate speech detection across a minimal-size Mixed English and Roman Urdu language intersection through machine learning and deep learning model analysis. For traditional models, the data required text cleaning alongside tokenization and TF-IDF vectorization to participate in the same experiment, as deep learning models needed trainable embeddings. Experiment results between Naive Bayes, Logistic Regression, Linear SVM, Random Forest, LSTM, BiLSTM, and CNN demonstrated that Logistic Regression produced the greatest F1 score of 0.8073. CNN was the most effective choice among deep learning models, scoring an F1 score of 0.7786. The research demonstrates that traditional models perform well on small-scale datasets; however, deep learning has evolved as an effective tool for processing code-mixed text. In the future, Researchers should examine pre-trained embeddings, larger datasets, and advanced models to raise detection abilities for hate speech in mixed-language text.
Authors: Husnain Saleem, Muhammad Javed, Abdulrhman Alahmadi, Ibrahim Aljubayri, Mohammad Zubair Khan, Junaid
Institutions: Gomal University, Taibah University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
SDG: Reduced inequalities
Open Access status: bronze
OpenAlex ID: W4411887285