Work

AI against abuse: real-time protection and detection of unsafe content from visual and verbal threats on social media

Year: 2026
Type: article
Abstract: With the rapid growth of video content on platforms such as Instagram and YouTube, the spread of harmful and illegal material by unauthenticated users has become a serious concern, particularly for children, youth, and other vulnerable audiences. This paper presents a real-time, AI-driven multimodal content moderation system implemented to detect and control unsafe content, including nudity, profanity, gore, violence, and hate speech, in both live streams and uploaded videos. The system integrates DeepLabV3 + for semantic segmentation and Faster R-CNN for object detection to analyze visual elements, while Wav2Vec 2.0 and a CNN are used to identify abusive speech and ambient threats such as gunshots and screams. BERT is employed to detect toxic and hate speech in video-related text. A priority-based Directed Acyclic Graph (DAG) scheduler orchestrates these models for efficient execution and load balancing, and Firefly Optimization is used for hyperparameter tuning to enhance accuracy. The implemented multimodal system achieves an overall detection accuracy of 98.33%, and includes a customizable Content Sentinel module that enables real-time actions such as skipping flagged segments. This solution promotes ethical video sharing and offers a scalable approach to content moderation across social media platforms.
Institution: Vels University
Language: English
Open Access status: gold
Estimated APC paid: $2,690
OpenAlex ID: W7236104790
FWCI:
Cites: 7
Cited by:
Related to: 10