Year: 2025
Type: conference-paper
Abstract: Large language models (LLMs) generate human-like text, raising concerns about their misuse in creating deceptive content.Detecting LLM-generated comments (LGC) in online news is essential for preserving online discourse integrity and preventing opinion manipulation.However, effective detection faces two key challenges: the brevity and informality of news comments limit traditional detection methods, while the lack of publicly available LGC datasets hinders model development, particularly for non-English languages.To address these challenges, we propose a twofold approach.First, we develop an LGC generation framework to construct a high-quality dataset with diverse and complex examples.Second, we introduce XDAC (XAI-Driven Detection and Attribution of LLM-Generated Comments), a framework utilizing explainable AI, designed for the detection and attribution of short-form LGC in Korean news articles.XDAC leverages XAI to uncover distinguishing linguistic patterns at both token and character levels.We present the first large-scale benchmark dataset, comprising 1.3M human-written comments from Korean news platforms and 1M LLM-generated comments from 14 distinct models.XDAC outperforms existing methods, achieving a 98.5% F1 score in LGC detection with a relative improvement of 68.1%, and an 84.3% F1 score in attribution.To validate real-world applicability, we analyze 5.24M news comments from Naver, South Korea's leading online news platform, identifying 27,029 potential LLM-generated comments.
Authors: Wooyoung Go, Hyoungshick Kim, Alice Oh, Yongdae Kim
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4412944761