Work

Detecting Error in AI-Generated Text: The Effects of Authorship and Word Presentation Speed

Year: 2026
Type: article
Abstract: The increased us of artificial intelligent (AI) chatbots powered by Generative Pre-trained Transformers has raised concerns about users’ ability to detect errors of AI-generated text. This dissertation examined how readers identify inconsistencies in AI-generated expository passages using the inconsistency detection paradigm from comprehension monitoring research. Across two experiments, it investigated whether perceived authorship and word presentation speed influenced inconsistency detection. Experiment 1 used a 3 (author: human, AI, no author) × 2 (inconsistency type: internal, external) between-subjects design. Perceived authorship did not significantly affect hit rates, sensitivity, or response bias. Exploratory analyses indicated that reading comprehension and working memory predicted error detection. Experiment 2 used a 2 (inconsistency type: internal, external) × 3 (word presentation speed: 100, 300, 600 words per minute [WPM]) between-subjects design to examine effects on inconsistency detection and attitudes toward AI. Competing predictions were derived from system attitudes research, which suggests that faster systems are evaluated positively, and cognitive psychology, which predicts that presentation may impair comprehension. Participants in the 100 WPM condition had significantly higher hit rates and a more liberal response bias than those in the 600 WPM condition, suggesting that slower presentation enhanced inconsistency detection. Presentation speed did not influence sensitivity or attitudes toward AI. Overall, the findings supported the cognitive perspective but not the system attitudes perspective. These results extend comprehension monitoring research by showing how external factors such as speed may shape inconsistency detection and inform chatbot design by demonstrating that speed can affect whether users notice and evaluate errors.
Language: English
Field: Psychology
Open Access status: green
OpenAlex ID: W7204504712
FWCI:
Cites: 100
Cited by:
Related to: 9