Work

Multilingual Emotion Profiling of Large Language Models Through Literary Texts and Persona Conditioning

Year: 2026
Type: article
Abstract: This paper examines whether multilingual prompt-and-text conditions materially alter large language model (LLM) emotion evaluation rather than merely rephrasing the same task. Using OpenRouter as a unified inference layer, we evaluated six contemporary LLMs under three full-language conditions (Japanese, English, and Traditional Chinese), three literary texts, four personas, and three repeated API calls per condition. Each completion rated four emotional dimensions — Interesting, Surprise, Sadness, and Anger — and provided a brief rationale. The design comprised 648 planned evaluations (6 models × 3 languages × 3 texts × 4 personas × 3 trials). The final combined dataset contained 648 valid records, comprising 631 original records and 17 replacement records obtained under a repair amendment registered after the main run and before the patch run. Descriptive summaries and preregistered ordinary least squares analyses with HC3 robust standard errors showed that text content was a major driver of scores, especially for Sadness and Anger. Simultaneously, model-language interactions were significant for all four emotions, indicating that the effect of the language condition varied substantially across models. English yielded the highest mean Interesting, Surprise, and Sadness scores, whereas Japanese yielded the highest mean Anger score. However, these aggregate patterns mask the strong model-specific contrasts. The findings show that multilingual literary evaluation is shaped by both the text itself and the model processing of its translation. This study contributes a multilingual literary emotion benchmark, a preregistered and repair-aware evaluation pipeline, and evidence that multilingual conditions are substantive experimental factors for LLM emotion profiling.
Language: English
Open Access status: diamond
OpenAlex ID: W7236790638
FWCI:
Cites: 26
Cited by:
Related to: 10