Is ChatGPT conservative or liberal? A novel approach to assess ideological stances and biases in generative LLMs
Year: 2025
Type: article
Abstract: Extant work shows that generative AI such as GPT-3.5 and perpetuate social stereotypes and biases. A less explored source of bias is ideology: do GPT models take ideological stances on politically sensitive topics? We develop a novel approach to identify ideological bias and show that it can originate in both the training data and the filtering algorithm. Using linguistic variation across countries with contrasting political attitudes, we evaluate average GPT responses in those languages. GPT output is more conservative in languages conservative societies (polish) and more liberal in languages used in liberal ones (Swedish). These differences persist from GPT-3.5 to GPT-4. We conclude that high-quality, curated training data are essential for reducing bias.
Authors: Christina P. Walker, Joan C. Timoneda
Institution: Purdue University West Lafayette
Language: English
Subfield: Safety Research
Field: Social Sciences
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $3,550
OpenAlex ID: W4416942090