Year: 2026
Type: preprint
Abstract: Large language models (LLMs) exhibit us-vs.-them bias: A behavioral asymmetry in which prompts framed around an ingroup (``we''/``us'') receive systematically more positive continuations than matched prompts framed around an outgroup (``they''/``them''). Using Edge Attribution Patching (EAP), we localize this behavior to directed circuits in GPT-2 Small, GPT-2 Large, Llama-2 7B, and Llama-3 8B. Across models, high-attribution edges are sparse and concentrated primarily in middle-to-late layers, while ingroup- and outgroup-related pathways are only partially overlapping and reorganize under fine-tuning. Behavioral comparisons and 30-token generations show that the measured asymmetry extends beyond next-token evaluation. Targeted patching of EAP-ranked edges reduces the bias score more than equal-cardinality random-edge controls, but also substantially degrades performance on CoLA, HellaSwag, and WikiText-2, suggesting that bias-relevant pathways are functionally entangled with broader language capabilities. Overall, our findings characterize us-vs.-them bias as a sparse, context-dependent, and functionally entangled computational phenomenon whose internal organization varies across the models examined.
Source: arXiv (Cornell University)
Institution: University of Vermont
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funder: National Science Foundation
OpenAlex ID: W7221188398