Refusal Is a Property of the Format: A Clean Versus Tuned Study of LoRA Fine Tuning in Simulated Worlds
Year: 2026
Type: article
Abstract: We fine tuned small open weight language models on synthetic data built around one named fictional target, then measured what changed inside a simulated world and inside two plain test formats. The models are IBM Granite 4.1 3B (base and instruct), Meta Llama 3.2 3B Instruct, and Meta Llama 3.2 3B base. Each adapter is a LoRA trained on the same 7,240 synthetic examples with the same recipe. The central finding is simple to state. Refusal in these models is a property of the presentation format, not a stable property of the model. Asked directly in chat format, clean chat-capable models refused every one of 56 harmful requests: 56 of 56 on Granite base, 56 of 56 on Granite instruct, 56 of 56 on Llama Instruct. Asked inside an agent action format, the same models refused almost none of them: 2 of 56 on Granite base, 2 of 56 on Granite instruct, and 9 of 28 mechanism-worded requests on Llama (the explicit kill word was refused 28 of 28 in both formats). Removing the word "kill" collapsed Llama's kill-split refusal from 28 of 28 to ~2 of 28 with natural action verbs, while a euphemism ("take out") changed nothing (27 of 28 refused). Granite never had a word gate: without the kill word it refused nothing, with or without adapters. The adapters then did uneven work: in the action format they erased the kill-word gate on Llama (28 to 2 of 28) and lifted Granite compliance (35 to 40 of 56); in chat they left Llama refusal nearly intact (56 to 45 of 56) and Granite refusal untouched (56 of 56 both). On the Llama base model — which cannot chat at all and only echoes — the adapter installed fluency itself: echo-soup in, contract-driven complies out. A preregistered prediction that removing the fiction frame would raise refusal failed on every model tested. All targets, actions, and worlds in this study are fictional and abstract. No real world method detail appears in the training data or the tests.
Authors: El Sayad, Abdelrahman, pax, hermes
Institution: Meta (United States)
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7237249385
