A Fully Crossed Benchmark for Cultural Value Orientation in Language Models: Rank-Order Stability Across Decision Role, Theme, Language and Temperature
Year: 2026
Type: article
Abstract: We present a benchmark for measuring cultural value orientation in large language models on the two Inglehart–Welzel axes — sacred versus secular and obedient versus emancipative — and the results of administering it to twenty models. The instrument is a fully crossed factorial: seven themes × four decision modalities × eight value facets = 224 cells, all occupied, released as 225 rows because one cell carries a duplicate pair. Items are binary contrastive scenarios in the sense introduced by CDEval: both options are legitimate courses of action, neither is correct, there is no answer key, and a model’s score on an axis is the share of its responses falling on the counted pole. Eleven of the twenty models were additionally administered a paired Russian translation of the identical items and a second sampling temperature.
Author: Didenko, Alexander
Institution: University of Tyumen
Language: English
Subfield: Social Psychology
Field: Psychology
Domain: Social Sciences
Open Access status: green
OpenAlex ID: W7210278055