Work

Semantic embeddings reveal and address taxonomic incommensurability in psychological measurement

Year: 2025

Type: article

Abstract: Taxonomic incommensurability denotes the difficulty in comparing scientific theories due to different uses of concepts and operationalizations. To tackle this problem in psychology, here we use language models to obtain semantic embeddings representing psychometric items, scales and construct labels in a vector space. This approach allows us to analyse different datasets (for example, the International Personality Item Pool) spanning thousands of items and hundreds of scales and constructs and show that embeddings can be used to predict empirical relations between measures, automatically detect taxonomic fallacies and suggest more parsimonious taxonomies. These findings suggest that semantic embeddings constitute a powerful tool for tackling taxonomic incommensurability in the psychological sciences.

Source: Nature Human Behaviour

DOI: 10.1038/s41562-024-02089-y

Authors: Dirk U. Wulff, Rui Mata

Institutions: University of Basel, Max Planck Institute for Human Development

Language: English

Topic: Psychometric Methodologies and Testing

Subfield: Management Science and Operations Research

Field: Decision Sciences

Domain: Social Sciences

Open Access status: hybrid

Estimated APC paid: $12,690

Funders: National Science Foundation, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung, Max-Planck-Gesellschaft