Work

Automated occupation coding with hierarchical features: a data-centric approach to classification with pre-trained language models

Year: 2023

Type: article

Abstract: Occupation coding is the classification of information on occupation that is collected in the context of demographic variables. Occupation coding is an important, but a tedious task for researchers in social science and official statistics that calls for automation. Due to the complexity of the task, currently, researchers carry out hand-coding or computer-assisted coding. However, we argue that, with the rise of transformer-based language models, hand-coding can be displaced by models, such as BERT or GPT3. Hence, we compare these models with state-of-the-art encoding approaches, showing that language models have a clear advantage in Cohen’s kappa compared to related approaches, but also allow for flexible fine-grained coding of single digits. Taking into consideration the hierarchical structure of the occupational group, we also develop an approach that achieves better performance for the classification of different single digit combinations.

Source: Discover Artificial Intelligence

DOI: 10.1007/s44163-023-00050-y

Authors: Parisa Safikhani, Hayastan Avetisyan, Dennis Föste-Eggers, David Broneske

Institution: German Centre for Higher Education Research and Science Studies

Language: English

Topic: Computational and Text Analysis Methods

Subfield: General Social Sciences

Field: Social Sciences

Domain: Social Sciences

SDG: Decent work and economic growth

Open Access status: gold

Estimated APC paid: $1,340