Automatically Coding Economic Activities via Semantic Search
Year: 2026
Type: article
Abstract: Automated coding of free-text descriptions is a core challenge for National Statistical Institutes (NSIs), which must map colloquial respondent inputs to official taxonomies under strict reliability and transparency requirements. Rule-based systems, the current standard, demand extensive, ongoing human effort to author and maintain the large manual rule sets needed to cover the diversity of real world inputs. This paper evaluates embedding-based semantic retrieval as a lower-maintenance alternative, using the Italian ATECO classification as the empirical setting. We compare several knowledge base construction strategies across seven sentence transformer models (ranging from 118 million to 8 billion parameters), evaluated against 33,544 real-world queries labelled by CIRCE, Istat’s operational rule-based coder, at the 5-digit and 2-digit levels. Moderate-size models (300–700 million parameters) are competitive with much larger ones, achieving Hit@5 above 0.82 and 0.94 at the respective levels. Query length is a significant performance driver, and manual mismatch analysis reveals that roughly one in five disagreements with CIRCE reflect label noise rather than retrieval errors. Embedding-based retrieval thus offers competitive performance with no task-specific training data and a fraction of the human labour required by rule-based approaches.
Source: Journal of Official Statistics
Authors: Francesco Ortame, Mauro Bruno
Institution: Istituto Nazionale di Statistica
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
OpenAlex ID: W7225648839