Reliability of Sampling Methods’ Representativeness in Decision-Making on the Use of OCR in Archives
Year: 2026
Type: article
Abstract: This study examines whether commonly used sampling methods provide reliable and representative evidence for selecting optimal optical character recognition (OCR) configurations in archival digitization projects. Because OCR performance directly affects the informational value, authenticity, and long-term usability of digital records, reliable sampling is essential for evidence-based decision-making. The objective was to evaluate the influence of simple random, systematic random, and stratified random sampling on OCR accuracy and to determine whether sampling strategy affects the selection of OCR systems and digitization settings. A dataset of 3,634 Croatian-language archival pages (approximately 1.45 million words) was digitized and evaluated using three OCR systems. The results showed that different sampling methods produced substantially different OCR rankings and error rates, and that the effects of sampling method, OCR system, and their interaction were all statistically significant (ANOVA, p ≤ 0.05). These findings demonstrate that sampling strategy can influence OCR performance and may introduce bias into technology selection. Consequently, sampling should not be used as the sole basis for configuring large-scale digitization workflows but rather as one component of a broader, evidence-based evaluation framework, with implications extending to AI and machine learning applications that depend on representative training data.
Authors: Hrvoje Stančić, Željko Trbušić
Language: English
Subfield: Conservation
Field: Arts and Humanities
Domain: Social Sciences
Open Access status: diamond
OpenAlex ID: W7228050072
