A Hybrid Template-Guided Deep Learning Framework for OCR-Oriented Restoration of Degraded Tax Documents
Year: 2026
Type: article
Abstract: Degraded tax forms and other legal-administrative documents require restoration methods that impose strict constraints on content fidelity. This paper presents a structure-aware restoration framework for degraded tax documents that combines geometric normalization, canonical template guidance, and supervised image restoration within a common alignment space. Documents are first mapped to a canonical layout through homography estimation based on Scale-Invariant Feature Transform (SIFT) and Random Sample Consensus (RANSAC), using a master template as a reference. Restoration is then performed using template priors and masked constraints designed to preserve the fixed document structure while recovering variable content. Under a fixed-budget comparative protocol, U-Net with template priors achieved the highest visual and structural quality, whereas the proposed hybrid model obtained the best functional OCR performance on synthetic data, reaching a Character Error Rate (CER) of 0.1091 and a Word Error Rate (WER) of 0.3495. As a complementary evaluation on 37 real-world documents with human-generated textual ground truth, restoration increased full-page word coverage across all three OCR engines evaluated, yielding absolute improvements ranging from 4.15 to 18.05 percentage points.
Source: Computers
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $2,172
OpenAlex ID: W7170143528