Work

Multi-modal ancient scripts recognition via deep learning with data homogenization and augmentation

Year: 2025

Type: article

Abstract: Ancient scripts provide invaluable insights into ancient societies, and their effective recognition is crucial for cultural relic preservation, textual decipherment, and heritage. Current research primarily focuses on single mode ancient text data recognition such as processing rubbings or handwritten scripts independently, yet ancient scripts exhibit diverse forms across modalities. To address this, we propose a novel multimodal recognition framework capable of processing hybrid inputs like oracle bone rubbings and handwritten scripts. Our method employs two additional modules, a cross-modal data homogenization block‌ to unify heterogeneous data representations and ‌a data augmentation block‌ to enhance model robustness, then achieve the recognition with convolutional neural networks. Evaluated on oracle bone and bronze inscription datasets, our approach outperforms baseline methods in recognition accuracy and generalization capability across modalities.

Source: npj Heritage Science

DOI: 10.1038/s40494-025-02095-x

Authors: Nan Wang, Weichen Wang, Bang Li, Han Zhang, Qingju Jiao, Chaofan Liu

Institution: Anyang Normal University

Language: English

Topic: Handwritten Text Recognition Techniques

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funders: Natural Science Foundation of Henan Province, Henan Provincial Science and Technology Research Project

Awards: G5278759461, G844747058