Work

Semi-supervised Contextual Historical Text Normalization

Year: 2020

Type: conference-paper

Abstract: Historical text normalization, the task of mapping historical word forms to their modern counterparts, has recently attracted a lot of interest (Bollmann, 2019;Tang et al., 2018;Lusetti et al., 2018;Bollmann et al., 2018;Robertson and Goldwater, 2018;Bollmann et al., 2017;Korchagina, 2017).Yet, virtually all approaches suffer from the two limitations: 1) They consider a fully supervised setup, often with impractically large manually normalized datasets; 2) Normalization happens on words in isolation.By utilizing a simple generative normalization model and obtaining powerful contextualization from the target-side language model, we train accurate models with unlabeled historical data.In realistic training scenarios, our approach often leads to reduction in manually normalized data at the same accuracy levels.

Source: Annual Meeting of the Association for Computational Linguistics (ACL)

DOI: 10.18653/v1/2020.acl-main.650

Authors: Peter Makarov, Simon Clematide

Institution: University of Zurich

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funders: National Science Foundation, Schweizerischer Nationalfonds zur Förderung der Wissenschaftlichen Forschung

Award: Media Monitoring of the Past