The OPUS Resource Repository: An Open Package for Creating Parallel Corpora and Machine Translation Services.
Year: 2019
Type: article
Abstract: This paper presents a flexible and powerful system for creating parallel corpora and for running neural machine translation services.Our package provides a scalable data repository backend that offers transparent data pre-processing pipelines and automatic alignment procedures that facilitate the compilation of extensive parallel data sets from a variety of sources.Moreover, we develop a web-based interface that constitutes an intuitive frontend for end-users of the platform.The whole system can easily be distributed over virtual machines and implements a sophisticated permission system with secure connections and a flexible database for storing arbitrary metadata.Furthermore, we also provide an interface for neural machine translation that can run as a service on virtual machines, which also incorporates a connection to the data repository software.
Authors: Mikko Aulamo, Jörg Tiedemann
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funder: China Scholarship Council
OpenAlex ID: W2982407184