Flipper: An Extended Document-Level Financial Dataset for Training and Evaluation with Annotated Discourse Phenomena
Year: 2026
Type: conference-paper
Abstract: We present a new resource for Machine Translation (MT), namely a training and evaluation dataset containing parallel documents issued from authentic data in the financial domain.We cover five language pairs: English-French, English-Spanish, English-German, English-Italian and French-Spanish.The total number of parallel documents is 122k and the number of tokens is 118M (source and target combined).MT has improved greatly in recent years, but certain phenomena still cause errors, particularly when context spans beyond a single sentence.Errors can lead to mistranslated pronouns, incorrect gender or number agreement, and inconsistent terminology, which can be especially problematic in high-stakes domains like finance.We therefore construct the dataset at document level (rather than sentence-level) and also produce fine-grained annotations of context-sensitive phenomena.The annotation was performed using preexisting tools and custom scripts.Thus the process can be replicated on different parallel data from other domains.The annotated phenomena are: formality, gender, terminology consistency, verb form and sentence reordering.This aims to improve document-level evaluation of MT models by enabling evaluation solely on texts containing a particular phenomenon of interest.Our primary contribution is the creation and public release of Flipper, a multilingual document-level parallel dataset in the financial domain, designed to support both training and targeted evaluation of context-sensitive machine translation.
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7166570442