Work

Filtering Matters: Experiments in Filtering Training Sets for Machine Translation

Year: 2023
Type: article
Abstract: We explore different approaches for filtering parallel data for MT training, whether the same filtering approaches suit different datasets, and if separate filters should be applied to a dataset depending on the translation direction.We evaluate the results of different approaches, both manually and on a downstream NMT task.We find that, first, it is beneficial to inspect how well different filtering approaches suit different datasets and, second, that while MT systems trained on data prepared using different filters do not differ substantially in quality, there is indeed a statistically significant difference.Finally, we find that the same training sets do not seem to suit different translation directions.
Language: English
Open Access status: green
OpenAlex ID: W7047431754
FWCI: 0.344
Cites: 45
Cited by: 6
Related to: 10