Sentence level machine translation evaluation as a ranking problem: one step aside from BLEU
Year: 2007
Type: conference-paper
Abstract: The paper proposes formulating MT evaluation as a ranking problem, as is often done in the practice of assessment by human.Under the ranking scenario, the study also investigates the relative utility of several features.The results show greater correlation with human assessment at the sentence level, even when using an n-gram match score as a baseline feature.The feature contributing the most to the rank order correlation between automatic ranking and human assessment was the dependency structure relation rather than BLEU score and reference language model feature.
Authors: Yang Ye, Ming Zhou, Chin-Yew Lin
Institutions: University of Michigan, Microsoft Research Asia (China)
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: bronze
OpenAlex ID: W2170852307
