Text content and task performance in the evaluation of a Natural Language Generation system
Year: 2009
Type: conference-paper
Abstract: An important question in the evaluation of Natural Language Generation systems concerns the relationship between textual characteristics and task performance. If the results of task-based evaluation can be correlated to properties of the text, there are better prospects for improving the system. Thepresent paper investigates this relationship by focusing on the outcomes of a task-based evaluation of a system that generates summaries of patientdata, attempting to correlate these with the results of an analysis of the system’s texts, compared to a set of gold standard human-authored summaries.
Source: OAR@UM (University of Malta)
Authors: Gatt, Albert, Portet, Francois, International Conference RANLP - 2009 /Recent Advances in Natural Language Processing
Institution: University of Aberdeen
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W172519568