A Survey on Evaluation Metrics for Backchannel Prediction Models
Year: 2012
Type: conference-paper
Abstract: In this paper we give an overview of the evaluation metrics used to measure the performance of backchannel prediction models. Both objective and subjective evaluation metrics are discussed. The survey shows that almost every backchannel prediction model is evaluated with a different evaluation metric. This makes comparison between developed models unreliable, even beside the other variables in play, such as different corpora, language, conversational setting, amount of data and/or denition of the term backchannel.
Authors: I.A. de Kok, Dirk Heylen
Institution: University of Twente
Language: English
Topic: Speech and dialogue systems
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W1603671614
