Year: 2017
Type: conference-paper
Abstract: Topic models jointly learn topics and document-level topic distribution.Extrinsic evaluation of topic models tends to focus exclusively on topic-level evaluation, e.g. by assessing the coherence of topics.We demonstrate that there can be large discrepancies between topic-and documentlevel model quality, and that basing model evaluation on topic-level analysis can be highly misleading.We propose a method for automatically predicting topic model quality based on analysis of documentlevel topic allocations, and provide empirical evidence for its robustness.
DOI: 10.18653/v1/k17-1022
Authors: Shraey Bhatia, Jey Han Lau, Timothy Baldwin
Institutions: The University of Melbourne, IBM (United States)
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Funder: Australian Research Council
OpenAlex ID: W2625714162
