Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge
Year: 2018
Type: conference-paper
Abstract: We introduce a neural reading comprehension model that integrates external commonsense knowledge, encoded as a keyvalue memory, in a cloze-style setting.Instead of relying only on document-toquestion interaction or discrete features as in prior work, our model attends to relevant external knowledge and combines this knowledge with the context representation before inferring the answer.This allows the model to attract and imply knowledge from an external knowledge source that is not explicitly stated in the text, but that is relevant for inferring the answer.Our model improves results over a very strong baseline on a hard Common Nouns dataset, making it a strong competitor of much more complex models.By including knowledge explicitly, our model can also provide evidence about the background knowledge used in the RC process.
DOI: 10.18653/v1/p18-1076
Authors: Todor Mihaylov, Anette Frank
Institutions: Heidelberg University, Technische Universität Darmstadt
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Funder: Deutsche Forschungsgemeinschaft
Award: G481299621
OpenAlex ID: W2803457824
