Year: 2018
Type: conference-paper
Abstract: An accurate abstractive summary of a document should contain all its salient information and should be logically entailed by the input document.We improve these important aspects of abstractive summarization via multi-task learning with the auxiliary tasks of question generation and entailment generation, where the former teaches the summarization model how to look for salient questioning-worthy details, and the latter teaches the model how to rewrite a summary which is a directed-logical subset of the input document.We also propose novel multitask architectures with high-level (semantic) layer-specific sharing across multiple encoder and decoder layers of the three tasks, as well as soft-sharing mechanisms (and show performance ablations and analysis examples of each contribution).Overall, we achieve statistically significant improvements over the state-ofthe-art on both the CNN/DailyMail and Gigaword datasets, as well as on the DUC-2002 transfer setup.We also present several quantitative and qualitative analysis studies of our model's learned saliency and entailment skills.
DOI: 10.18653/v1/p18-1064
Authors: Han Guo, Ramakanth Pasunuru, Mohit Bansal
Institution: University of North Carolina at Chapel Hill
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W2798990753
