Hierarchical Recurrent Attention Network for Response Generation
Year: 2018
Type: conference-paper
Abstract: We study multi-turn response generation in chatbots where a response is generated according to a conversation context. Existing work has modeled the hierarchy of the context, but does not pay enough attention to the fact that words and utterances in the context are differentially important. As a result, they may lose important information in context and generate irrelevant responses. We propose a hierarchical recurrent attention network (HRAN) to model both the hierarchy and the importance variance in a unified framework. In HRAN, a hierarchical attention mechanism attends to important parts within and among utterances with word level attention and utterance level attention respectively.
Authors: Chen Xing, Yu Wu, Wei Wu, Yalou Huang, Ming Zhou
Institutions: Nankai University, Beihang University, Microsoft (United States)
Language: English
Topic: Speech and dialogue systems
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Keywords: chatbots, word-level attention
Open Access status: diamond
Awards: G2511088089, G4665830920
OpenAlex ID: W2584185835
