Year: 2018
Type: conference-paper
Abstract: Despite their superior performance, deep learning models often lack interpretability.In this paper, we explore the modeling of insightful relations between words, in order to understand and enhance predictions.To this effect, we propose the Self-Attention Network (SANet), a flexible and interpretable architecture for text classification.Experiments indicate that gains obtained by self-attention is task-dependent.For instance, experiments on sentiment analysis tasks showed an improvement of around 2% when using selfattention compared to a baseline without attention, while topic classification showed no gain.Interpretability brought forward by our architecture highlighted the importance of neighboring word interactions to extract sentiment.
DOI: 10.18653/v1/w18-5429
Institution: Université Laval
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W2914713622
