Year: 2017
Type: conference-paper
Abstract: Machine translation is a natural candidate problem for reinforcement learning from human feedback: users provide quick, dirty ratings on candidate translations to guide a system to improve.Yet, current neural machine translation training focuses on expensive human-generated reference translations.We describe a reinforcement learning algorithm that improves neural machine translation systems from simulated human feedback.Our algorithm combines the advantage actor-critic algorithm (Mnih et al., 2016) with the attention-based neural encoderdecoder architecture (Luong et al., 2015).This algorithm (a) is well-designed for problems with a large action space and delayed rewards, (b) effectively optimizes traditional corpus-level machine translation metrics, and (c) is robust to skewed, high-variance, granular feedback modeled after actual human behaviors.
DOI: 10.18653/v1/d17-1153
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Funder: National Science Foundation
Awards: Collaborative Research: Scaling Insight into Science: Assessing the value and effectiveness of machine assisted classification within a statistical system, RI: Small: Linguistic Semantics and Discourse from Leaky Distant Supervision, RI: Small: Bayesian Thinking on Your Feet---Embedding Generative Models in Reinforcement Learning for Sequentially Revealed Data, CHS: Medium: Hyperlocal and Hypertemporal Information in Mass Emergencies Events: Next Generation Crisis Informatics Data Collection and Analytics, III: Medium: Collaborative Research: Closing the User-Model Loop for Understanding Topics in Large Document Collections, CAREER: Human-Computer Cooperation for Word-by-Word Question Answering
OpenAlex ID: W2737114849
