Neural Models for Large-Scale Semantic Role Labelling
Year: 2018
Type: dissertation
Abstract: Recovering predicate-argument structures from natural language sentences is an important task in natural language processing (NLP), where the goal is to identify "who did what to whom" with respect to events described in a sentence.A key challenge in this task is sparsity of labeled data: a given predicate-role instance may only occur a handful of times in the training set.While attempts have been made to collect large, diverse datasets which could help mitigate this sparseness, these effort are hampered by the difficulty inherent in labelling traditional SRL formalisms such as PropBank and FrameNet.We take a two-pronged approach to solving these issues.First, we develop models which can be used to jointly represent multiple SRL annotation schemes, allowing us to pool annotations between multiple datasets.We present a new method for semantic role labeling in which arguments and semantic roles are jointly embedded in a shared vector space for a given predicate.We further show how the model can learn jointly from PropBank and FrameNet annotations to obtain additional improvements on the smaller FrameNet dataset.Next, we demonstrate that crowdsourcing techniques can be used to collect a large, high-quality SRL dataset at much lower cost than previous methods, and that this data can be used to learn a highquality SRL parser.Our corpus, QA-SRL Bank 2.0, consists of over 250,000 question-answer pairs for over 64,000 sentences across 3 domains and was gathered with a new crowd-sourcing scheme that we show has high precision and good recall at modest cost.We also present neural models for two QA-SRL subtasks: detecting argument spans for a predicate and generating questions to label Completing a PhD is impossible without the help and support of many wonderful people.I owe a deep debt of gratitude to my advisor Luke Zettlemoyer, who has been my greatest guide and advocate throughout this journey -indulging me in my exuberance, coaching me through the disappointments, and helping me pick my way through the difficult terrain that is a PhD.Thank you to the other members of my committee, Noah Smith and Yejin Choi, to Dieter Fox, who provided valuable guidance early in my program, and to the late Ben Taskar.
Author: Nicholas FitzGerald
Institution: University of Washington
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2945495342
