Work

Annotating and Modeling Shallow Semantics Directly from Text

Year: 2018
Type: dissertation
Abstract: One key challenge to understanding human language is to find out the word to word semantic relations, such as "who does what to whom", "when", and "where".Semantic role labeling (SRL) is the widely studied challenge of recovering such predicate-argument structure.SRL is designed to be consistent across syntactic alternations , which can potentially benefit downstream applications such as information extraction, machine translation, and summarization.However, the performance of SRL system is limited by the amount of training data and its dependence on the intermediate syntactic representation.In this thesis, our goal is to develop annotation frameworks and learning models for recovering semantic structures directly from text, in an end-to-end manner.We first introduce question-answer driven semantic role labeling (QA-SRL), an annotation framework that allows us to gather SRL information from non-expert annotators.Different from the traditional SRL formalisms (e.g.PropBank), this new task does not depend on predefined syntactic structure or frame ontology.It is simple and intuitive enough that we can train any native speaker to provide annotation, as long as they can understand the meanings of sentences.We also develop two general-purpose, syntax-independent neural models that lead to significant performance gains, including a over 40% error reduction over long-standing pre-neural performance levels on PropBank.Our first model, DeepSRL, uses highway BiLSTMs to make local BIO-tagging decisions for each token.While significantly out-performing previous systems, Deep-SRL cannot jointly process multiple predicates or incorporate span-level features.To address these limitations, we further introduce a span-based neural model called the Labeled Span Graph Networks (LSGNs).Inspired by a recent state-of-the-art coreference resolution model, LSGNs build contextualized representations for all spans in the input text, and use lightweight classifiers to make independent edge labeling decisions.With LSGNs, we are able to model all predicate words and argument spans jointly, the first end-to-end result we know of.LSGNs also lead to a unified view for many NLP structures involving span-labeling or span-span relations.In addition to SRL and coreference resolution, LSGNs also achieve state-of-the-art performance when applied to named entity recognition (NER) without any feature engineering.This opens up exciting future directions to build a single, unified model for end-to-end, document-level semantic analysis.My five years at the University of Washington is the happiest, most productive time in my life so far.I am extremely lucky to be a part of this amazing community where I was surrounded by many smart and supportive people.First, I would like to express my sincerest gratitude to my advisor Luke Zettlemoyer.He has always been tremendously encouraging and patient.He gives me both freedom and guidance, and encourages me to take risks and make my own decisions.
Author: Luheng He
Language: English
Open Access status: green
OpenAlex ID: W2921798689
Cites: 67
Cited by: 1
Related to: 10