Year: 2020
Type: dissertation
Abstract: Information extraction transforms unstructured text to structured by annotating semantic information on raw data.A crucial step in information extraction is relation extraction, which identifies semantic relationships between named entities in text.The resulting relations can be used to construct and populate knowledge bases as well as used in various applications such as information retrieval and question answering.Relation extraction has been widely studied using fully supervised learning and distantly supervised approaches, these approaches require either manually-or automaticallyannotated data.In contrast, a massive amount of unlabelled texts freely available are underused.We hence focus on leveraging the unlabelled data to improve and extend relation extraction.We approach the use of unlabelled text from three directions: (i) use it for pre-training word representations, (ii) conduct unsupervised learning, and (iii) perform weak supervision.Regarding the first direction, we want to leverage syntactic information for relation extraction.Instead of directly tuning such information on a relation extraction corpus, we propose a novel graph neural model for learning syntactically-informed word representations.The proposed method allows us to enrich pretrained word representations with syntactic information rather than re-training language models from scratch as previous work.Throughout this work, we can confirm that our novel representations are beneficial for relations in two different domains.In the second direction, we study unsupervised relation extraction, which is a promising approach because it does not require manually-or automatically-labelled data.We hypothesise that inductive biases are extremely important to direct unsupervised relation extraction.We hence employ two simple methods using only entity types to infer relations.Despite their simplicity, our methods can outperform existing approaches
Author: Tran, Thy
Language: English
Topic: Topic Modeling
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7127556143