Work

Capturing Domain Semantics with Representation Learning: Applications to Health and Function

Year: 2020
Type: article
Abstract: Natural language processing research is constantly expanding to new domains of text, new types of information, and new applications.A key factor for success in new settings is an ability to capture the characteristics of the language to be analyzed: i.e., the sublanguage of interest.One powerful tool for capturing information about language use is neural representation learning, a family of methods for mathematically representing words, phrases, and other units of language, based on usage patterns in large text corpora.Representation learning for language is predicated on the observation that lexical usage patterns convey important information about meaning, and models this information in terms of geometric relationships between lexical representations.Thus, learned representations provide a lens for analyzing and capturing patterns of language use within restricted domains, as well as for general applications.This thesis presents two main contributions to the literature.First, we present a method for moving beyond word-level information to learn representations of domain concepts from arbitrary text corpora.We demonstrate that these representations capture domain-relevant information about similarity and relatedness, for both biomedical and encyclopedic concepts, and show that they reveal clinically-significant differences in how medical concepts are discussed among different types of health documentation.We further show how concept-level representations learned using a variety of techniques can be effectively combined for semantic grounding of text.
Language: English
Open Access status: green
OpenAlex ID: W7036441033
FWCI: 0.148
Cites: 354
Cited by: 2
Related to: 10