Leveraging existing corpora for de-identification of psychiatric notes using domain adaptation.
Year: 2017
Type: conference-paper
Abstract: De-identification of clinical notes is a special case of named entity recognition. Supervised machine-learning (ML) algorithms have achieved promising results for this task. However, ML-based de-identification systems often require annotating a large number of clinical notes of interest, which is costly. Domain adaptation (DA) is a technology that enables learning from annotated datasets from different sources, thereby reducing annotation cost required for ML training in the target domain. In this study, we investigate the use of DA methods for deidentification of psychiatric notes. Three state-of-the-art DA methods: instance pruning, instance weighting, and feature augmentation are applied to three source corpora of annotated hospital discharge summaries, outpatient notes, and a mixture of different note types written for diabetic patients. Our results show that DA can increase deidentification performance over the baselines, indicating that it can effectively reduce annotation cost for the target psychiatric notes. Feature augmentation is shown to increase performance the most among the three DA methods. Performance variation among the different types of clinical notes is also observed, showing that a mixture of different types of notes brings the biggest increase in performance.
Source: PubMed
Authors: Hee-Jin Lee, Yaoyun Zhang, Kirk Roberts, Hua Xu
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Awards: Advancing Cancer Pharmacoepidemiology Research Through EHRs and Informatics, Challenges in Natural Language Processing in Clinical Text, Natural language processing for clinical and translational research, Interactive machine learning methods for clinical natural language processing, Natural Language Question Understanding for Electronic Health Records, Neuropsychiatric Genome-Scale and RDOC Individualized Domains (N-GRID)
OpenAlex ID: W2787267295
