Work

Preprocessing of natural language process variables using a data-driven method improves the association with suicide risk in a large veterans affairs population

Year: 2025

Type: article

Abstract: Suicide risk assessment has historically relied heavily on clinical evaluations and patient self-reports. Natural language processing (NLP) of electronic health records (EHRs) provides an alternative approach for extracting risk predictors from clinical notes. Modeling NLP variables, however, is challenging because of zero inflation and skewed distributions. Therefore, we evaluated whether an adaptive-mixture-categorization (AMC) method could optimize the suicide risk predictive capacity of NLP data extracted from Veterans Affairs (VA) EHR notes. NLP variables for 25,342 patients were analyzed using the SÉANCE python package. The AMC method was employed to categorize NLP measures into distinct groups to maximize the between-category variance. Associations between suicide outcomes and AMC-categorized NLP variables were compared to those between the original and quantile-categorized NLP variables. AMC-categorized variables showed stronger associations with suicide risk than other approaches did in the full cohort analysis and sensitivity analyses by subsampling bootstrapping. Additionally, over 90 % of the NLP variables were significantly associated with suicide risk in univariate analyses, indicating the relevance of clinical notes in suicide prevention. AMC-based categorization substantially enhanced the suicide predictive capacity of NLP variables extracted from clinical text. Transforming skewed NLP data with the AMC method holds promise for improving risk prediction models. • AMC preprocessing improves associations between NLP variables and suicide risk. • Over 90 % of AMC-processed NLP variables are significantly associated with suicide. • AMC outperforms quantile categorization in whole and undersampled cohorts. • AMC refines risk modeling for suicide prevention in clinical settings. • AMC may enhance NLP-based suicide risk prediction in Veterans Affairs EHR notes.

Source: Computers in Biology and Medicine

DOI: 10.1016/j.compbiomed.2025.109939