Work

NLP and Topic Modeling with LDA, LSA, and NMF for Monitoring Psychosocial Well-being in Monthly Surveys

Year: 2024
Type: conference-paper
Abstract: This article presents an approach for assessing psychosocial concerns using Natural Language Processing (NLP) and topic modeling on text data collected in monthly surveys. We processed a dataset containing more than 10,000 entries from two regional public health department, focusing on psychosocial concerns expressed by the population. Using NLP techniques and topic models like Latent Dirichlet Allocation (LDA), Latent Semantic Analysis (LSA), and Non-Negative Matrix Factorization (NMF), we identifed and analyzed recurring themes. The study found that LDA with unigrams performed best, yielding a coherence score of 0.59, while NMF was less effective. Key emerging themes included emotional well-being, stress, and social isolation, which evolved over time, especially during the COVID-19 pandemic. The results demonstrate that these methods can identify emerging issues and provide valuable information for decision making.
Language: English
Open Access status: diamond
OpenAlex ID: W4405113218
FWCI: 6.117
Cites: 31
Cited by: 17
Related to: 8