Work

Term Frequency-Inverse Document Frequency (TF-IDF)-Based Machine Learning and a Zero-Shot Fine-Tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5) Baseline for Depression Risk Detection from Text

Year: 2026
Type: article
Abstract: Text-based depression risk detection is an important area of computational mental health because written language may contain signals associated with psychological distress and can support scalable risk-screening research. This study evaluates three term frequency-inverse document frequency (TF-IDF)-based classical machine learning classifiers - Logistic Regression, Multinomial Naive Bayes, and Linear Support Vector Machine (SVM) - against a small instruction-tuned zero-shot Fine-tuned Language Net-Text-to-Text Transfer Transformer (FLAN-T5)-base baseline on a public Reddit depression dataset. Performance was assessed using accuracy, precision, recall, F1-score, and receiver operating characteristic-area under the curve (ROC-AUC). Linear SVM achieved the highest accuracy (0.9651), F1-score (0.9644), and ROC-AUC (0.9937), while Logistic Regression obtained a very similar precision (0.9743 versus 0.9747). Naive Bayes achieved higher recall than Linear SVM (0.9687 versus 0.9544), and the FLAN-T5 baseline produced recall of 1.0000 because it predicted every test sample as depression; its accuracy was 0.4958, and ROC-AUC was 0.5000. Therefore, the findings support the effectiveness of TF-IDF-based linear classifiers for this dataset and experimental configuration, but they should not be interpreted as a general comparison between classical machine learning and large language models (LLMs). The FLAN-T5 result represents only the tested zero-shot prompt, truncation, decoding, and score-parsing setup. Additional tuning, repeated validation, stronger transformer/LLM baselines, and cross-dataset testing are required before broader conclusions can be drawn.
Language: English
Field: Psychology
Open Access status: hybrid
Estimated APC paid:
OpenAlex ID: W7236726396
FWCI:
Cites: 23
Cited by:
Related to: 10