Researchers built a system that spots depression levels in Reddit posts, sorting them into four grades: minimal, mild, moderate, and severe. They took two routes: a classic one with ten machine‑learning models (like SVM, Random Forest, XGBoost) paired with Word2Vec and GloVe embeddings; and a cutting‑edge one with ten transformer models (BERT, RoBERTa, MentalBERT, etc.). The top performer was MentalBERT, achieving a 97.31 % F1‑score, far ahead of classic methods (the best was XGBoost at 94.01 %). This shows that domain‑adapted transformers capture subtle linguistic cues of depression better than traditional models. The finding pushes forward fine‑grained online mental‑health monitoring, paving the way for more sensitive tools to spot those who may need help.
The proposed framework merges two distinct pipelines. In the first, texts are converted into vectors using Word2Vec or GloVe, which capture semantic relationships based on word co‑occurrences in large corpora. These vectors feed ten traditional classifiers; XGBoost stands out for its ability to handle non‑linear features and reduce overfitting through boosting. In the second pipeline, transformer models are pre‑trained on massive linguistic datasets and then fine‑tuned on a Reddit corpus annotated for depression severity. MentalBERT, a BERT variant trained on psychological texts, benefits from deeper contextual representations, enhancing discrimination between mild and severe symptoms. Employing metrics like the F1‑score, which balances precision and recall, is essential in medical contexts where false positives and negatives have different consequences. Moreover, evaluating multiple severity levels requires a multi‑class approach, managed via one‑vs‑rest or softmax strategies. The results suggest that integrating static embeddings with traditional ensemble models can still yield competitive performance, but specialized transformers remain superior due to their capacity to model long‑range dependencies and complex emotional contexts.
