Research Appraisaldiagnostic

MDD-thinker: A reasoning-enhanced large language model for diagnosis of major depressive disorder.

Journal of affective disordersSha, Yuyang, Pan, Hongxin, Luo, Gang et al.15 June 2026DOI

Clinical Snapshot

20CEBM
Evidence: Weakdiagnostic

PICO Framework

P — PopulationPatients with suspected major depressive disorder from UK Biobank dataset (40,000 structured reasoning samples) plus 10,000 records from publicly available mental health datasets
I — InterventionMDD-Thinker large language model diagnostic system using supervised fine-tuning and reinforcement learning
C — ComparatorConventional machine learning models, deep learning methods, and representative LLM baselines
O — OutcomesDiagnostic accuracy, F1-score, interpretability of diagnostic reasoning, and clinical coherence of structured reasoning paths

Bottom Line

This study presents MDD-Thinker, a large language model system for diagnosing major depressive disorder, achieving 82.7% accuracy on a UK Biobank-derived dataset. However, the study has significant methodological limitations that severely limit its clinical applicability. Most critically, no reference standard for MDD diagnosis is described, and essential diagnostic accuracy metrics including sensitivity, specificity, and confidence intervals are absent. The patient sample characteristics and clinical context are poorly described, making it impossible to assess whether results would generalise to real clinical populations. While the concept of interpretable reasoning for psychiatric diagnosis is promising, this study provides insufficient evidence to support clinical implementation. Clinicians should await properly designed diagnostic accuracy studies with appropriate reference standards, comprehensive statistical reporting, and validation in clinical settings before considering such tools for practice.

Evidence: Weak

Key Findings

  • P Value: Not reported

  • Effect Size: Accuracy 0.8268, F1-score 0.8081

  • Primary Outcome: Diagnostic accuracy for major depressive disorder

  • Nnt Or Sensitivity: Sensitivity and specificity not reported

  • Confidence Interval: Not reported

Clinical Application

Limited by requirement for large language model infrastructure and unclear integration with existing clinical workflows Would require validation against Australian diagnostic standards and integration with existing mental health assessment tools used in RACGP guidelines Patients with suspected major depressive disorder in research settings

Abstract

BACKGROUND: Major depressive disorder (MDD) is a leading cause of global disability and poses a substantial public health burden. However, current diagnostic approaches largely rely on subjective assessments and lack the ability to integrate heterogeneous clinical and sociodemographic information. Recent advances in large language models (LLMs) offer new opportunities to support MDD diagnosis through reasoning over complex data, yet their clinical applicability is constrained by challenges related to interpretability, hallucinations, and reliance on synthetic data. METHODS: We propose MDD-Thinker, an LLM-based diagnostic system that integrates supervised fine-tuning (SFT) and reinforcement learning (RL) to enhance reasoning and interpretability under the evaluated conditions. Using the UK Biobank dataset, we constructed 40,000 structured reasoning samples and incorporated an additional 10,000 records from publicly available mental health datasets. MDD-Thinker was trained on these heterogeneous textual data and evaluated against conventional machine learning models, deep learning methods, and representative LLM baselines in terms of diagnostic performance and interpretability. RESULTS: MDD-Thinker achieved high performance in MDD diagnosis, with an accuracy of 0.8268 and an F1-score of 0.8081, showing better performance than conventional machine learning models, deep learning approaches, and representative LLM baselines on the evaluated dataset. Beyond predictive accuracy, it consistently produced structured reasoning paths that were clinically coherent, enabling transparent interpretation of diagnostic decisions in the evaluated experiments. The integration of SFT and RL contributed to notable improvements in both diagnostic reliability and reasoning quality. CONCLUSION: MDD-Thinker demonstrates the potential of reasoning-enhanced LLMs for large-scale MDD diagnosis under the evaluated settings. By jointly optimizing accuracy, interpretability, and efficiency, the proposed system provides a scalable and explainable approach for intelligent psychiatric assessment within the scope of the study, highlighting the potential of reasoning-oriented LLMs in mental health care.

Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service