Large Language Models and Their Applications in Mental Health: Scoping Review

Clinical Snapshot

Key Findings

• Effect Size: Not applicable for scoping review

• Primary Outcome: Distribution and applications of LLMs in mental health research

• Nnt Or Sensitivity: Only 31.7% of studies validated against real patient data; 75.6% focused on diagnostics

• Confidence Interval: Not reported

Clinical Application

Limited by lack of real-world validation and standardized implementation protocols Relevant for Australian mental health services, but TGA approval and RACGP guidelines for AI tools would be required before clinical implementation Mental health clinicians and researchers exploring AI-assisted diagnosis and decision support

Abstract

BACKGROUND: Large language models (LLMs) are poised to transform mental health care, offering advanced capabilities in diagnosis, prognosis, and decision support. Since their inception, numerous mental health-focused LLMs have emerged in the scientific literature, reflecting the growing interest in leveraging these models across various clinical applications. With a broad range of models available, diverse optimization strategies, and multiple use cases, reviewing the current landscape is critical to understanding where future impact lies. OBJECTIVE: This study aimed to conduct a scoping review investigating the use of LLMs in mental health across diagnostic, prognostic, and decision support tasks. METHODS: We screened 3121 papers from PubMed, Scopus, and Web of Science for studies published between January 2023 and October 2025, using terms related to LLM and mental health. After removing duplicates, 2 reviewers (MCL and WWBG) independently screened the studies, with a third (JJK) to resolve conflicting opinions. We extracted and synthesized information on the models, use cases, datasets, and adaptation methods from selected papers. RESULTS: In total, 41 papers were selected. Many studies included evaluations on OpenAI's GPT series applications: GPT-4 (24 studies, 58.5%) and GPT-3.5 (16 studies, 39%). Others included Bidirectional Encoder Representations from Transformers-derived models (9 studies, 22%), LLaMA (8 studies, 19.5%), and RoBERTa-derived models (6 studies, 14.6%). While all studies initially applied out-of-the-box LLMs, several adapted them through few-shot learning or fine-tuning to better align with specific research goals. The most common use case was in diagnostics (31 studies, 75.6%), while the most common target condition was depression (11 studies, 26.8%). While many studies reported superior performance of LLMs, only a minority of studies (13 studies, 31.7%) validated LLM performance against clinician assessments using real patient data, with the majority relying on proxy outcomes such as clinical vignettes, examination questions, or social media posts. CONCLUSIONS: Despite rapid growth and diversity of LLM applications in mental health, the field remains nascent and exploratory. Future developments must emphasize consistent model adaptation procedures to ensure safety and clinical workflow alignment. Models must also be evaluated on robust evaluation criteria by using standardized protocols and real clinical outcome measures.

References

1. 1.Lokadjaja, M. C., Kho, J. J., Schulz, P. J., & Goh, W. W. B. (2026). Large Language Models and Their Applications in Mental Health: Scoping Review. JMIR Mental Health. https://doi.org/10.2196/88057