Research Appraisalqualitative

AI Chatbots for Mental Health Self-Management: Lived Experience-Centered Qualitative Study

JMIR mental healthYoo, Dong Whi, Shi, Jiayue Melissa, Rodriguez, Violeta J et al.2 Apr 2026DOI

Clinical Snapshot

85CEBM
Evidence: Moderatequalitative

PICO Framework

P — Population17 individuals with lived experiences of depression
I — InterventionInteraction with GPT-4o-based mental health chatbot (Zenny) during interview sessions
C — ComparatorNo formal comparator - explored experiences and perceptions
O — OutcomesPerceived benefits, limitations, and concerns regarding LLM-based mental health chatbots for depression self-management

Bottom Line

This qualitative study provides valuable insights into how people with depression experience AI chatbots for mental health self-management. The research identifies three key themes that shape user evaluations: concerns about information accuracy and personal applicability, the tension between wanting emotional support while recognizing limitations of machine empathy, and the dilemma between desiring personalized guidance while protecting privacy. Participants valued validation and judgment-free interaction but remained concerned about incorrect information, vagueness, and data safety. The findings suggest AI mental health chatbots should be designed as complements to, not replacements for, human support. For Australian clinicians, this research highlights the importance of understanding patient perspectives when considering AI tools in mental health care, emphasizing the need for robust safety protocols and clear limitations when integrating such technologies into practice.

Evidence: Moderate

Key Findings

  • P Value: Not applicable - qualitative study

  • Effect Size: Not applicable - qualitative study

  • Primary Outcome: Three themes: (1) informational accuracy and applicability concerns, (2) emotional support vs human connection needs, (3) personalization-privacy dilemma

  • Nnt Or Sensitivity: Not applicable - qualitative study exploring user experiences and perceptions

  • Confidence Interval: Not applicable - qualitative study

Clinical Application

Findings inform design of AI mental health chatbots but implementation requires careful consideration of safety protocols and integration with existing care Relevant to Australian digital mental health initiatives and TGA regulation of AI medical devices. Aligns with RACGP guidelines emphasizing patient-centered care and safety in digital health tools Adults with depression considering or using AI-based mental health support tools

Abstract

BACKGROUND: Large language models (LLMs) now enable chatbots to engage in sensitive mental health conversations, including depression self-management. Yet their rapid deployment often overlooks how well these tools align with the priorities of people with lived experiences, which can introduce harms such as inaccurate information, lack of empathy, or inadequate crisis support. OBJECTIVE: This study explores how people with lived experience of depression experience an LLM-based mental health chatbot in self-management contexts, and what perceived benefits, limitations, and concerns inform harm-mitigating design implications. METHODS: We developed a technology probe (a GPT-4o-based chatbot named Zenny) designed to simulate depression self-management scenarios grounded in prior research. We conducted interviews with 17 individuals with lived experiences of depression, who interacted with Zenny during the session. We applied qualitative content analysis to interview transcripts, notes, and chat logs using sensitizing concepts related to values and harms. RESULTS: We identified 3 themes shaping participants' evaluations: (1) informational accuracy and applicability, including concerns about incorrect or misleading information, vagueness, and fit with personal constraints; (2) emotional support vs need for human connection, including validation and a judgment-free space alongside perceived limits of machine empathy; and (3) a personalization-privacy dilemma, where participants wanted more tailored guidance while withholding sensitive information and using privacy-preserving tactics. CONCLUSIONS: People with lived experience of depression evaluated LLM-based mental health chatbots through intertwined priorities of actionable information, emotional validation with clear limits, and personalization that does not require unsafe data disclosure. These findings suggest concrete design strategies to mitigate harms and support LLM-based tools as complements to, rather than replacements for, human support and recovery.

References

  1. 1.Yoo, D. W., Shi, J. M., Rodriguez, V. J., & Saha, K. (2026). AI Chatbots for Mental Health Self-Management: Lived Experience-Centered Qualitative Study. JMIR Mental Health. https://doi.org/10.3389/fpsyt.2018.00416
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service