Research Appraisalother

When Chatbots Become Agents: The Next Phase of Healthcare AI

Journal of medical systemsKarunanayake, Nalan13 May 2026DOI

Clinical Snapshot

30CEBM
Evidence: Weakother

PICO Framework

P — PopulationHealthcare systems and clinical practitioners using AI-enabled agentic systems
I — InterventionAgentic AI systems (OpenAI, Anthropic, Google) that retrieve evidence, use tools, and execute multi-step workflows
C — ComparatorTraditional healthcare AI chatbots and current clinical practice workflows
O — OutcomesClinical reliability, workflow integration, professional role redefinition, and governance implications

Bottom Line

This perspective piece highlights the rapid evolution of healthcare AI from simple chatbots to complex agentic systems capable of multi-step clinical workflows. While raising important concerns about the evidence gap between technology deployment and clinical evaluation, the article lacks empirical data and systematic methodology. The author argues for urgent stakeholder engagement in AI governance before architectural choices become irreversible. However, clinicians should be cautious about the claims made, particularly the statistics about clinical trials, which are not substantiated with proper references. The piece serves as a call to action for healthcare leaders but provides limited practical guidance for clinical implementation or evidence-based decision making.

Evidence: Weak

Key Findings

  • Effect Size: Not applicable - perspective piece

  • Primary Outcome: Identification of evidence gap in agentic AI evaluation

  • Nnt Or Sensitivity: Claims only 19 prospective trials exist among 4,600 clinical LLM studies

  • Confidence Interval: Not provided

Clinical Application

Limited practical guidance provided for implementation Relevant to Australian Digital Health Strategy and TGA medical device regulations, but lacks specific guidance for local implementation or RACGP AI guidelines Healthcare administrators, clinicians, and policymakers involved in AI implementation

Abstract

Healthcare artificial intelligence (AI) has moved beyond answering medical questions. In early 2026, OpenAI, Anthropic, and Google launched agentic systems that retrieve evidence, use tools, and execute multi-step workflows. These systems can integrate information across multiple clinical knowledge domains within a single workflow, but the evidence base for evaluating their reliability in clinical practice has not kept pace with deployment. This perspective argues that healthcare is adopting a technology evolving faster than anyone can evaluate, and that a brief window exists to shape integration before the architecture becomes entrenched. These systems share common architectural principles, yet only 19 prospective trials exist among over 4,600 clinical large language model studies, none evaluating agentic pipelines. The architecture is locking in, professional roles are being redefined, and builders hold a structural information advantage. Transparency, adaptive governance, and broader participation are needed before these choices become irreversible, and to ensure that the boundary between human clinical judgment and automated capability is drawn in a way that strengthens both. Every stakeholder in healthcare must engage with this shift now.

References

  1. 1.Karunanayake, N. (2026). When chatbots become agents: The next phase of healthcare AI. Journal of Medical Systems, 50(6), Article 402. https://doi.org/10.1007/s10916-026-02402-4
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service