Research Appraisalother

Human in the loop artificial intelligence in healthcare: applications, outcomes, and implementation challenges

International journal of medical informaticsOlawade, David B, Plabon, Shamiul Bashir, Ojo, Adeyinka et al.15 June 2026DOI

Clinical Snapshot

30CEBM
Evidence: Weakother

PICO Framework

P — PopulationHealthcare systems, clinicians, and patients utilizing AI-assisted healthcare delivery
I — InterventionHuman-in-the-loop artificial intelligence systems
C — ComparatorFully automated AI systems and traditional clinician-only approaches
O — OutcomesDiagnostic accuracy, medical errors, patient safety, clinician trust, implementation challenges

Bottom Line

This narrative review examines human-in-the-loop artificial intelligence in healthcare, claiming benefits in diagnostic accuracy and patient safety compared to fully automated or traditional approaches. However, the review lacks systematic methodology, quality assessment, and quantitative synthesis. While it identifies important implementation challenges including workflow integration and regulatory gaps, the evidence presented is insufficient to support specific clinical recommendations. The review serves as a useful conceptual overview but cannot inform evidence-based practice decisions. Clinicians should await more rigorous systematic reviews and primary studies before implementing HITL-AI systems. The identified need for EHR interoperability, liability frameworks, and adaptive training protocols highlights practical implementation barriers requiring careful consideration.

Evidence: Weak

Key Findings

  • P Value: Not applicable - no statistical analysis

  • Effect Size: Not quantified - narrative synthesis only

  • Primary Outcome: Human-in-the-loop AI demonstrates applications across diagnostic imaging, clinical decision support, patient monitoring, drug discovery, and research analysis

  • Nnt Or Sensitivity: Claims of improved diagnostic accuracy and reduced medical errors but no specific metrics provided

  • Confidence Interval: Not provided

Clinical Application

Implementation requires significant infrastructure including EHR interoperability, training protocols, and regulatory frameworks Relevant to Australian digital health initiatives and TGA medical device regulations, though specific Australian applicability not addressed Healthcare systems implementing AI-assisted clinical decision making across diagnostic imaging, patient monitoring, and clinical decision support

Abstract

BACKGROUND: The integration of artificial intelligence in healthcare has transformed clinical practice and research methodologies. However, concerns regarding algorithmic accountability, interpretability, and safety have necessitated human oversight in AI systems. Human in the loop artificial intelligence represents a collaborative paradigm where human expertise and machine intelligence converge to enhance decision making while maintaining ethical standards and clinical safety. AIM: This review synthesizes current evidence on human in the loop AI in healthcare delivery and research, examining implementation frameworks, clinical outcomes, comparative advantages over fully automated and clinician-only approaches, and challenges. METHOD: A comprehensive narrative review was conducted using PubMed, Scopus, Web of Science, and IEEE Xplore databases covering studies from 2018 to 2025. Data were thematically synthesized to identify patterns, frameworks, and outcomes. This narrative approach enables comprehensive conceptual synthesis across diverse HITL-AI applications and contexts. RESULTS: Human in the loop AI demonstrates significant applications across diagnostic imaging, clinical decision support, patient monitoring, drug discovery, and research data analysis. Evidence indicates improved diagnostic accuracy, reduced medical errors, enhanced patient safety, and increased clinician trust compared to both automated AI and traditional approaches. Implementation requires EHR interoperability, clear liability frameworks, adaptive training protocols, and quantum-safe cryptographic security. Challenges include workflow integration, regulatory gaps for adaptive systems, and sustainability concerns. CONCLUSION: This review advances the field by synthesizing cross-domain implementation patterns, mapping collaboration models to risk-stratified contexts, identifying regulatory gaps for adaptive systems, and proposing future directions including post-quantum cryptographic integration, AI-driven adaptive architectures, and multi-center scalability frameworks for optimizing human-machine collaboration in healthcare.

References

  1. 1.Olawade, D. B., Plabon, S. B., Ojo, A., Ogunbona, M. A., Makanjuola, B. D., & Olasilola, O. R. (2026). Human in the loop artificial intelligence in healthcare: applications, outcomes, and implementation challenges. International Journal of Medical Informatics, 106362. https://doi.org/10.1016/j.ijmedinf.2026.106362
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service