Research Appraisalother

The use of large language models in clinical documentation: A scoping review

International journal of nursing studiesWoo, Brigitte Fong Yeong, Cato, Kenrick, Cho, Hannah et al.DOI

Clinical Snapshot

75CEBM
Evidence: Moderateother

PICO Framework

P — PopulationHealthcare professionals and clinical settings using documentation systems
I — InterventionLarge language models for clinical documentation (note generation, discharge summaries, encounter documentation)
C — ComparatorTraditional clinical documentation methods or no intervention
O — OutcomesDocumentation efficiency, accuracy, time savings, clinician perceptions, ethical considerations, and implementation challenges

Bottom Line

This comprehensive scoping review of 41 studies reveals that large language models show promise for clinical documentation, potentially reducing documentation time by up to 40% while improving standardization and readability. However, significant concerns remain about factual accuracy, hallucinations, and performance in complex clinical scenarios. Clinician acceptance is mixed, with particular concerns about reliability and loss of clinical nuance. The technology requires rigorous accuracy safeguards, ethical frameworks, and regulatory oversight before widespread implementation. Current evidence suggests these tools should augment rather than replace clinical judgment, with careful attention to maintaining patient-centered care quality. Healthcare organizations considering implementation should prioritize co-design with clinicians, comprehensive evaluation, and staff training in technology limitations.

Evidence: Moderate

Key Findings

  • P Value: Not applicable for scoping review

  • Effect Size: Up to 40% time savings reported in some studies

  • Primary Outcome: Large language models demonstrated potential for improving documentation efficiency and readability

  • Nnt Or Sensitivity: Mixed clinician acceptance with concerns about accuracy and reliability in complex cases

  • Confidence Interval: Not applicable for scoping review

Clinical Application

Limited by current concerns about accuracy, liability, and need for regulatory frameworks Relevance to Australian practice unclear given US predominance in studies; would require consideration of TGA medical device regulations and RACGP digital health guidelines Healthcare professionals involved in clinical documentation across various specialties

Abstract

BACKGROUND: Clinical documentation is essential for safe, high-quality care but has become increasingly complex, contributing to clinician burnout. Large language models offer potential to ease documentation by generating summaries, structuring data, and ensuring compliance. However, concerns remain regarding accuracy, bias, privacy, and regulatory risks. OBJECTIVE: To map current literature on large language models applications in clinical documentation, evaluating their benefits, limitations, and ethical considerations. INFORMATION SOURCES: Five electronic databases (i.e., PubMed, Scopus, CINAHL, Cochrane Library, and IEEE Xplore) covering peer-reviewed literature published in English between January 2009 and August 2025. METHODS: This scoping review followed Arksey and OMalleys framework and was reported in accordance with PRISMA-ScR guidelines. Screening, data extraction, and quality appraisal were conducted independently by multiple reviewers using Joanna Briggs Institute tools. Findings were synthesized using descriptive and narrative approaches. RESULTS: Forty-one studies met inclusion criteria, most originating from the United States. Large language models were primarily applied to clinical note generation, discharge summaries, and provider-patient encounter documentation. Key evaluation metrics included content accuracy, linguistic quality, and summarization performance. Large language models demonstrated potential to improve documentation efficiency and readability, with some studies reporting up to 40 % time savings. However, concerns about factual inaccuracies, hallucinations, and reduced performance in complex cases were common. Clinician perceptions were mixed. Some found notes generated by large language models helpful and well-structured, while others raised concerns about reliability, liability, and loss of clinical nuance. Ethical challenges included data privacy, security, and algorithmic bias, with varying levels of compliance across settings. CONCLUSIONS: Large language models hold significant promise for enhancing clinical documentation by improving efficiency, standardization, and clarity. However, their safe and effective use requires rigorous attention to accuracy, ethical safeguards, and clinician trust. Integration must support, rather than supplant, clinical reasoning and patient-centered care. Co-design with clinicians, real-world evaluation, and artificial intelligence literacy are essential to ensure that these technologies augment, not erode, professional judgment and care quality. REGISTRATION: Open Science Framework Registries (https://osf.io/m4h3q).

References

  1. 1.Woo, B. F. Y., Cato, K., Cho, H., You, S. B., & Song, J. (2026). The use of large language models in clinical documentation: A scoping review. International Journal of Nursing Studies, 105322. https://doi.org/10.1016/j.ijnurstu.2025.105322
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service