Research Appraisals
Evidence-based critical appraisals of the latest medical research, systematically evaluated using Oxford CEBM methodology.
Showing 2 appraisals
Medicine
Exploring the role of generative artificial intelligence in enhancing clinical skills training: A bibliometric analysis
BACKGROUND: Traditional clinical skills training faces challenges such as limited standardized patient resources, high costs of simulation equipment, and restricted opportunities for repeated practice. Generative artificial intelligence (GAI), particularly large language models, has attracted increasing attention as a potential tool for simulation, feedback, and adaptive learning in medical education. However, the research landscape and thematic development of GAI in clinical skills training remain insufficiently mapped. METHODS: A bibliometric analysis was conducted using literature retrieved from the Web of Science Core Collection from January 1, 2011 to April 1, 2025. VOSviewer, the Bibliometrix R package, and CiteSpace were used to analyze publication trends, country and institutional contributions, journal distribution, collaboration networks, keyword co-occurrence, co-cited references, and citation bursts. RESULTS: A total of 322 publications were included. Research activity remained limited before 2023 but increased rapidly thereafter. The United States contributed the largest number of publications, followed by China and India. Major contributing institutions included the National University of Singapore, Gazi University, and Nova Southeastern University. Frequently publishing journals included JMIR Medical Education, Medical Teacher, and BMC Medical Education. Keyword and thematic analyses showed that current research attention is mainly concentrated on ChatGPT, large language models, natural language processing, clinical reasoning simulation, personalized learning, virtual patient interaction, and ethical governance. CONCLUSIONS: Research on GAI in clinical skills training is in an early but rapidly expanding stage, with growing scholarly attention to language-model-driven educational applications and related ethical issues. The bibliometric findings reflect research activity, knowledge structure, and thematic priorities rather than direct evidence of educational effectiveness. Future studies should adopt rigorous empirical designs and standardized evaluation frameworks to assess the effectiveness, safety, and appropriate boundaries of GAI applications in clinical skills training.
19 July 2026
Read appraisal →Archives of disease in childhood
AI-simulated clinical consultations: Assessing the potential of ChatGPT to support medical training
BACKGROUND: Simulated medical scenarios are useful for evaluating and developing clinical competencies but scheduling them is expensive and time-consuming. Large language models show promise in role-playing tasks. We investigated the fidelity with which ChatGPT can mimic patients, clinicians and examiners in educational settings. OBJECTIVE: To determine the realism with which ChatGPT can portray patient, doctor and examiner roles, and the utility of these agents in clinical education. METHOD: We selected four paediatric scenarios from mock objective structured clinical examinations (OSCEs) and set up separate patient, doctor and examiner ChatGPT agents for each. The patient and doctor agents conversed with each other in written format. The examiner agent marked the doctor agent based on this conversation. Patients and clinicians familiar with the OSCE assessed the dialogues. RESULTS: The patient agent was judged to be true to character most of the time and good at expressing emotion. The doctor agent was reported to be an effective communicator but occasionally used jargon. Both agents tended to produce repetitive responses which undermined realism. The examiner agent had good correlation with human clinicians. There was moderate support for using the simulated interactions for educational purposes. CONCLUSION: Although the realism of the agents can be improved, ChatGPT can generate plausible proxies of participants in medical scenarios and could be useful for complementing standardised patient-based training.
24 June 2026
Read appraisal →