Pedagogical strategies for enhancing critical thinking in nursing students using large language models: a mixed-methods systematic review protocol.
Clinical Snapshot
PICO Framework
| P — Population | Undergraduate nursing students exposed to structured large language model (LLM)-based pedagogical interventions in educational settings |
| I — Intervention | Structured LLM-based pedagogical strategies (e.g., AI-assisted case-based learning, Socratic dialogue tools, reflective prompting) integrated into nursing curricula |
| C — Comparator | Comparators not explicitly pre-specified in the protocol; likely conventional teaching methods or alternative digital pedagogies where reported in eligible studies |
| O — Outcomes | Critical thinking competency (primary); outcomes classified using a modified Kirkpatrick framework distinguishing objective competence (e.g., validated critical thinking assessments) from subjective confidence (e.g., self-reported measures); secondary outcomes include instructional design features associated with effectiveness |
Bottom Line
This is a well-constructed systematic review protocol addressing a timely and clinically important question: which pedagogical strategies using large language models effectively cultivate critical thinking in undergraduate nursing students? The methodological framework is rigorous — JBI mixed-methods convergent segregated design, dual GRADE/GRADE-CERQual confidence assessment, and a modified Kirkpatrick framework that appropriately distinguishes objective competence from subjective satisfaction. These design choices represent a meaningful advance over prior syntheses that have conflated student satisfaction with clinical competency development. However, as a protocol only, no evidence synthesis has been conducted and no practice recommendations can be made at this stage. Key limitations include the absence of an explicit comparator in the PICO, English-language restriction, a narrow three-year date range likely yielding a small primary study base, and the absence of a cited prospective registration number. When completed, this review has the potential to provide evidence-based guidance for Australian nursing educators navigating NMBA graduate standards in an AI-integrated training environment. Senior clinicians and curriculum leaders should monitor this review's completion but should not alter current pedagogical practice on the basis of this protocol alone.
Key Findings
P Value: Not applicable at protocol stage
Effect Size: Not applicable — protocol stage; quantitative synthesis planned via SWiM (no pooled effect size will be generated)
Primary Outcome: Protocol only — no results available. Planned primary outcome: critical thinking competency in undergraduate nursing students, classified using a modified Kirkpatrick framework
Nnt Or Sensitivity: Not applicable — educational intervention review; no NNT calculable. Direction-of-effect tables via SWiM are the planned analogue for effect estimation
Confidence Interval: Not applicable at protocol stage
Clinical Application
Feasibility of the planned review is moderate-to-high given the clear JBI methodology, multi-database search, and experienced authorship team. However, the primary study base in this field is nascent and likely small, which may limit the depth of synthesis achievable. The planned dissemination via a visual guide for educators is a practical and accessible knowledge translation strategy. Directly relevant to Australian nursing education. The Australian Nursing and Midwifery Accreditation Council (ANMAC) standards require demonstration of critical thinking as a graduate attribute. The Nursing and Midwifery Board of Australia (NMBA) Registered Nurse Standards for Practice explicitly mandate critical thinking and analysis (Standard 1). Australian universities are actively integrating generative AI tools into health professional education, and RACGP and AHPRA have issued guidance on AI literacy in clinical training. The University of the Sunshine Coast co-authorship ensures Australian contextual awareness. Findings will be relevant to curriculum designers, nursing school directors, and clinical educators across Australian universities navigating TGA and AHPRA expectations for AI-competent graduates. No PBS or TGA regulatory implications apply directly to this educational intervention review. Undergraduate nursing students in tertiary education settings where LLM-based tools are integrated into curricula. Findings, when available, will be most directly applicable to pre-registration nursing programmes in English-speaking countries with comparable regulatory frameworks (Australia, New Zealand, United Kingdom, Canada).
Abstract
INTRODUCTION: Large language models (LLMs) are rapidly normalising in nursing education. However, evidence regarding their impact on critical thinking-a cornerstone of safe clinical practice-remains inconsistent. Current syntheses have largely focused on student satisfaction and general utility, leaving the specific instructional mechanisms that cultivate this competency unexplored. This mixed-methods systematic review aims to identify effective pedagogical strategies for fostering critical thinking, providing evidence-based guidance to safeguard clinical competency in an artificial intelligence-integrated workforce. METHODS AND ANALYSIS: This review will follow a convergent segregated mixed-methods design in accordance with the Joanna Briggs Institute (JBI) methodology. A systematic search will be conducted across CINAHL, ERIC, MEDLINE, PsycINFO and Scopus supplemented by grey literature sources (ProQuest Dissertations, MedRxiv). The search will be limited to English-language studies published from January 2023 to June 2026. Eligible studies will include undergraduate nursing students exposed to structured LLM-based pedagogical interventions. Methodological quality will be appraised using design-specific JBI Critical Appraisal Checklists. Outcomes will be classified using a modified Kirkpatrick framework to distinguish objective competence from subjective confidence. Quantitative data will be synthesised narratively following Synthesis Without Meta-analysis guidelines, and qualitative data thematically. Streams will be integrated using a Joint Display Analysis to generate meta-inferences on effective instructional design. Finally, confidence in the cumulative evidence will be assessed using Grading of Recommendations Assessment, Development and Evaluation (GRADE) and GRADE-Confidence in the Evidence from Reviews of Qualitative research. ETHICS AND DISSEMINATION: As a systematic review of existing literature, this study does not require ethical approval. Findings will be disseminated through a peer-reviewed publication, conference presentations and a visual guide for educators.
References
- 1.Oh, L., Mearns, G., & Mowat, R. (2026). Pedagogical strategies for enhancing critical thinking in nursing students using large language models: a mixed-methods systematic review protocol. BMJ Open. https://doi.org/10.1136/bmjopen-2026-119386
Related Research
Telemedicine journal and e-health : the official journal of the American Telemedicine Association
Telehealth Competency Evaluation Tools: A Scoping Review
3 Aug 2026
Simulation in healthcare : journal of the Society for Simulation in Healthcare
Future of Biometric Technology in Healthcare Simulation
2 Aug 2026
International journal of nursing education scholarship
Effect of concept mapping on critical thinking skills in nursing students: a systematic review with meta-analysis
26 July 2026
This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service