Research Appraisals
Evidence-based critical appraisals of the latest medical research, systematically evaluated using Oxford CEBM methodology.
Showing 6 appraisals
American journal of medical quality : the official journal of the American College of Medical Quality
Increasing Advance Care Planning in a Community Internal Medicine Clinic
INTRODUCTION: Advance care planning (ACP) supports goal-concordant care but remains underused nationally. In resident clinics, limited continuity, short visits, and lack of standardized workflows create barriers to ACP integration. In our Community Internal Medicine resident clinic, ACP discussion was documented in 2.5% of annual physicals, and 19.6% of paneled patients had an advance directive (AD) on file. We aimed to increase ACP documentation from 2.5% to 12.5% within 1 year without increasing perceived resident workflow burden. METHODS: We conducted a resident-led quality improvement project using Lean Six Sigma methodology. Three interventions were implemented sequentially: nursing distribution of ACP brochures, an electronic medical record DotPhrase to prompt and document ACP discussions, and targeted patient portal outreach to patients without an AD before annual visits. The primary outcome was documented ACP discussion during annual physicals. Secondary outcomes included AD uploads and ACP consult referrals. The balancing measure was resident-perceived workflow burden. Charts were reviewed over 5-week periods at baseline (n = 118) and after each implementation phase (n = 132, 158, 129). RESULTS: ACP documentation increased from 2.5% at baseline to 12.2%, 17.1%, and 24.0% across sequential phases (χ2(3) = 24.74, P < 0.0001). Pairwise comparisons versus baseline were significant (all P ≤ 0.005). AD upload rate increased from 1.7 to 6.0 per month, and ACP consult referrals increased from 0.0% to 10.9%. Mean perceived workflow burden decreased from 4.9 to 3.0. CONCLUSION: Workflow-embedded interventions improved ACP documentation, AD uploads, and ACP referrals without increasing perceived resident burden.
30 June 2026
Read appraisal →European journal of emergency medicine : official journal of the European Society for Emergency Medicine
Association between patient-to-nurse ratios in emergency departments and patient, staff, and organizational outcomes: a systematic review.
Background In many settings, studies have shown that establishing patient-to-nurse ratios has benefits for both patients and staff. Whether this is transposable to emergency department (ED) is unclear. Objective The primary objective was to assess the association between patient-to-nurse ratios in EDs and mortality. Design In this systematic review, a search strategy identified studies published in 2004-2025 in MEDLINE, Cochrane, and CINAHL. Two independent reviewers performed selection and data extraction, followed by a narrative synthesis. Outcomes The primary outcome was in-hospital mortality. Secondary outcomes were other patient outcomes, staff, and organizational outcomes. Results Of 2214 identified references, 17 studies were included and all of which were observational. The primary outcome was assessed in only one cohort study ( n = 73 EDs), where an increase in the number of nurses per patient was associated with a reduction in ED mortality (adjusted odds ratio = 0.68; 95% confidence interval: 0.49; 0.94). An increase in the number of nurses per patient was also associated with a reduction in cardiac arrests (one study: relative risk = 1.33, 95% confidence interval: 1.05, 1.67 for ≥8.5 patients/nurse vs. <8.5) and medication errors (one of two studies), and an improvement in patient experience (two studies) and nurse satisfaction (one study). Mixed results were observed with regard to reducing length of stay (one of two studies), administration time (three of four studies) and the number of patients who left without being seen (three of four studies), while waiting time before diagnosis or treatment improved (three studies). Conclusion Although evidence is limited, several observational studies suggest that a higher nurse-to-patient ratio is associated with better patient, nurse, and ED organizational outcomes.
23 June 2026
Read appraisal →BMC research notes
Survey to evaluate clinical benefits and acceptance in international tele-intensive care unit collaboration
OBJECTIVES: Tele-intensive care unit (TICU) networks have evolved quickly in recent years and have proved their value in providing care for the critically ill. Objective measures to assess performance and quantify success e.g. clinical and economic outcome parameters are desirable but not easily accessible in international collaboration with very diverse clinical settings and legal prerequisites. Therefore, we initiated a study to evaluate the performance in our tele-intensive care unit network. METHODS: We conducted an online survey addressing clinical staff at ten spoke sites in four countries connected to one TICU hub to assess subjective clinical benefit, acceptance and potential for improvement. RESULTS: The majority of the 30 participants felt well supported clinically and personally, with a high acceptance and trust as well as a positive working relationship in tele-medical collaboration. Ethical principles and data protection were discovered to be persistently of utmost significance in tele-intensive care unit networks. CONCLUSION: International telemedicine in critical care is perceived positively without major differences between diverse health care systems when crossing borders, showing potential for improvement to guide future clinical and research approaches. Clinical trial registiry: The study was registered on August 11th, 2023 with the German Clinical Trials Register (DRKS-IDDRKS00032246; https://www.drks.de/search/de/trial/DRKS00032246/details ).
24 May 2026
Read appraisal →Studies in health technology and informatics
Digital Health Tool Usability and Redesign: Preliminary Scoping Review Findings
Few usability or user experience studies report how insights resulted in improved digital health tool (DHT) design. Therefore, this paper reports on preliminary findings of a scoping review that examines this topic. A systematic search in five databases led to the inclusion of 102 studies that met the inclusion criteria, namely those reporting both usability evaluation and redesign outcomes. Categorisation of these studies identified four user groups: patients, healthcare professionals, public health users, and mixed groups. Many DTHs were web- (36%) or mobile-based (32%) applications, and most often newly developed (68%).
24 May 2026
Read appraisal →JMIR medical informatics
A Practical Approach to Assessing the Completeness of Electronic Health Records for Medical Research: Data Quality Study
BACKGROUND: Data quality is the degree to which data are fit for their intended purpose and is described using quality dimensions. The increased use of medical data in clinical research and medical artificial intelligence development has rendered data quality assessment essential. Despite existing data quality definitions, frameworks, and tools, data quality assessment in real-world settings faces multiple challenges. This stems from a lack of understanding of how to assess real-world data quality and interpret the results. Therefore, practical approaches to data quality assessment are needed that are appropriate for diverse data environments, intended uses, quality dimensions, and requirements. OBJECTIVE: This study proposes a practical approach for assessing the completeness of electronic health records (EHRs) for medical research. This approach integrates structural completeness, rule-based assessment, and descriptive analyses of completeness and data diversity to clarify how data quality can be measured and meaningfully interpreted in practice. METHODS: The completeness of a large-scale EHR dataset from Gachon University Gil Medical Center was evaluated covering January 2005 to December 2023. Completeness was assessed using a three-part approach comprising (1) structural completeness assessment, (2) rule-based assessment, and (3) descriptive analyses of completeness and data diversity. Assessments were conducted using clinical data quality assessment tools. This practical approach was used to assess EHR completeness for medical research from 1,798,153 patient records. RESULTS: In the structural assessment, 12.8% (5/39) of the data tables were unavailable, indicating limited capturing of clinician free-text data. The rule-based assessment identified substantial missingness in vocabulary fields (38/124, 30.6%) and missing or special characteristic values in relation to observations (3,643,581/15,313,287, 23.8%), measurements (25,583,622/642,623,715, 4%), care sites (28/1715, 1.6%), and deaths (117/34,330, 0.3%). Descriptive analyses demonstrated a balanced gender distribution (886,489/1,798,153, 49.3% male and 911,664/1,798,153, 50.7% female) and a predominantly Korean racial distribution (1,739,628/1,798,153, 96.7%). Collectively, these findings illustrate the completeness quality of a multiperspective completeness assessment for medical research. CONCLUSIONS: This study demonstrates how data quality dimensions can be measured in practice through a real-world completeness assessment. This practical approach enables evaluation of EHR completeness and provides insights into data quality. Its findings have implications for researchers conducting data quality assessments and applying quality dimensions in medical research.
22 May 2026
Read appraisal →BMJ open
Implementation of safety management systems (SMS) in healthcare: a systematic review and international comparison
OBJECTIVES: Many industries where safety is a priority (eg, aviation) use safety management systems (SMSs), but evidence on their use in healthcare is needed to determine whether they could support patient safety improvement. We investigated the application of national-level SMSs to patient safety in terms of effectiveness, implementation and experience. DESIGN: Systematic review using a case study approach. DATA SOURCES: We identified patient safety organisations in each country and searched their websites. We also searched MEDLINE (in December 2023) and Embase (via Ovid), CINAHL (EBSCO) and Web of Science (in February 2024). ELIGIBILITY CRITERIA: Any evidence from five high-income countries that have publicly funded healthcare systems with universal coverage: Australia, Canada, Ireland, New Zealand and the Netherlands. We included publications on the effectiveness, implementation or experience of the patient safety approach in each country. DATA EXTRACTION AND SYNTHESIS: Included evidence was summarised and mapped onto an initial analytical framework based on analysis of SMSs in high-risk industries, enabling cross-country comparisons. Drafts were shared with experts from patient safety organisations in each country for comment. Formal quality appraisal was not possible as most evidence was non-evaluative. RESULTS: 53 publications were included, from Australia (5), Canada (7), Ireland (8), New Zealand (9) and the Netherlands (24). Only the Netherlands implemented a patient safety programme explicitly based on an SMS approach. Some aspects of patient safety in hospitals improved as a result, but there was significant variation in both the implementation of the programme and attributed outcomes.In the other four countries, the main components of an SMS were identified to some extent, along with evidence that their patient safety approaches had been influenced by concepts from high-risk industries and 'safety science' more widely. CONCLUSIONS: Emerging ideas from high-risk industries (beyond SMSs) and broader safety science have influenced all countries, reflecting increasing awareness of the need for initiatives to be context-specific to be successful. However, their implementation and impact need further evaluation. PROSPERO REGISTRATION NUMBER: CRD42023487512.
15 May 2026
Read appraisal →