Evidence-Based Medicine

Research Appraisals

Evidence-based critical appraisals of the latest medical research, systematically evaluated using Oxford CEBM methodology.

Showing 3 appraisals

observationalEvidence: Moderate
80CEBM

Journal of medical Internet research

Telehealth Scale and Artificial Intelligence Adoption Tiers Across Clinical and Operational Domains in US Hospitals: Cross-Sectional Study

BACKGROUND: Telehealth expansion and artificial intelligence (AI) adoption are often described as parallel dimensions of health system digital transformation. However, whether telehealth scale is associated with hospital AI adoption and whether this relationship varies across hospital settings remain unclear. OBJECTIVE: This study examined the association of telehealth scale with clinical and operational AI adoption tiers in US hospitals and assessed whether these patterns differed by telehealth reporting behavior and geography. METHODS: This cross-sectional study included 6173 US acute care hospitals using linked 2024 American Hospital Association Annual Survey and Information Technology Supplement data and 2023 Healthcare Cost Report Information System data. Telehealth scale was parameterized using log-transformed telehealth volume, a telehealth nonreporting indicator, and a reported-zero telehealth indicator. Clinical and operational AI adoption tiers were derived from hospital-reported AI capability items and classified into 3 tiers. Both outcomes were modeled using multioutput gradient-boosted tree classifiers, and model behavior was interpreted using Shapley additive explanations, partial dependence plots, and stratified analyses by the Core-Based Statistical Area category. RESULTS: Telehealth volume was the strongest predictor of both clinical and operational AI adoption tiers and had a larger contribution to the clinical AI model. Telehealth nonreporting was common, occurring in 57% (3521/6173) of hospitals, and was concentrated among hospitals in the lowest clinical AI adoption tier, accounting for 91.4% (3145/3441) of hospitals with no reported clinical AI adoption. Higher telehealth volume was associated with a steep increase in predicted clinical AI adoption tiers at lower telehealth volumes, followed by a plateau at higher volumes. At similar telehealth volumes, rural hospitals showed weaker telehealth-attributed contributions to predicted clinical AI adoption tiers than metropolitan hospitals. Supplementary analyses suggested that telehealth reporting status and telehealth intensity reflected related but distinct structural processes. CONCLUSIONS: Telehealth scale was strongly associated with hospital AI adoption tiers, especially clinical AI adoption tiers. These findings suggest that telehealth capacity may serve as a practical hospital-level marker of broader digital readiness for AI adoption, but the cross-sectional design does not establish whether telehealth expansion precedes or causes AI adoption. Hospitals with telehealth nonreporting and rural hospitals may face additional structural barriers that limit the translation of digital capacity into AI maturity. Policies to reduce inequities in hospital AI adoption may therefore need to pair telehealth expansion with implementation support, interoperability capacity, and organizational resources.

14 June 2026

Read appraisal →
observationalEvidence: Moderate
75CEBM

JMIR formative research

Machine Learning-Based Prediction Model for 30-Day Emergency Department Revisits in a Medically Underserved Tertiary Hospital: Formative Retrospective Cohort Study

BACKGROUND: Emergency department (ED) revisits are critical quality indicators, particularly in medically underserved areas, where traditional prediction tools show limited performance. Machine learning (ML) approaches may offer improved predictive performance for identifying high-risk patients. OBJECTIVE: This formative study aimed to develop and validate an ML-based model for predicting 30-day ED revisits using electronic health records from a tertiary hospital serving a medically underserved area in South Korea and to evaluate its clinical utility through interpretability analysis and risk stratification. METHODS: This retrospective cohort study analyzed 36,230 adult patients visiting the Gangneung Asan Hospital ED in 2023. We developed and compared 3 ML models (extreme gradient boosting [XGBoost], random forest, and ElasticNet) using electronic health records. Model interpretability was ensured through Shapley additive explanations (SHAP) analysis, and clinical utility was evaluated through 5-tier risk stratification. RESULTS: Among 36,230 patients, 798 (2.2%) revisited within 30 days. XGBoost achieved superior performance with an area under the receiver operating characteristic curve of 0.90 (95% CI 0.88-0.92), a sensitivity of 0.94, and a specificity of 0.69. The SHAP analysis identified ED length of stay, oxygen saturation, systolic blood pressure, computed tomography performance, antibiotic use, and liver disease as key predictors. Risk stratification demonstrated a 25-fold difference in the actual revisit rates between the lowest (152/8450, 1.8%) and the highest (686/1500, 45.7%) risk groups. CONCLUSIONS: The XGBoost model demonstrated excellent predictive performance with high interpretability for 30-day ED revisit predictions. The implementation of this model could enable risk-stratified interventions and more efficient resource allocation in medically underserved settings, potentially reducing unnecessary revisits and improving patient outcomes. This formative study establishes feasibility and provides a foundation for future multicenter validation studies in similar medically underserved settings.

30 May 2026

Read appraisal →
Systematic ReviewEvidence: Moderate
60CEBM

Disaster medicine and public health preparedness

Hospital Medical Surge Capacity Assessment and Planning Tools for Disaster Response: A Systematic Review and Meta-analysis

BACKGROUND: Hospital surge capacity is pivotal for disaster response, yet the effectiveness of assessment and planning tools remains underexplored. OBJECTIVE: This systematic review evaluates the reliability, validity, and applicability of surge capacity tools across disaster scenarios. METHODS: Following PRISMA guidelines, we analyzed 24 Q1 studies (PubMed, Scopus) using the PICO framework. Risk of bias was assessed via ROBINS-E, and meta-analysis (random-effects model) quantified pooled effect sizes (ES). Subgroup analyses compared simulation tools, surveys, and resource strategies. RESULTS: The combined ES was 0.74 (95% CI: 0.67-0.82), indicating moderate improvement in preparedness. Simulation tools (Group A) showed the highest consistency (ES = 0.81, I2 = 0%), while resource strategies (Group C) had wider variability (ES = 0.71, I2 = 74.42%). Egger's regression revealed publication bias (P = 0.004), and heterogeneity was substantial (I2 = 76.70%). CONCLUSIONS: Simulation-based tools are most effective for surge capacity, whereas resource strategies require contextual adaptation. Policymakers should prioritize standardized benchmarks and DSS integration, with future research addressing equity and real-world implementation gaps.

20 May 2026

Read appraisal →