Research Appraisals
Evidence-based critical appraisals of the latest medical research, systematically evaluated using Oxford CEBM methodology.
Showing 2 appraisals
JMIR human factors
Emotion-Adaptive Large Language Model-Driven Clinical Decision Support: User Evaluation of the Empathic Clinical Decision Support System Framework for Trust and Explainability
BACKGROUND: The increasing prevalence of cannabis use has motivated researchers to develop computational behavioral models that predict usage patterns and related health impacts in naturalistic environments. However, the opaque nature of many artificial intelligence (AI) systems limits users' ability to interpret outputs and undermines trust. Existing explainable artificial intelligence techniques often remain overly technical and do not account for the confusion or frustration clinicians may experience when interpreting complex model explanations. OBJECTIVE: We propose and evaluate an empathic clinical decision support system (empathic-CDSS) that integrates large language models (LLMs) with real-time emotion recognition and explainability modules. The goal is to provide transparent, adaptive, and emotionally attuned explanations that enhance interpretability, user confidence, and trust in AI-assisted clinical decision-making. METHODS: Our empathic-CDSS integrates explainable artificial intelligence, causal inference, and affective computing within an interactive LLM-driven framework. Users' affective states were inferred using the circumplex model of affect, which characterizes emotions along 2 dimensions: valence (the degree of pleasure or displeasure) and arousal (the level of physiological activation or energy). Based on the captured emotional signals, the system dynamically adjusts the tone, structure, style, and complexity of its explanations generated by a fine-tuned LLM, enabling personalized and plain-language explanations. A total of 33 participants with diverse medical and technical backgrounds engaged with the system through guided evaluation tasks and postsession assessments to evaluate 6 dimensions of user-centered questions: usability, personalization and relevance of insights, clarity and comprehensibility, system benefits, satisfaction, and trust and reliability. RESULTS: Our empathic-CDSS effectively generated personalized and transparent explanations that revealed the causal reasoning behind model predictions while enhancing users' emotional engagement and trust in the system's decision logic. Continuous, affect-based feedback enabled the system to dynamically adapt explanation delivery to individual user needs. Participants reported significantly improved usability, clarity, satisfaction, and trust compared with a baseline clinical decision support system without emotion adaptation. Improvements were also observed across additional evaluation dimensions, including personalization and perceived system benefits, supporting the feasibility and added value of integrating empathy-aware communication into AI-driven clinical decision support. CONCLUSIONS: This study introduces a transparent, trustworthy, and emotionally adaptive framework for AI-assisted prediction and clinical decision support. By uniting causal reasoning, affective sensing, and LLM-based natural-language explanations, the empathic-CDSS offers a novel direction for developing emotionally intelligent and user-centered AI systems, with potential applications in behavioral monitoring and personalized interventions, including cannabis use and related health domains.
23 May 2026
Read appraisal →JMIR medical informatics
Resource Use Patterns in US Telehealth Services: Machine Learning and Clustering Analysis Across 4 Specialties
BACKGROUND: The expansion of telehealth services, particularly during the COVID-19 pandemic, has transformed health care delivery in the United States. Telehealth promises greater access and resource efficiency by reducing wait times and appointment lengths, especially in specialties like psychiatry, behavioral health, bariatrics, and sleep medicine. However, disparities exist in adoption based on demographics, geography, and socioeconomic status, raising concerns about equitable access and optimal resource use. OBJECTIVE: This study aims to evaluate how telehealth impacts health care resource use across 4 specialties by examining 2 key metrics: patient-to-provider ratios and appointment durations. It seeks to understand how factors such as patient demographics, facility characteristics, and social determinants influence telehealth adoption and efficiency using a national dataset spanning from 2018 to 2023. METHODS: We analyzed a deidentified dataset from Epic Cosmos, covering outpatient visits across 48 US states (2018-2023). After data preprocessing and feature engineering, we applied 3 machine learning (ML) models (random forest, extreme gradient boosting, and deep neural networks) to predict resource use. Using the model performing the best, feature importance was assessed using Shapley Additive Explanations values. We then used k-means clustering to group facilities into clusters per specialty. Comparative analyses were conducted to evaluate differences in use among clusters, during and after the pandemic. RESULTS: Telehealth use peaked in 2020 and has remained above prepandemic levels since then. In 2018-2023, telehealth adoption reached 36.9% (4,543,021/12,311,710) in psychiatry, 23.9% (5,321,099/22,264,013) in behavioral health, 21.2% (924,333/4,360,061) in bariatrics, and 16.8% (851,803/5,070,256) in sleep medicine. Telehealth visits were consistently shorter than office visits (mean reduction 12.24 minutes; SD 3.33 minutes; P=.18), while patient-to-provider ratios varied significantly across specialties. Among ML models, extreme gradient boosting regression achieved the best performance (patient-to-provider ratios: R2=0.96-0.99; appointment durations: R2=0.61-0.69). Shapley Additive Explanations analysis identified visit type, telehealth use, facility size, rurality, and Social Vulnerability Index household vulnerability as the strongest predictors. Comparative analyses showed significant differences across clusters (all P<.05). CONCLUSIONS: Telehealth has become a sustainable component of health care, enhancing access and efficiency across both rural and urban areas. However, its impact varies across specialties and regions, highlighting the need for targeted strategies such as staffing support for vulnerable populations, infrastructure investments in rural facilities, and reimbursement models that reflect telehealth's resource use. This study provides robust evidence from ML and clustering analyses, demonstrating how telehealth shapes resource use and offering actionable insights for equitable and sustainable integration.
12 May 2026
Read appraisal →