Research AppraisalRandomised Controlled Trial

Empowering clinical trial design with agentic intelligence and real-world data

Nature communicationsLi, Haoyang, Pan, Weishen, Rajendran, Suraj et al.7 July 2026DOI

Clinical Snapshot

25CEBM
Evidence: WeakRandomised Controlled Trial

PICO Framework

P — PopulationPatients with acute conditions (septic shock, acute heart failure, acute pulmonary edema, acute kidney injury) represented in MIMIC-IV, and patients with chronic conditions (Alzheimer's disease, Parkinson's disease) represented in the INSIGHT Network across five New York City health systems
I — InterventionEmulatRx — an agentic multi-role conversational framework that autonomously extracts real-world evidence (RWE) from electronic health records (EHR) to inform and refine clinical trial design (CTD) protocols
C — ComparatorNo explicit active comparator; implicit comparison to conventional manual or single-model machine learning approaches to RWE extraction for CTD
O — OutcomesCapability of EmulatRx to facilitate and accelerate the clinical trial design process, including autonomous protocol refinement and generation of actionable RWE reports; no patient-level clinical outcomes assessed

Bottom Line

EmulatRx is a proof-of-concept agentic framework designed to extract real-world evidence from EHR data to inform clinical trial design. While the conceptual contribution is timely and the problem it addresses — reducing the bottleneck between RWD and trial protocol development — is clinically important, this study provides insufficient evidence to support adoption or endorsement of the framework in clinical research practice. The evaluation is entirely qualitative, with no pre-specified endpoints, no comparator, no confidence intervals, and no independent validation. Performance is demonstrated only on two US-based datasets with known demographic limitations. Critical methodological threats including indication bias, immortal time bias, and data representativeness are not addressed. A notable metadata discrepancy — the DOI resolves to the American Journal of Epidemiology rather than Nature Communications — warrants verification of the primary source before citation. Senior clinicians and trialists should regard this as an early-stage methodological proposal requiring prospective validation against expert consensus, regulatory scrutiny, and testing across diverse health system datasets before any operational deployment.

Evidence: Weak

Key Findings

  • P Value: Not reported

  • Effect Size: Not reported — no quantitative effect size is provided for any outcome measure

  • Primary Outcome: Qualitative demonstration of EmulatRx's ability to autonomously refine clinical trial protocols and generate RWE reports across six disease areas (septic shock, acute heart failure, acute pulmonary edema, acute kidney injury, Alzheimer's disease, Parkinson's disease)

  • Nnt Or Sensitivity: Not applicable — no diagnostic accuracy, therapeutic effect, or prognostic metrics are reported; framework performance metrics (sensitivity, specificity, concordance with expert consensus) are absent

  • Confidence Interval: Not reported

Clinical Application

Implementation feasibility is currently limited by the requirement for access to large, structured EHR databases, computational infrastructure, and domain expertise to validate outputs. The framework has not been tested outside the development team's institutional environment. Regulatory acceptance of EmulatRx-generated protocols by bodies such as the FDA or EMA has not been established. EmulatRx has not been validated on Australian EHR data. Australian clinical trial infrastructure operates under TGA oversight, and trial protocols must comply with ICH E6(R2) GCP guidelines as adopted by the TGA. The INSIGHT Network's NYC-based data does not map to Australian ICD-10-AM coding, PBS medication lists, or AIHW population health datasets. RACGP and ACCRM guidelines for chronic disease management (relevant to Alzheimer's and Parkinson's disease arms) reflect different care pathways than US practice. Before any Australian application, validation against datasets such as the APDC, MBS/PBS linked data, or state-based EHR systems (e.g., NSW HealtheNet) would be essential. The Australian Clinical Trials Alliance (ACTA) and NHMRC would need to evaluate regulatory and ethical acceptability of autonomous protocol generation tools. Researchers and clinical trialists working with large-scale EHR datasets for trial design in acute care (ICU/emergency medicine) and chronic neurological disease settings; not directly applicable to individual patient care decisions

Abstract

Clinical trial design (CTD) is a time-consuming process that requires substantial domain expertise. Large-scale real-world data (RWD), such as electronic health records (EHR), encodes practice-based evidence that is of tremendous value to CTD. In recent years, many machine learning methods have been developed to extract such real-world evidence (RWE) from the RWD to inform CTD, but they still need to be communicated with the domain experts extensively in an iterative manner to be further refined and ultimately useful. In this paper, we introduce EmulatRx, an agentic framework that derives RWE for helping with CTD. Through the iterative conversation and analysis across agents with different roles, EmulatRx can autonomously refine trial protocols and finally generate a robust report containing insights that inform better CTD. We applied EmulatRx on the CTD process for both acute diseases (e.g., septic shock, acute heart failure, acute pulmonary edema, and acute kidney injury) using the MIMIC-IV data and chronic diseases (e.g., Alzheimer's disease and Parkinson's disease) using the INSIGHT Network across five New York City health systems. The results demonstrate EmulatRx's capabilities in facilitating and accelerating the CTD process.

References

  1. 1.Li, H., Pan, W., Rajendran, S., Zang, C., & Wang, F. (2026). Empowering clinical trial design with agentic intelligence and real-world data. Nature Communications. https://doi.org/10.1093/aje/kwq439
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service