Empowering clinical trial design with agentic intelligence and real-world data
Clinical Snapshot
PICO Framework
| P — Population | Patients with acute conditions (septic shock, acute heart failure, acute pulmonary edema, acute kidney injury) represented in MIMIC-IV, and patients with chronic conditions (Alzheimer's disease, Parkinson's disease) represented in the INSIGHT Network across five New York City health systems |
| I — Intervention | EmulatRx — an agentic multi-role conversational framework that autonomously extracts real-world evidence (RWE) from electronic health records (EHR) to inform and refine clinical trial design (CTD) protocols |
| C — Comparator | No explicit active comparator; implicit comparison to conventional manual or single-model machine learning approaches to RWE extraction for CTD |
| O — Outcomes | Capability of EmulatRx to facilitate and accelerate the clinical trial design process, including autonomous protocol refinement and generation of actionable RWE reports; no patient-level clinical outcomes assessed |
Bottom Line
EmulatRx is a proof-of-concept agentic framework designed to extract real-world evidence from EHR data to inform clinical trial design. While the conceptual contribution is timely and the problem it addresses — reducing the bottleneck between RWD and trial protocol development — is clinically important, this study provides insufficient evidence to support adoption or endorsement of the framework in clinical research practice. The evaluation is entirely qualitative, with no pre-specified endpoints, no comparator, no confidence intervals, and no independent validation. Performance is demonstrated only on two US-based datasets with known demographic limitations. Critical methodological threats including indication bias, immortal time bias, and data representativeness are not addressed. A notable metadata discrepancy — the DOI resolves to the American Journal of Epidemiology rather than Nature Communications — warrants verification of the primary source before citation. Senior clinicians and trialists should regard this as an early-stage methodological proposal requiring prospective validation against expert consensus, regulatory scrutiny, and testing across diverse health system datasets before any operational deployment.
Key Findings
P Value: Not reported
Effect Size: Not reported — no quantitative effect size is provided for any outcome measure
Primary Outcome: Qualitative demonstration of EmulatRx's ability to autonomously refine clinical trial protocols and generate RWE reports across six disease areas (septic shock, acute heart failure, acute pulmonary edema, acute kidney injury, Alzheimer's disease, Parkinson's disease)
Nnt Or Sensitivity: Not applicable — no diagnostic accuracy, therapeutic effect, or prognostic metrics are reported; framework performance metrics (sensitivity, specificity, concordance with expert consensus) are absent
Confidence Interval: Not reported
Clinical Application
Implementation feasibility is currently limited by the requirement for access to large, structured EHR databases, computational infrastructure, and domain expertise to validate outputs. The framework has not been tested outside the development team's institutional environment. Regulatory acceptance of EmulatRx-generated protocols by bodies such as the FDA or EMA has not been established. EmulatRx has not been validated on Australian EHR data. Australian clinical trial infrastructure operates under TGA oversight, and trial protocols must comply with ICH E6(R2) GCP guidelines as adopted by the TGA. The INSIGHT Network's NYC-based data does not map to Australian ICD-10-AM coding, PBS medication lists, or AIHW population health datasets. RACGP and ACCRM guidelines for chronic disease management (relevant to Alzheimer's and Parkinson's disease arms) reflect different care pathways than US practice. Before any Australian application, validation against datasets such as the APDC, MBS/PBS linked data, or state-based EHR systems (e.g., NSW HealtheNet) would be essential. The Australian Clinical Trials Alliance (ACTA) and NHMRC would need to evaluate regulatory and ethical acceptability of autonomous protocol generation tools. Researchers and clinical trialists working with large-scale EHR datasets for trial design in acute care (ICU/emergency medicine) and chronic neurological disease settings; not directly applicable to individual patient care decisions
Abstract
Clinical trial design (CTD) is a time-consuming process that requires substantial domain expertise. Large-scale real-world data (RWD), such as electronic health records (EHR), encodes practice-based evidence that is of tremendous value to CTD. In recent years, many machine learning methods have been developed to extract such real-world evidence (RWE) from the RWD to inform CTD, but they still need to be communicated with the domain experts extensively in an iterative manner to be further refined and ultimately useful. In this paper, we introduce EmulatRx, an agentic framework that derives RWE for helping with CTD. Through the iterative conversation and analysis across agents with different roles, EmulatRx can autonomously refine trial protocols and finally generate a robust report containing insights that inform better CTD. We applied EmulatRx on the CTD process for both acute diseases (e.g., septic shock, acute heart failure, acute pulmonary edema, and acute kidney injury) using the MIMIC-IV data and chronic diseases (e.g., Alzheimer's disease and Parkinson's disease) using the INSIGHT Network across five New York City health systems. The results demonstrate EmulatRx's capabilities in facilitating and accelerating the CTD process.
References
- 1.Li, H., Pan, W., Rajendran, S., Zang, C., & Wang, F. (2026). Empowering clinical trial design with agentic intelligence and real-world data. Nature Communications. https://doi.org/10.1093/aje/kwq439
Related Research
Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy
Ventral hernia repair in emergency settings. A machine learning model to predict post-operative complications.
3 Aug 2026
Journal of the American Medical Informatics Association : JAMIA
Sociodemographic bias in large language model clinical trial screening
2 Aug 2026
Acta odontologica Scandinavica
Predicting gingival embrasure risk after invisible orthodontics using multimodal data and machine learning
23 July 2026
This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service