Research Appraisalobservational

Modeling Diabetes Risk and Progression With Public Health Data: Ontology-Guided, Simulation-Capable Digital Twin Study

JMIR medical informaticsLi, Qingrui, Amat, Kapileshwor Ray, Johnson, Eric L et al.21 Apr 2026DOI

Clinical Snapshot

55CEBM
Evidence: Weakobservational

PICO Framework

P — PopulationAdults from the Midlife in the United States study (n=4,174), middle-aged participants with longitudinal follow-up data
I — InterventionOntology-guided digital twin framework with agent-based orchestration and machine learning models
C — ComparatorTraditional risk prediction models without ontological structuring or simulation capabilities
O — OutcomesDiabetes onset prediction, risk state transitions, and simulated intervention effects on diabetes progression

Bottom Line

This innovative study presents a novel ontology-guided framework for creating digital twins from public health data to model diabetes risk progression. While the technical approach is sophisticated and incorporates comprehensive multidomain factors, the clinical utility remains limited by several methodological concerns. The lack of external validation, unclear outcome definitions, and absence of comparison with established diabetes risk tools significantly limit confidence in the findings. The reported discrimination performance (AUC 0.78-0.82) is reasonable but not superior to existing validated tools like the Australian Type 2 Diabetes Risk Assessment Tool. The simulation capabilities are interesting for research purposes, but the authors appropriately caution against direct clinical application. This represents promising proof-of-concept work that requires substantial validation before clinical implementation. Australian clinicians should await external validation studies and comparison with locally validated risk assessment tools before considering adoption.

Evidence: Weak

Key Findings

  • P Value: Not reported for statistical significance testing

  • Effect Size: Random forest AUC 0.82, XGBoost AUC 0.81, demonstrating good discrimination

  • Primary Outcome: Diabetes onset prediction at follow-up with risk state transition modeling

  • Nnt Or Sensitivity: Next-state prediction accuracy 92.5%; simulated 10% weight reduction reduced estimated diabetes cases by 98 (17% relative reduction)

  • Confidence Interval: Not reported for primary performance metrics

Clinical Application

Limited by computational complexity and requirement for extensive multidomain data collection Framework could potentially be adapted for Australian population health data, but would require validation with local datasets and consideration of different healthcare delivery models compared to US-based study Middle-aged adults in research or population health settings, particularly for diabetes risk stratification

Abstract

BACKGROUND: Digital twins (DTs) offer a paradigm for health care by enabling data-driven, simulation-capable representations of individual health trajectories. However, DT development remains limited by the scarcity of standardized, temporally structured, and multidomain data suitable for modeling chronic disease progression. Most existing DT studies rely on narrowly scoped or proprietary datasets, restricting generalizability. Public health datasets, such as the Midlife in the United States study, provide rich biopsychosocial information but are underused due to structural complexity and lack of semantic integration frameworks. OBJECTIVE: This study aimed to develop and evaluate an ontology-guided, agent-orchestrated framework for constructing offline, simulation-capable, and progression-aware DTs from public health datasets. Using diabetes as a case study, the framework integrates agent-based orchestration, medical ontologies, and large language model (LLM)-assisted semantic reasoning with machine learning to support explainable feature structuring, risk prediction, and predictive "what-if" progression analysis. METHODS: A 6-stage DT framework was developed and applied to Midlife in the United States wave 2 (baseline) and wave 3 (follow-up) data. Ontology- and LLM-assisted feature selection identified predictors across biological, behavioral, psychosocial, and socioeconomic domains. Cleaned and harmonized data were used to train predictive models (random forest, eXtreme gradient boosting, and logistic regression) to estimate diabetes onset at follow-up. A state-transition simulator was implemented to model between-wave progression dynamics, quantify transitions across low-, medium-, and high-risk states, and evaluate predictive "what-if" scenarios such as weight reduction and lifestyle improvement. Model performance was assessed using accuracy, F1 score, area under the receiver operating characteristic curve (AUC), and calibration metrics. RESULTS: From 9976 candidate variables, ontology- and LLM-guided selection retained the top 200 relevant predictors spanning biological, behavioral, psychosocial, and socioeconomic domains. Predictive modeling achieved strong discrimination, with random forest (AUC=0.82, accuracy=0.76) and eXtreme gradient boosting (AUC=0.81, accuracy=0.75) outperforming logistic regression (AUC=0.78). The state-transition simulator reproduced realistic progression patterns: 33.9% (1414/4174) of participants changed risk states between waves, and the high-risk group increased from 10.8% (451/4174) to 32.2% (1344/4174). Next-state prediction accuracy reached 92.5%. Predictive "what-if" analyses showed that with a simulated 10% weight reduction, model-estimated diabetes cases decreased by 98 (from 576 to 478). A placebo test (0% weight change) produced less than 0.3% difference in risk distribution, confirming model stability. CONCLUSIONS: This study presents a foundational, ontology-guided, and agent-orchestrated framework for constructing offline, simulation-capable, and progression-aware DTs from public datasets. By combining semantic reasoning, multidomain predictors, and predictive "what-if" progression simulation, the framework transforms static population data into longitudinal, interpretable representations of individual health trajectories. The proof-of-concept application to diabetes demonstrates that public health data can support robust and explainable DT models for exploratory risk analysis and hypothesis generation, without implying causal intervention effects or direct clinical decision support.

References

  1. 1.Li, Q., Amat, K. R., Johnson, E. L., & Li, J. (2026). Modeling diabetes risk and progression with public health data: Ontology-guided, simulation-capable digital twin study. JMIR Medical Informatics, 14(1), e87374. https://doi.org/10.2196/87374
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service