Tech-based evaluation of healthcare quality during the COVID-19 pandemic
Clinical Snapshot
PICO Framework
| P — Population | 52,490 respondents from the 2021 Global Burden of Disease COVID-19 Health Service Disruption Survey |
| I — Intervention | Machine learning-based healthcare quality evaluation framework using 4-dimensional WHO people-centered care principles |
| C — Comparator | Baseline machine learning models vs optimized models (SVM and Random Forest) |
| O — Outcomes | Healthcare service quality classification accuracy, identification of healthcare disparities by socioeconomic factors |
Bottom Line
This cross-sectional study used machine learning to analyze healthcare quality during COVID-19 using global survey data. While the large sample size and WHO-aligned framework are strengths, significant methodological limitations undermine confidence in the findings. The study lacks essential details about sampling methodology, outcome validation, and statistical inference. The reliance on machine learning classification without traditional epidemiological analysis raises concerns about interpretability and bias. The reported associations between socioeconomic factors and healthcare quality, while plausible, cannot be considered robust evidence due to inadequate confounding control and absence of effect size estimates with confidence intervals. Australian clinicians should interpret these findings cautiously, as the global survey data may not reflect local healthcare system characteristics or pandemic responses.
Key Findings
P Value: Not reported
Effect Size: SVM model accuracy improved from 0.93 to 0.96 with optimization
Primary Outcome: Healthcare service quality classification using ML framework
Nnt Or Sensitivity: Macro-F1 scores reported for Random Forest model but specific values not provided
Confidence Interval: Not reported
Clinical Application
Requires substantial technical infrastructure and data collection capabilities Limited applicability given different healthcare system structure, universal coverage through Medicare, and distinct pandemic response compared to global survey population Healthcare systems seeking to monitor service quality during health emergencies
Abstract
The coronavirus disease 2019 pandemic profoundly disrupted global health systems, exacerbating preexisting inequalities in access to and quality of care. Disparities in service accessibility, continuity, coordination, and comprehensiveness highlight the need for a multidimensional, data-driven approach to healthcare evaluation. We conducted a retrospective analysis using 52,490 responses from the 2021 Global Burden of Disease COVID-19 Health Service Disruption Survey. We developed a 4-dimensional evaluation framework aligned with World Health Organization principles for people-centered care. Following variable selection, standardized preprocessing, and manual labeling, we trained and assessed 6 machine learning (ML) algorithms. We further optimized the 2 best-performing models - support vector machine (SVM) and random forest (RF) - using interpolation-based data augmentation, cross-validated hyperparameter tuning, and particle swarm optimization. SVM showed the highest baseline performance (accuracy 0.93), whereas RF achieved competitive macro-F1 scores. Interpolation-based data augmentation improved the generalizability of the SVM model, increasing its accuracy to 0.96. The RF model benefited most from particle swarm optimization-based hyperparameter optimization. Model predictions revealed persistent inequalities in healthcare service quality: respondents with lower income, lower educational attainment, and rural residence were disproportionately classified as receiving lower-quality services, whereas urban residence and higher income were associated with higher-quality care. Our scalable ML framework successfully assessed healthcare service quality during the pandemic, with optimized SVM and RF models demonstrating robust performance on high-dimensional, imbalanced survey data. Post-pandemic recovery strategies must prioritize socioeconomically disadvantaged populations. Furthermore, integrating ML tools can enhance real-time quality monitoring within health systems.
References
- 1.Wang, K., Xu, R., & Huang, Q. (2026). Tech-based evaluation of healthcare quality during the COVID-19 pandemic. Medicine, Article 0000000000048850. https://doi.org/10.1097/MD.0000000000048850
Related Research
JMIR formative research
Teaching Health Informatics in a Skills-First Era: A Curriculum Mapping Approach Aligned With Workforce Demand
31 July 2026
Proceedings of the National Academy of Sciences of the United States of America
Race-conscious admissions algorithms and the law.
28 July 2026
Journal of medical Internet research
Digital Transformation in Health Care: Are We on the Right Track?
22 July 2026
This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service