The impact of data consistency on deep learning models for nasopharyngeal cancer organ auto-segmentation
Clinical Snapshot
PICO Framework
| P — Population | 1,301 nasopharyngeal carcinoma patients undergoing radiotherapy planning with CT scans |
| I — Intervention | Deep learning U-Net models trained on consistent single-physician annotations versus heterogeneous multi-physician annotations |
| C — Comparator | Models trained on different annotation consistency levels (single physician vs multi-physician teams) |
| O — Outcomes | Dice similarity coefficients (DSC) for organ-at-risk auto-contouring accuracy across 14 critical structures |
Bottom Line
This methodology study demonstrates that annotation consistency is more critical than dataset size for deep learning auto-contouring performance in nasopharyngeal cancer radiotherapy. Small datasets with consistent single-physician annotations outperformed large heterogeneous datasets, while physician-specific fine-tuning of pre-trained models achieved optimal results. For Australian radiation oncology departments, these findings suggest prioritising annotation standardisation protocols and implementing targeted model fine-tuning rather than simply accumulating large volumes of inconsistently annotated data. The 6-7% improvement in segmentation accuracy could translate to more precise treatment planning and potentially better patient outcomes, though clinical validation studies are needed to confirm downstream benefits.
Key Findings
P Value: Not reported in abstract
Effect Size: Fine-tuned Model C achieved 6-7% DSC improvement over baseline
Primary Outcome: Dice similarity coefficient for organ-at-risk auto-contouring accuracy
Nnt Or Sensitivity: Model A: DSC 0.777; Model B: DSC 0.806; Fine-tuned Model C: DSC 0.795-0.814
Confidence Interval: Not reported in abstract
Clinical Application
Requires institutional commitment to annotation consistency and model fine-tuning protocols Relevant to Australian radiation oncology centres using auto-contouring systems, particularly given TGA requirements for medical device validation and RANZCR guidelines for radiotherapy quality assurance Radiation oncology departments treating nasopharyngeal cancer patients requiring precise organ-at-risk delineation
Abstract
Purpose. To investigate how annotation consistency influences deep learning-based auto-contouring performance for organs-at-risk (OARs) in nasopharyngeal cancer radiotherapy.Methods. We evaluated CT scans from 1,301 nasopharyngeal carcinoma patients: 65 contoured by Physician A, 76 by Physician B, and 1,160 by heterogeneous multi-physician teams. Three cohorts (50 samples each for Physicians A/B; 1,000 for multi-physician) with standardized U-Net training protocols generated Models A, B, and C. Model C underwent physician-specific fine-tuning. Performance was quantified via Dice similarity coefficients (DSC) against ground-truth contours across 14 critical OARs.Results. Each model achieved peak accuracy on physician-matched test data. Critically, small-consistency models (A/B) outperformed large-heterogeneous Model C on target cohorts (Model A: 0.777 versus Model C's 0.743 on Test A; Model B: 0.806 versus 0.765 on Test B). Physician-specific fine-tuning closed institutional data gaps, boosting Model C's DSC to 0.795 (+7.08% versus original) on Test A and 0.814 (+6.32%) on Test B-surpassing both original Model C and dedicated small-data models (Model A: +2.39%; Model B: +0.97%).Conclusion. Annotation consistency supersedes dataset scale as the primary performance driver for OAR auto-contouring. Small high-consistency datasets enable optimal native model accuracy, whereas fine-tuning large pre-trained models with targeted physician data closes domain adaptation gaps and delivers state-of-the-art segmentation, advancing precision radiotherapy for head and neck oncology..
References
- 1.Fang, Y., Wang, J., He, X., Hu, C., Yu, L., Guo, Y., Zhong, Y., Mi, J., Chen, S., Qiao, J., Yang, Y., & Hu, W. (2026). The impact of data consistency on deep learning models for nasopharyngeal cancer organ auto-segmentation. Biomedical Physics & Engineering Express. https://doi.org/10.1088/2057-1976/ae596e
Related Research
Medical physics
Reference-Free large language model agents for physician-guided radiotherapy treatment planning
2 Aug 2026
Cancer medicine
Applications of Artificial Intelligence in Cancer Diagnosis and Treatment
1 Aug 2026
Acta oncologica (Stockholm, Sweden)
User perceptions of machine learning models as decision support for colorectal cancer multidisciplinary team conferences (AID-SIM-2): a qualitative simulation study.
1 Aug 2026
This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service