Research Appraisalother

The impact of data consistency on deep learning models for nasopharyngeal cancer organ auto-segmentation

Biomedical physics & engineering expressFang, Yingtao, Wang, Jiazhou, He, Xiayun et al.10 Apr 2026DOI

Clinical Snapshot

85CEBM
Evidence: Moderateother

PICO Framework

P — Population1,301 nasopharyngeal carcinoma patients undergoing radiotherapy planning with CT scans
I — InterventionDeep learning U-Net models trained on consistent single-physician annotations versus heterogeneous multi-physician annotations
C — ComparatorModels trained on different annotation consistency levels (single physician vs multi-physician teams)
O — OutcomesDice similarity coefficients (DSC) for organ-at-risk auto-contouring accuracy across 14 critical structures

Bottom Line

This methodology study demonstrates that annotation consistency is more critical than dataset size for deep learning auto-contouring performance in nasopharyngeal cancer radiotherapy. Small datasets with consistent single-physician annotations outperformed large heterogeneous datasets, while physician-specific fine-tuning of pre-trained models achieved optimal results. For Australian radiation oncology departments, these findings suggest prioritising annotation standardisation protocols and implementing targeted model fine-tuning rather than simply accumulating large volumes of inconsistently annotated data. The 6-7% improvement in segmentation accuracy could translate to more precise treatment planning and potentially better patient outcomes, though clinical validation studies are needed to confirm downstream benefits.

Evidence: Moderate

Key Findings

  • P Value: Not reported in abstract

  • Effect Size: Fine-tuned Model C achieved 6-7% DSC improvement over baseline

  • Primary Outcome: Dice similarity coefficient for organ-at-risk auto-contouring accuracy

  • Nnt Or Sensitivity: Model A: DSC 0.777; Model B: DSC 0.806; Fine-tuned Model C: DSC 0.795-0.814

  • Confidence Interval: Not reported in abstract

Clinical Application

Requires institutional commitment to annotation consistency and model fine-tuning protocols Relevant to Australian radiation oncology centres using auto-contouring systems, particularly given TGA requirements for medical device validation and RANZCR guidelines for radiotherapy quality assurance Radiation oncology departments treating nasopharyngeal cancer patients requiring precise organ-at-risk delineation

Abstract

Purpose. To investigate how annotation consistency influences deep learning-based auto-contouring performance for organs-at-risk (OARs) in nasopharyngeal cancer radiotherapy.Methods. We evaluated CT scans from 1,301 nasopharyngeal carcinoma patients: 65 contoured by Physician A, 76 by Physician B, and 1,160 by heterogeneous multi-physician teams. Three cohorts (50 samples each for Physicians A/B; 1,000 for multi-physician) with standardized U-Net training protocols generated Models A, B, and C. Model C underwent physician-specific fine-tuning. Performance was quantified via Dice similarity coefficients (DSC) against ground-truth contours across 14 critical OARs.Results. Each model achieved peak accuracy on physician-matched test data. Critically, small-consistency models (A/B) outperformed large-heterogeneous Model C on target cohorts (Model A: 0.777 versus Model C's 0.743 on Test A; Model B: 0.806 versus 0.765 on Test B). Physician-specific fine-tuning closed institutional data gaps, boosting Model C's DSC to 0.795 (+7.08% versus original) on Test A and 0.814 (+6.32%) on Test B-surpassing both original Model C and dedicated small-data models (Model A: +2.39%; Model B: +0.97%).Conclusion. Annotation consistency supersedes dataset scale as the primary performance driver for OAR auto-contouring. Small high-consistency datasets enable optimal native model accuracy, whereas fine-tuning large pre-trained models with targeted physician data closes domain adaptation gaps and delivers state-of-the-art segmentation, advancing precision radiotherapy for head and neck oncology.​.

References

  1. 1.Fang, Y., Wang, J., He, X., Hu, C., Yu, L., Guo, Y., Zhong, Y., Mi, J., Chen, S., Qiao, J., Yang, Y., & Hu, W. (2026). The impact of data consistency on deep learning models for nasopharyngeal cancer organ auto-segmentation. Biomedical Physics & Engineering Express. https://doi.org/10.1088/2057-1976/ae596e
Share:XLinkedIn

This content is for educational purposes for healthcare professionals only and does not constitute clinical advice. Clinical decisions should be based on individual patient assessment, current guidelines, and appropriate specialist consultation. Editorial Standards · Privacy Policy · Terms of Service