MEL-IA: An Interoperable AI System for Multimodal Skin Lesion Classification in Hospital Settings

Clinical Snapshot

Key Findings

• P Value: Not reported

• Effect Size: Internal validation: accuracy 0.86, macro F1-score 0.85; External validation: accuracy 0.84, balanced accuracy 0.65

• Primary Outcome: Diagnostic accuracy for skin lesion classification

• Nnt Or Sensitivity: Melanoma sensitivity 0.60, basal cell carcinoma sensitivity 0.72

• Confidence Interval: Not reported

Clinical Application

Demonstrated technical feasibility with >99% successful integration and real-time processing Relevant to Australian dermatology services, though TGA approval would be required for clinical use. Integration with existing PACS systems in Australian hospitals appears feasible Patients presenting with skin lesions in hospital dermatology departments

Abstract

UNLABELLED: Skin cancer represents a growing healthcare challenge, motivating the development of AI sytems that can support lesion assessment while integrating efficiently into clinical workflows. This study presents MEL-IA (MobilE skin Lesion dIAgnosis), an interoperable AI system designed for automated skin lesion classification and full integration with hospital information systems. METHODS: The system combines dermatoscopic images and structured clinical metadata using an EfficientNet-B4 - based multimodal model trained on the ISIC 2019 BCN_20000 and MSK subsets. Internal robustness was assessed through stratified 5-fold cross-validation, and external generalization was evaluated on the independent HAM10000 dataset. Interoperability and operational performance were validated through deployment in a real hospital environment using HL7, DICOM, PACS, and HIS/RIS systems. RESULTS: We evaluated internal robustness using stratified five‑fold cross‑validation, with global accuracy of 0.86, macro F1-score of 0.85, and AUC values above 0.97. The external evaluation showed that the model generalizes well under different acquisition conditions, achieving an accuracy of 0.84 and balanced accuracy of 0.65, with sensitivities of 0.60 for melanoma 0.72 for basal cell carcinoma. The multimodal model outperformed the image model baseline across all classes. Technical deployment confirmed full interoperability, > 99% successful study integration, and near real time processing. CONCLUSIONS: MEL-IA provides multimodal skin lesion classification capabilities and integrates smoothly into hospital infrastructures based on standards. The results demonstrate technical feasibility, interoperability, and operational viability for deployment within dermatology oriented clinical workflows. Further clinical validation studies are warranted to assess the system's impact on diagnostic decision-making and patient outcomes.

References

1. 1.Córcoles, P. C., De Ramón Fernández, A., Calvo, M. S., Serrano, J. M. S., Peral, D. G., & Fernández, D. R. (2026). MEL-IA: An Interoperable AI System for Multimodal Skin Lesion Classification in Hospital Settings. Journal of Medical Systems. https://doi.org/10.1007/s10916-026-02424-y