Unsupervised multimodal deformable medical image registration based on feature perceptual contrast learning

Clinical Snapshot

Key Findings

• P Value: Not reported

• Effect Size: DSC of 76.3% (T2-T1), 77.7% (T1-T1ce), 50.1% (CT-MR)

• Primary Outcome: Dice similarity coefficient for multimodal image registration

• Nnt Or Sensitivity: Relative improvement over baselines not quantified with statistical measures

• Confidence Interval: Not reported

Clinical Application

Requires significant computational infrastructure and technical expertise for implementation Could support TGA-approved imaging workflows and enhance diagnostic accuracy in Australian radiology departments, particularly for complex cases requiring multimodal fusion Patients requiring multimodal medical imaging for brain tumour assessment and abdominal imaging

Abstract

Objective.Multimodal medical image registration has extensive applications in clinical diagnosis and is fundamental for a series of medical analysis tasks. However, the presence of modality differences makes the registration process challenging. Existing methods often employ modality-independent feature descriptors that are sensitive to noise, or attempt to bridge differences within networks, which typically results in translation inaccuracies and misaligned anatomical information.Approach.In this paper, we propose a novel unsupervised approach utilizing a Feature Perceptual Contrast Learning Network (FP-net) to learn descriptors that bridge modality differences while accurately capturing common details. We unify the feature representation of anatomical information under homogeneous and heterogeneous intensity distributions through local sampling-based feature perceptual contrast learning and image reconstruction learning. The trained FP-net is subsequently employed to drive an unsupervised registration framework without requiring ground-truth deformation fields.Main results.We extensively evaluated our method on two public benchmarks: the BraTS 2021 dataset for brain T2-T1 and T1-T1ce registration, and the Learn2Reg 2021 dataset for challenging abdominal CT-MR registration. By passing multimodal image pairs with shape differences through the fixed FP-net, we generate optimization gradients that successfully update the registration network. Quantitative evaluations demonstrate our method's superiority over state-of-the-art baselines. Specifically, our model achieved a dice similarity coefficient (DSC) of 76.3% and 77.7% in tumor-bearing T2-T1 and T1-T1ce tasks, respectively. Furthermore, in the complex abdominal CT-MR task, it reached a DSC of 50.1%, significantly improving structural alignment.Significance.Our method effectively shifts the burden of bridging the modality gap away from the registration network, enabling standard U-Net architectures to achieve state-of-the-art deformable registration. This provides a robust, accurate, and easily deployable unsupervised solution for complex clinical multimodal image analysis.

References

1. 1.Lin, H., & Song, Y. (2024). Unsupervised multimodal deformable medical image registration based on feature perceptual contrast learning. Physics in Medicine and Biology. https://doi.org/10.1088/1361-6560/ae74b0