Abstract
Multimodal medical image fusion integrates spatially aligned scans into a unified representation to facilitate comprehensive clinical assessments. However, the diagnostic utility of these composite representations is frequently compromised by inherent spatial resolution limits and complex inter-modality discrepancies. Existing approaches typically perform fusion and super-resolution (SR) in separate stages, leading to artifacts and degraded perceptual quality. These limitations are further amplified in tri-modal scenarios, where combining anatomical modalities (e.g., Magnetic Resonance Imaging (MRI), Computed Tomography (CT)) with functional scans (e.g., Positron Emission Tomography (PET), Single-Photon Emission Computed Tomography (SPECT)) introduces pronounced frequency-domain imbalances. To address this, we propose TriFusion-SR, a wavelet-guided conditional diffusion framework for joint tri-modal fusion and SR. Our framework explicitly decomposes multimodal features into frequency bands using the 2D Discrete Wavelet Transform (DWT), enabling frequency-aware cross-modal interaction. To mitigate spectral conflicts and dynamically balance structural and textural details prior to integration, we introduce a latent coefficient calibration strategy termed Rectified Wavelet Features (RWF). This is subsequently processed by an Adaptive Spatial-Frequency Fusion (ASFF) module, which utilizes gated channel-spatial attention for structure-driven multimodal refinement. Extensive experi
Links to Paper and Supplementary Materials
Main Paper (Open Access Version): https://papers.miccai.org/miccai-2026-sat/paper/RIME_004.pdf
SharedIt Link: Not yet available
SpringerLink (DOI): Not yet available
Supplementary Material: Not Submitted
Link to Open Review
Open Review Page: https://openreview.net/forum?id=5DNyJKIQHA
BibTex
@InProceedings{DhaFay_TriFusionSR_MICCAISAT2026,
author = { Dharejo, Fayaz Ali AND S. M. A., Sharif AND Khalil, Aiman AND Chaudhary, Nachiket AND Naqvi, Rizwan Ali AND Timofte, Radu},
title = { { TriFusion-SR: Joint Tri-Modal Medical Image Fusion and SR } },
booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026 Workshops and Challenges},
year = {2026},
publisher = {Springer Nature Switzerland},
volume = {LNCS 17277},
month = {pending},
page = {pending}
}
