Abstract

The integration of neural-network-based systems into clin- ical practice is limited by challenges related to domain generalization androbustness.Thecomputervisioncommunityestablishedbenchmarks such as ImageNet-C as a fundamental prerequisite to measure progress towards those challenges. Similar datasets are largely absent in the med- ical imaging community which lacks a comprehensive benchmark that spans across imaging modalities and applications. To address this gap, we create and open-source MedMNIST-C, a benchmark dataset based on the MedMNIST+ collection, covering 12 datasets and 9 imaging modali- ties. We simulate task and modality-specific image corruptions of varying severity to comprehensively evaluate the robustness of established algo- rithms against real-world artifacts and distribution shifts. We further provide quantitative evidence that our simple-to-use artificial corrup- tions allow for highly performant, lightweight data augmentation to en- hance model robustness. Unlike traditional, generic augmentation strate- gies, our approach leverages domain knowledge, exhibiting significantly higher robustness when compared to widely adopted methods. By intro- ducing MedMNIST-C andopen-sourcingthecorrespondinglibraryallowing for targeted data augmentations, we contribute to the development of in- creasingly robust methods tailored to the challenges of medical imaging. The code is available at github.com/francescodisalvo05/medmnistc-api.

Links to Paper and Supplementary Materials

Main Paper (Open Access Version): https://papers.miccai.org/miccai-2026-sat/paper/ADSMI2024_022.pdf

SharedIt Link: Not yet available

SpringerLink (DOI): Not yet available

Supplementary Material: Not Submitted

Link to Open Review

Open Review Page: Not Available

BibTex

@InProceedings{DiFra_MedMNISTC_MICCAISAT2026,
        author = { Di Salvo, Francesco AND Doerrich, Sebastian AND Ledig, Christian},
        title = { { MedMNIST-C: Comprehensive benchmark and improved classifier robustness by simulating realistic image corruptions } },
        booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026 Workshops and Challenges},
        year = {2026},
        publisher = {Springer Nature Switzerland},
        volume = {LNCS 17276},
        month = {pending},
        page = {pending}
}


back to top