Abstract
In medical imaging, saliency maps are among the most common ways to communicate model reasoning, yet a plausible-looking map may not faithfully reflect the evidence a model actually uses. This limitation is amplified in frozen foundation-model pipelines, where large vision transformers separate representation learning from downstream decision-making and combine global [CLS] summaries with local patch-token evidence. We audited the plausibility-faithfulness gap in a frozen chest X-ray foundation model for osteoporosis screening. Exploiting its linear pooled-patch classifier pathway, we derived an exact per-patch attribution for the pooled-patch contribution to the decision margin and used it as a branch-level faithfulness reference. On external radiographs (n = 295), input-gradient saliency assigns, on average, 1.92x more mass to the spine than the exact pooled-patch attribution and exceeds it in all 295 cases, while the spine is clinically plausible for osteoporosis. This reveals a false-trust failure mode: saliency can make a model appear more clinically grounded than its exact decision attribution supports. We present this as a focused interpretability audit and argue for quantitative faithfulness checks before deploying heatmap-based explanations on medical foundation models.
Links to Paper and Supplementary Materials
Main Paper (Open Access Version): https://papers.miccai.org/miccai-2026-sat/paper/iMIMIC_014.pdf
SharedIt Link: Not yet available
SpringerLink (DOI): Not yet available
Supplementary Material: Not Submitted
Link to Open Review
Open Review Page: Not Available
BibTex
@InProceedings{KimKeu_When_MICCAISAT2026,
author = { Kim, Keun Woo AND Lee, Jemyoung AND Kim, Mingyu},
title = { { When Saliency Over-Credits Anatomy: Token-Level Evidence Flow in Frozen Medical Vision Transformers } },
booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026 Workshops and Challenges},
year = {2026},
publisher = {Springer Nature Switzerland},
volume = {LNCS 17279},
month = {pending},
page = {pending}
}