Abstract
Automated Gleason grading of prostate whole slide images
(WSIs) enables faster and more consistent cancer risk stratification. However,
it remains a challenging task due to the subtle morphological differences
between grades, the severe class imbalance arising from rare
patterns, and the diagnostic features that span multiple spatial scales.
Pathology foundation models (FMs) extract strong patch representations
but often operate at a single-scale, which limits spatial context and
disproportionately affects classes that depend on broader context. The
challenge of fusing multiple scales and complementary models, with minimal
data and computational resources, remains unresolved. We propose
a multi-scale classifier built on state-space models. Our method combines
two complementary feature sources: a frozen foundation model,
and a lightweight FastVim, pre-trained on ImageNet and distilled from
the foundation model, that reads the raw image crops. At each scale, a
Mamba model encodes the features from both sources with linear-time
spatial context, and a jointly trained head fuses the encoded representations
into one prediction. On the PANDA dataset, our method reaches
macro F1 of 0.894 and Gleason 5 F1 of 0.802 under 5-fold cross-validation,
a 12% and 21% relative improvement over the best single-scale model. A
controlled study over 5 foundation models, 5 base classifiers and 3 scales
confirms that the gain holds across encoders, with larger improvements
observed at smaller scales.
Links to Paper and Supplementary Materials
Main Paper (Open Access Version): https://papers.miccai.org/miccai-2026-sat/paper/COMPAYL_046.pdf
SharedIt Link: Not yet available
SpringerLink (DOI): Not yet available
Supplementary Material: https://papers.miccai.org/miccai-2026-sat/supp/COMPAYL_046_supp.pdf
Link to Open Review
BibTex
@InProceedings{ZhaZih_Multiscale_MICCAISAT2026,
author = { Zhang, Zihe AND Yu, Weimiao AND Don Simonge, Piumi},
title = { { Multi-scale Fusion of Fast Vision Mamba and Foundation Model Features for Patch-Level Gleason Grading in Computational Pathology } },
booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026 Workshops and Challenges},
year = {2026},
publisher = {Springer Nature Switzerland},
volume = {LNCS 17251},
month = {pending},
page = {pending}
}
