Abstract
Differential diagnosis of neurodegenerative diseases is challenging due to the overlap and heterogeneity of brain atrophy patterns observed on structural MRI. Although supervised deep-learning classifiers have shown promising performance, they require large annotated datasets and remain sensitive to domain shift. Vision-Language Models (VLMs) offer a promising paradigm for zero-shot inference by leveraging representations learned from large-scale multimodal pretraining; however, current VLMs struggle with brain MRI interpretation, where diagnosis requires distinguishing subtle, distributed disease-related atrophy patterns from age-related changes. To overcome these challenges, we propose a modular framework that reframes differential diagnosis as reasoning over structured descriptions of brain atrophy rather than raw MRI scans. The framework combines automated brain parcellation and lifespan normative modeling to quantify deviations from expected aging trajectories and converts them into qualitative atrophy reports aligned with neurodegenerative terminology. These reports are then processed by Large Language Models (LLMs), which leverage their pretrained knowledge to perform zero-shot diagnostic reasoning, generating human-readable rationales and a ranked diagnostic hypothesis. Evaluated on a five-class neurodegenerative benchmark, the proposed zero-shot framework outperforms direct MRI-based VLM inference and achieves performance comparable to supervised MRI-based classifiers.
Links to Paper and Supplementary Materials
Main Paper (Open Access Version): https://papers.miccai.org/miccai-2026-sat/paper/ELAMI_008.pdf
SharedIt Link: Not yet available
SpringerLink (DOI): Not yet available
Supplementary Material: Not Submitted
Link to Open Review
Open Review Page: Not Available
BibTex
@InProceedings{ZamAnd_LLMBased_MICCAISAT2026,
author = { Zamai, Andrew AND Fijalkow, Nathanaël AND Mansencal, Boris AND Navet, Éloi AND Simon, Laurent AND Planche, Vincent AND Coupé, Pierrick},
title = { { LLM-Based Differential Diagnosis of Neurodegenerative Diseases from MRI-Derived Brain Atrophy Reports } },
booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026 Workshops and Challenges},
year = {2026},
publisher = {Springer Nature Switzerland},
volume = {LNCS 17262},
month = {pending},
page = {pending}
}