Abstract
While Large Language Models (LLMs) have demonstrated high prociency on English-centric medical examinations, their perfor- mance often declines when faced with non-English languages and multi- modal diagnostic tasks. We present EuropeMedQA, the rst multilingual and multimodal medical examination dataset built from ocial regula- tory exams in Italy, France, Spain, and Portugal. We describe a rigorous curation process and an automated translation pipeline for comparative analysis. We evaluated three contemporary LLMs (OpenAI gpt-5-mini, Anthropic Claude Haiku 3.5, and Claude Sonnet 4.5), using a zero-shot, strictly constrained prompting strategy to assess cross-lingual transfer and visual reasoning. EuropeMedQA aims to provide a contamination- mitigating benchmark that reects the complexity of European clinical practices and fosters the development of more generalizable medical AI.
Links to Paper and Supplementary Materials
Main Paper (Open Access Version): https://papers.miccai.org/miccai-2026-sat/paper/AMAI_038.pdf
SharedIt Link: Not yet available
SpringerLink (DOI): Not yet available
Supplementary Material: Not Submitted
Link to Open Review
Open Review Page: https://openreview.net/forum?id=cdjnOlTjiq
BibTex
@InProceedings{CauFra_EuropeMedQA_MICCAISAT2026,
author = { Causio, Francesco Andrea AND Riccomi, Olivia AND De Vita, Vittorio AND Felizzi, Federico AND Ferramola, Michele AND Tosi, Alessandro AND Cristiano, Antonio AND De Mori, Lorenzo AND Battipaglia, Chiara AND Sawaya, Melissa AND De Angelis, Luigi AND Di Pumpo, Marcello AND Piscitelli, Alessandra AND Risuleo, Pietro Eric AND Longo, Alessia AND Vojvodic, Giulia AND Vassalli, Mariapia AND Castaniti, Bianca Destro AND Scarsi, Nicolò AND Del Medico, Manuel},
title = { { EuropeMedQA: A Multilingual, Multimodal Medical Examination Dataset for Language Model Evaluation } },
booktitle = {Medical Image Computing and Computer Assisted Intervention -- MICCAI 2026 Workshops and Challenges},
year = {2026},
publisher = {Springer Nature Switzerland},
volume = {LNCS 17273},
month = {pending},
page = {pending}
}