MIRA-Ev:A Benchmark for Granular Evidence Detection and Relational Reasoning in Clinical Exams
Merged summary
TL;DR - MIRA-Ev is a multilingual clinical argument-mining benchmark that evaluates whether models identify and correctly relate evidence behind diagnostic answers, rather than merely selecting the right answer.
- Built from Spanish MIR medical licensing-exam cases re-annotated by expert clinicians.
- Labels span-level premises, claims, and directed support or attack relations.
- Evaluates evidence retrieval, argumentative component extraction, and relation classification.
- Provides parallel Spanish, English, and Basque versions, including the first Basque clinical argumentation resource.
Sources (1)
MIRA-Ev:A Benchmark for Granular Evidence Detection and Relational Reasoning in Clinical Exams
TL;DR - MIRA-Ev is a multilingual clinical argument-mining benchmark that evaluates whether models identify and correctly relate evidence behind diagnostic answers, rather than merely selecting the right answer.
- Built from Spanish MIR medical licensing-exam cases re-annotated by expert clinicians.
- Labels span-level premises, claims, and directed support or attack relations.
- Evaluates evidence retrieval, argumentative component extraction, and relation classification.
- Provides parallel Spanish, English, and Basque versions, including the first Basque clinical argumentation resource.