MedicalBenchmark

Evaluating the future of Medical AI

The definitive evaluation platform for language models on Spain's MIR exams (2024-2026). Trusted by clinicians and researchers.

Our Methodology

How we evaluate artificial intelligence models in the medical field using the MIR exam as a reference.

Official MIR Questions

We use real questions from Spain's MIR exam, the standard for evaluating medical knowledge at a professional level. Each question is verified and categorized by specialty.

Rigorous Evaluation

Each model is evaluated under the same controlled conditions, without access to external information. We measure accuracy, clinical reasoning, and response consistency.

Detailed Analysis

We provide granular metrics by medical specialty, question type, and difficulty level. This allows identifying strengths and areas for improvement for each model.

Questions catalogued by specialists

Distribution of MIR exam questions by subject and type in each edition.

Comprehensive Analysis

Our benchmark provides an exhaustive evaluation of AI model performance in the medical field.

Continuous Evaluation

Performance tracking over time to identify improvements and regressions.

Detailed Metrics

Granular analysis by subject and clinical question type.

Clear Objectives

Standardized benchmarks based on Spain's official MIR exam.

Full Transparency

Open and reproducible methodology with complete access to evaluation criteria.

Constant Updates

Periodic incorporation of new models and MIR exam editions.

Direct Comparison

Rankings and statistics that allow easy performance comparison between models.

Verified Data

Official questions from the Ministry of Health with validated answers.

Questions by Type

Question distribution by type

Anatomy3 questions
Biostatistics3 questions
Diagnosis86 questions
Epidemiology10 questions
Ethics6 questions
Interpretation41 questions
Legal9 questions
Pathophysiology26 questions
Pharmacology16 questions
Prevention17 questions
Prognosis5 questions
Risk17 questions
Tests36 questions
Treatment74 questions

Questions by Subject

Question distribution by subject

Allergology1 questions
Anesthesiology and Resuscitation7 questions
Cardiology25 questions
Dermatology11 questions
Endocrinology and Nutrition16 questions
ENT8 questions
Epidemiology8 questions
Gastroenterology32 questions
Genetics11 questions
Geriatrics14 questions
Gynecology and Obstetrics13 questions
Health Planning and Management10 questions
Hematology11 questions
Immunology6 questions
Infectious Diseases14 questions
Legal Medicine and Bioethics11 questions
Medical Oncology25 questions
Nephrology10 questions
Neurology15 questions
Ophthalmology6 questions
Palliative Care6 questions
Pediatrics22 questions
Pharmacology12 questions
Psychiatry8 questions
Pulmonology17 questions
Radiology-Emergency13 questions
Rheumatology12 questions
Statistics3 questions
Traumatology11 questions
Urology8 questions