MedicalBenchmark

Access structured medical AI evaluation data

Datasets

Download complete datasets with MIR questions, AI model responses, and performance metrics. Ideal for academic research and model development.

What's included in the dataset?

Complete data for research and development

Structured data

Complete MIR questions with statement, answer options, correct answer, and classification metadata by specialty and type.

Multiple exams

Data from all evaluated MIR exam editions, with coverage from 2024 to the most recent available edition.

Model responses

Complete responses from each evaluated AI model, including selected answer, reasoning, and confidence level.

Open format

Available in CSV, JSON, and Parquet for maximum compatibility with data analysis tools and machine learning frameworks.

Regular updates

The dataset is updated with each new model evaluation and exam edition, ensuring always current data.

Academic license

License for academic research and non-commercial development. Contact us for commercial licenses.

How does it work?

Four steps to access the dataset

1

Request access

Fill out the form with information about your project and use case. We'll review your request within 24-48 hours.

2

Review

Our team will review your request and verify it complies with our acceptable use policies.

3

Receive access

Once your request is approved, you'll receive access credentials and download link via email.

4

Download

Download the dataset in your preferred format and start your research.

Request dataset access

Fill out the form and we'll get in touch with you

I consent to MedicalBenchmark processing my personal data (name, organization, email and project data provided) to manage my dataset access request and contact regarding it. Legal basis: explicit consent (Art. 6.1.a GDPR). I can exercise my rights of access, rectification, erasure, objection and portability through the contact page.