MedicalBenchmark
OpenAI: o1 provider

o1

34

#34 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

569.33 pts

Accuracy

96.2%

Correct / Incorrect

577 / 23

Total Cost

$72.39

Overall Performance

(vs. average)
Accuracy

96.2%

avg: 80.6%

Net score

569.33 pts

avg: 453.30 pts

Correct

577

avg: 483

Incorrect

23

avg: 90

Total Cost

$72.39

avg: $9.58

Average response time

10.4s

avg: 17.9s

Output Tokens

657K

avg: 1.3M

Reasoning Tokens

483K

avg: 898K

Average confidence

99.9%

avg: 95.4%

Breakdown by Exam

MIR 2024
33
Correct
193
Incorrect
7
Accuracy
96.5%
Net score
190.66
MIR 2025
63
Correct
186
Incorrect
14
Accuracy
93.0%
Net score
181.33
MIR 2026
14
Correct
198
Incorrect
2
Accuracy
99.0%
Net score
197.33