MedicalBenchmark
AllenAI: Olmo 3.1 32B Instruct provider

Olmo 3.1 32B Instruct

278

#278 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

273.00 pts

Accuracy

58.0%

Correct / Incorrect

348 / 225

Total Cost

$0.34

Overall Performance

(vs. average)
Accuracy

58.0%

avg: 80.6%

Net score

273.00 pts

avg: 453.30 pts

Correct

348

avg: 483

Incorrect

225

avg: 90

Total Cost

$0.34

avg: $9.58

Average response time

12.6s

avg: 17.9s

Output Tokens

453K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

94.4%

avg: 95.4%

Breakdown by Exam

MIR 2024
279
Correct
116
Incorrect
76
Accuracy
58.0%
Net score
90.66
MIR 2025
276
Correct
107
Incorrect
83
Accuracy
53.5%
Net score
79.33
MIR 2026
279
Correct
125
Incorrect
66
Accuracy
62.5%
Net score
103.00