MedicalBenchmark
AllenAI: Olmo 3.1 32B Think provider

Olmo 3.1 32B Think

244

#244 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

412.00 pts

Accuracy

74.0%

Correct / Incorrect

444 / 96

Total Cost

$1.14

Overall Performance

(vs. average)
Accuracy

74.0%

avg: 80.6%

Net score

412.00 pts

avg: 453.30 pts

Correct

444

avg: 483

Incorrect

96

avg: 90

Total Cost

$1.14

avg: $9.58

Average response time

46.9s

avg: 17.9s

Output Tokens

2.2M

avg: 1.3M

Reasoning Tokens

2.0M

avg: 898K

Average confidence

88.0%

avg: 95.4%

Breakdown by Exam

MIR 2024
245
Correct
150
Incorrect
30
Accuracy
75.0%
Net score
140.00
MIR 2025
246
Correct
141
Incorrect
40
Accuracy
70.5%
Net score
127.66
MIR 2026
241
Correct
153
Incorrect
26
Accuracy
76.5%
Net score
144.33