MedicalBenchmark
AllenAI: Molmo2 8B provider

Molmo2 8B

274

#274 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

288.66 pts

Accuracy

59.3%

Correct / Incorrect

356 / 202

Total Cost

$0.13

Overall Performance

(vs. average)
Accuracy

59.3%

avg: 80.6%

Net score

288.66 pts

avg: 453.30 pts

Correct

356

avg: 483

Incorrect

202

avg: 90

Total Cost

$0.13

avg: $9.58

Average response time

6.7s

avg: 17.9s

Output Tokens

318K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

92.6%

avg: 95.4%

Breakdown by Exam

MIR 2024
267
Correct
127
Incorrect
62
Accuracy
63.5%
Net score
106.33
MIR 2025
279
Correct
102
Incorrect
78
Accuracy
51.0%
Net score
76.00
MIR 2026
277
Correct
127
Incorrect
62
Accuracy
63.5%
Net score
106.33