MedicalBenchmark
AllenAI: Molmo2 8B provider

Molmo2 8B

249

#249 of 290 modelsMIR 2026

Net score

106.33 pts

Accuracy

63.5%

Correct / Incorrect

127 / 62

Total Cost

$0.05

Overall Performance

(vs. average)
Accuracy

63.5%

avg: 81.6%

Net score

106.33 pts

avg: 154.00 pts

Correct

127

avg: 163

Incorrect

62

avg: 28

Total Cost

$0.05

avg: $3.33

Average response time

7.6s

avg: 16.2s

Output Tokens

118K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

93.7%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
3
Incorrect
2
Unanswered
2
Accuracy
42.9%
Average
69.6%
Cardiology
Correct
13
Incorrect
8
Unanswered
4
Accuracy
52.0%
Average
77.3%
Dermatology
Correct
9
Incorrect
2
Unanswered
0
Accuracy
81.8%
Average
72.3%
Endocrinology and Nutrition
Correct
9
Incorrect
6
Unanswered
0
Accuracy
60.0%
Average
84.0%
ENT
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
84.7%
Epidemiology
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
80.2%
Gastroenterology
Correct
14
Incorrect
16
Unanswered
0
Accuracy
46.7%
Average
79.3%
Genetics
Correct
5
Incorrect
4
Unanswered
2
Accuracy
45.5%
Average
78.7%
Geriatrics
Correct
8
Incorrect
4
Unanswered
1
Accuracy
61.5%
Average
83.0%
Gynecology and Obstetrics
Correct
10
Incorrect
2
Unanswered
0
Accuracy
83.3%
Average
84.3%
Health Planning and Management
Correct
5
Incorrect
3
Unanswered
2
Accuracy
50.0%
Average
78.4%
Hematology
Correct
3
Incorrect
5
Unanswered
1
Accuracy
33.3%
Average
76.6%
Immunology
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
91.4%
Infectious Diseases
Correct
7
Incorrect
6
Unanswered
1
Accuracy
50.0%
Average
77.9%
Legal Medicine and Bioethics
Correct
9
Incorrect
2
Unanswered
0
Accuracy
81.8%
Average
82.9%
Medical Oncology
Correct
16
Incorrect
6
Unanswered
1
Accuracy
69.6%
Average
83.0%
Nephrology
Correct
7
Incorrect
3
Unanswered
0
Accuracy
70.0%
Average
85.1%
Neurology
Correct
12
Incorrect
1
Unanswered
0
Accuracy
92.3%
Average
88.6%
Ophthalmology
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
83.7%
Palliative Care
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
80.2%
Pediatrics
Correct
12
Incorrect
8
Unanswered
2
Accuracy
54.5%
Average
87.6%
Pharmacology
Correct
9
Incorrect
2
Unanswered
0
Accuracy
81.8%
Average
78.6%
Psychiatry
Correct
7
Incorrect
1
Unanswered
0
Accuracy
87.5%
Average
87.9%
Pulmonology
Correct
10
Incorrect
5
Unanswered
1
Accuracy
62.5%
Average
82.8%
Radiology-Emergency
Correct
6
Incorrect
5
Unanswered
2
Accuracy
46.2%
Average
67.7%
Rheumatology
Correct
8
Incorrect
2
Unanswered
1
Accuracy
72.7%
Average
88.4%
Statistics
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
83.8%
Traumatology
Correct
4
Incorrect
5
Unanswered
2
Accuracy
36.4%
Average
65.2%
Urology
Correct
7
Incorrect
1
Unanswered
0
Accuracy
87.5%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
82.6%
Biostatistics
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
83.8%
Diagnosis
Correct
51
Incorrect
27
Unanswered
3
Accuracy
63.0%
Average
82.2%
Epidemiology
Correct
7
Incorrect
2
Unanswered
0
Accuracy
77.8%
Average
88.7%
Ethics
Correct
6
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
92.0%
Interpretation
Correct
16
Incorrect
14
Unanswered
7
Accuracy
43.2%
Average
72.0%
Legal
Correct
8
Incorrect
1
Unanswered
0
Accuracy
88.9%
Average
82.4%
Pathophysiology
Correct
19
Incorrect
5
Unanswered
2
Accuracy
73.1%
Average
84.3%
Pharmacology
Correct
11
Incorrect
4
Unanswered
0
Accuracy
73.3%
Average
82.3%
Prevention
Correct
6
Incorrect
9
Unanswered
1
Accuracy
37.5%
Average
80.6%
Prognosis
Correct
4
Incorrect
1
Unanswered
0
Accuracy
80.0%
Average
93.2%
Risk
Correct
9
Incorrect
6
Unanswered
0
Accuracy
60.0%
Average
84.3%
Tests
Correct
23
Incorrect
9
Unanswered
1
Accuracy
69.7%
Average
80.3%
Treatment
Correct
43
Incorrect
25
Unanswered
4
Accuracy
59.7%
Average
80.1%
#AnswerCorrectStatus
1BA
2B
3AD
4BD
5BB
6C
7CB
8AD
9DD
10AA
11B
12CA
13DAnnulled
14BC
15CA
16CC
17CC
18BD
19BB
20BB
21BB
22C
23CB
24A
25C
26A
27DB
28DD
29AA
30AD
31DC
32CC
33BB
34AB
35BC
36BD
37DD
38AA
39CC
40AA
41AD
42A
43BB
44BB
45AB
46BB
47DD
48CC
49CC
50BAnnulled
51AA
52CC
53CC
54CC
55AA
56BA
57BA
58AA
59AB
60BB
61CC
62BB
63BB
64AAnnulled
65CC
66DC
67CC
68AA
69BB
70BB
71BB
72BB
73BB
74AA
75CC
76CC
77CA
78DD
79AA
80AD
81CC
82CD
83DB
84CA
85DD
86AA
87BB
88BB
89BB
90CC
91BA
92CC
93AD
94AC
95CC
96BB
97DB
98AA
99BB
100CC
101CC
102AA
103CC
104CC
105CC
106BB
107CC
108AA
109CC
110AC
111AB
112AC
113CC
114DD
115BB
116DD
117CC
118AB
119DA
120AA
121CC
122BB
123BB
124B
125CC
126BB
127C
128CB
129AC
130CC
131BB
132BB
133CC
134CB
135CC
136BB
137AD
138BB
139BAnnulled
140DD
141AA
142BAnnulled
143BA
144AD
145CC
146AC
147DB
148BC
149BB
150BB
151BB
152CC
153BC
154DD
155BB
156BA
157DD
158BB
159CC
160AA
161CAnnulled
162AA
163AC
164CC
165AA
166AA
167DD
168CC
169BB
170BB
171AA
172AB
173AD
174AC
175BB
176DA
177AD
178AD
179BB
180CC
181DB
182CC
183CD
184DD
185BB
186DD
187BD
188CC
189AC
190BB
191DD
192BD
193CC
194CC
195DD
196AA
197CC
198BA
199B
200DD
201CC
202BA
203AA
204AC
205BB
206CC
207AA
208DAnnulled
209BB
210CC