MedicalBenchmark
Meta: Llama 3.2 11B Vision Instruct provider

Llama 3.2 11B Vision Instruct

306

#306 of 319 models — MIR 2026

Net score

52.00 pts

Accuracy

33.0%

Correct / Incorrect

66 / 42

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

33.0%

avg: 82.4%

Net score

52.00 pts

avg: 156.14 pts

Correct

66

avg: 165

Incorrect

42

avg: 26

Total Cost

$0.04

avg: $3.12

Average response time

50.6s

avg: 17.4s

Output Tokens

261K

avg: 415K

Reasoning Tokens

0

avg: 295K

Average confidence

53.8%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
1
Incorrect
2
Unanswered
4
Accuracy
14.3%
Average
71.0%
Cardiology
Correct
7
Incorrect
6
Unanswered
12
Accuracy
28.0%
Average
78.4%
Dermatology
Correct
1
Incorrect
3
Unanswered
7
Accuracy
9.1%
Average
73.2%
Endocrinology and Nutrition
Correct
7
Incorrect
3
Unanswered
5
Accuracy
46.7%
Average
84.7%
ENT
Correct
6
Incorrect
0
Unanswered
2
Accuracy
75.0%
Average
85.0%
Epidemiology
Correct
2
Incorrect
1
Unanswered
4
Accuracy
28.6%
Average
81.3%
Gastroenterology
Correct
10
Incorrect
6
Unanswered
14
Accuracy
33.3%
Average
80.2%
Genetics
Correct
6
Incorrect
3
Unanswered
2
Accuracy
54.5%
Average
79.7%
Geriatrics
Correct
3
Incorrect
5
Unanswered
5
Accuracy
23.1%
Average
83.7%
Gynecology and Obstetrics
Correct
6
Incorrect
1
Unanswered
5
Accuracy
50.0%
Average
85.2%
Health Planning and Management
Correct
2
Incorrect
2
Unanswered
6
Accuracy
20.0%
Average
79.4%
Hematology
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
77.6%
Immunology
Correct
2
Incorrect
2
Unanswered
2
Accuracy
33.3%
Average
91.8%
Infectious Diseases
Correct
2
Incorrect
4
Unanswered
8
Accuracy
14.3%
Average
79.0%
Legal Medicine and Bioethics
Correct
6
Incorrect
1
Unanswered
4
Accuracy
54.5%
Average
83.4%
Medical Oncology
Correct
7
Incorrect
3
Unanswered
13
Accuracy
30.4%
Average
83.7%
Nephrology
Correct
4
Incorrect
2
Unanswered
4
Accuracy
40.0%
Average
85.6%
Neurology
Correct
6
Incorrect
2
Unanswered
5
Accuracy
46.2%
Average
89.0%
Ophthalmology
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
84.5%
Palliative Care
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
80.8%
Pediatrics
Correct
7
Incorrect
6
Unanswered
9
Accuracy
31.8%
Average
88.1%
Pharmacology
Correct
2
Incorrect
3
Unanswered
6
Accuracy
18.2%
Average
79.6%
Psychiatry
Correct
0
Incorrect
3
Unanswered
5
Accuracy
0.0%
Average
88.4%
Pulmonology
Correct
3
Incorrect
4
Unanswered
9
Accuracy
18.8%
Average
83.6%
Radiology-Emergency
Correct
3
Incorrect
5
Unanswered
5
Accuracy
23.1%
Average
69.4%
Rheumatology
Correct
3
Incorrect
3
Unanswered
5
Accuracy
27.3%
Average
89.0%
Statistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
84.5%
Traumatology
Correct
3
Incorrect
4
Unanswered
4
Accuracy
27.3%
Average
66.6%
Urology
Correct
3
Incorrect
0
Unanswered
5
Accuracy
37.5%
Average
83.1%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
83.4%
Biostatistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
84.5%
Diagnosis
Correct
27
Incorrect
15
Unanswered
39
Accuracy
33.3%
Average
83.0%
Epidemiology
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
89.1%
Ethics
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
92.2%
Interpretation
Correct
14
Incorrect
10
Unanswered
13
Accuracy
37.8%
Average
73.2%
Legal
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
82.9%
Pathophysiology
Correct
12
Incorrect
7
Unanswered
7
Accuracy
46.2%
Average
85.0%
Pharmacology
Correct
5
Incorrect
4
Unanswered
6
Accuracy
33.3%
Average
83.1%
Prevention
Correct
2
Incorrect
3
Unanswered
11
Accuracy
12.5%
Average
81.5%
Prognosis
Correct
3
Incorrect
0
Unanswered
2
Accuracy
60.0%
Average
93.2%
Risk
Correct
5
Incorrect
2
Unanswered
8
Accuracy
33.3%
Average
85.0%
Tests
Correct
12
Incorrect
7
Unanswered
14
Accuracy
36.4%
Average
81.2%
Treatment
Correct
20
Incorrect
18
Unanswered
34
Accuracy
27.8%
Average
80.9%
#AnswerCorrectStatus
1—A
2—B
3CD
4—D
5BB
6BC
7BB
8DD
9CD
10—A
11AB
12—A
13D—Annulled
14BC
15AA
16CC
17—C
18AD
19—B
20—B
21—B
22—C
23BB
24AA
25—C
26—A
27—B
28—D
29AA
30—D
31—C
32CC
33—B
34DB
35AC
36—D
37—D
38CA
39CC
40—A
41BD
42BA
43—B
44—B
45—B
46BB
47DD
48CC
49—C
50——Annulled
51AA
52—C
53CC
54—C
55AA
56BA
57—A
58DA
59—B
60—B
61—C
62—B
63DB
64——Annulled
65—C
66—C
67CC
68AA
69—B
70—B
71—B
72—B
73BB
74AA
75CC
76—C
77CA
78AD
79AA
80CD
81—C
82DD
83—B
84—A
85—D
86—A
87BB
88—B
89—B
90CC
91—A
92CC
93—D
94—C
95—C
96BB
97BB
98—A
99DB
100CC
101CC
102AA
103CC
104CC
105—C
106AB
107CC
108BA
109AC
110—C
111—B
112—C
113DC
114—D
115—B
116—D
117BC
118—B
119—A
120AA
121CC
122BB
123—B
124AB
125CC
126BB
127DC
128BB
129CC
130CC
131—B
132—B
133—C
134—B
135—C
136—B
137CD
138BB
139B—Annulled
140—D
141AA
142A—Annulled
143—A
144DD
145—C
146BC
147—B
148—C
149—B
150DB
151BB
152CC
153—C
154CD
155BB
156—A
157—D
158—B
159AC
160AA
161C—Annulled
162CA
163—C
164CC
165—A
166BA
167DD
168—C
169—B
170BB
171—A
172AB
173—D
174AC
175BB
176—A
177AD
178—D
179BB
180BC
181BB
182BC
183—D
184—D
185DB
186DD
187DD
188CC
189—C
190—B
191DD
192—D
193—C
194AC
195DD
196—A
197DC
198BA
199CB
200DD
201CC
202AA
203AA
204—C
205BB
206CC
207—A
208D—Annulled
209—B
210CC