MedicalBenchmark
Meta: Llama 3.2 11B Vision Instruct provider

Llama 3.2 11B Vision Instruct

278

#278 of 290 modelsMIR 2026

Net score

52.00 pts

Accuracy

33.0%

Correct / Incorrect

66 / 42

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

33.0%

avg: 81.6%

Net score

52.00 pts

avg: 154.00 pts

Correct

66

avg: 163

Incorrect

42

avg: 28

Total Cost

$0.04

avg: $3.33

Average response time

50.6s

avg: 16.2s

Output Tokens

261K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

53.8%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
1
Incorrect
2
Unanswered
4
Accuracy
14.3%
Average
69.6%
Cardiology
Correct
7
Incorrect
6
Unanswered
12
Accuracy
28.0%
Average
77.3%
Dermatology
Correct
1
Incorrect
3
Unanswered
7
Accuracy
9.1%
Average
72.3%
Endocrinology and Nutrition
Correct
7
Incorrect
3
Unanswered
5
Accuracy
46.7%
Average
84.0%
ENT
Correct
6
Incorrect
0
Unanswered
2
Accuracy
75.0%
Average
84.7%
Epidemiology
Correct
2
Incorrect
1
Unanswered
4
Accuracy
28.6%
Average
80.2%
Gastroenterology
Correct
10
Incorrect
6
Unanswered
14
Accuracy
33.3%
Average
79.3%
Genetics
Correct
6
Incorrect
3
Unanswered
2
Accuracy
54.5%
Average
78.7%
Geriatrics
Correct
3
Incorrect
5
Unanswered
5
Accuracy
23.1%
Average
83.0%
Gynecology and Obstetrics
Correct
6
Incorrect
1
Unanswered
5
Accuracy
50.0%
Average
84.3%
Health Planning and Management
Correct
2
Incorrect
2
Unanswered
6
Accuracy
20.0%
Average
78.4%
Hematology
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
76.6%
Immunology
Correct
2
Incorrect
2
Unanswered
2
Accuracy
33.3%
Average
91.4%
Infectious Diseases
Correct
2
Incorrect
4
Unanswered
8
Accuracy
14.3%
Average
77.9%
Legal Medicine and Bioethics
Correct
6
Incorrect
1
Unanswered
4
Accuracy
54.5%
Average
82.9%
Medical Oncology
Correct
7
Incorrect
3
Unanswered
13
Accuracy
30.4%
Average
83.0%
Nephrology
Correct
4
Incorrect
2
Unanswered
4
Accuracy
40.0%
Average
85.1%
Neurology
Correct
6
Incorrect
2
Unanswered
5
Accuracy
46.2%
Average
88.6%
Ophthalmology
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
83.7%
Palliative Care
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
80.2%
Pediatrics
Correct
7
Incorrect
6
Unanswered
9
Accuracy
31.8%
Average
87.6%
Pharmacology
Correct
2
Incorrect
3
Unanswered
6
Accuracy
18.2%
Average
78.6%
Psychiatry
Correct
0
Incorrect
3
Unanswered
5
Accuracy
0.0%
Average
87.9%
Pulmonology
Correct
3
Incorrect
4
Unanswered
9
Accuracy
18.8%
Average
82.8%
Radiology-Emergency
Correct
3
Incorrect
5
Unanswered
5
Accuracy
23.1%
Average
67.7%
Rheumatology
Correct
3
Incorrect
3
Unanswered
5
Accuracy
27.3%
Average
88.4%
Statistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
3
Incorrect
4
Unanswered
4
Accuracy
27.3%
Average
65.2%
Urology
Correct
3
Incorrect
0
Unanswered
5
Accuracy
37.5%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
27
Incorrect
15
Unanswered
39
Accuracy
33.3%
Average
82.2%
Epidemiology
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
88.7%
Ethics
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
14
Incorrect
10
Unanswered
13
Accuracy
37.8%
Average
72.0%
Legal
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
82.4%
Pathophysiology
Correct
12
Incorrect
7
Unanswered
7
Accuracy
46.2%
Average
84.3%
Pharmacology
Correct
5
Incorrect
4
Unanswered
6
Accuracy
33.3%
Average
82.3%
Prevention
Correct
2
Incorrect
3
Unanswered
11
Accuracy
12.5%
Average
80.6%
Prognosis
Correct
3
Incorrect
0
Unanswered
2
Accuracy
60.0%
Average
93.2%
Risk
Correct
5
Incorrect
2
Unanswered
8
Accuracy
33.3%
Average
84.3%
Tests
Correct
12
Incorrect
7
Unanswered
14
Accuracy
36.4%
Average
80.3%
Treatment
Correct
20
Incorrect
18
Unanswered
34
Accuracy
27.8%
Average
80.1%
#AnswerCorrectStatus
1A
2B
3CD
4D
5BB
6BC
7BB
8DD
9CD
10A
11AB
12A
13DAnnulled
14BC
15AA
16CC
17C
18AD
19B
20B
21B
22C
23BB
24AA
25C
26A
27B
28D
29AA
30D
31C
32CC
33B
34DB
35AC
36D
37D
38CA
39CC
40A
41BD
42BA
43B
44B
45B
46BB
47DD
48CC
49C
50Annulled
51AA
52C
53CC
54C
55AA
56BA
57A
58DA
59B
60B
61C
62B
63DB
64Annulled
65C
66C
67CC
68AA
69B
70B
71B
72B
73BB
74AA
75CC
76C
77CA
78AD
79AA
80CD
81C
82DD
83B
84A
85D
86A
87BB
88B
89B
90CC
91A
92CC
93D
94C
95C
96BB
97BB
98A
99DB
100CC
101CC
102AA
103CC
104CC
105C
106AB
107CC
108BA
109AC
110C
111B
112C
113DC
114D
115B
116D
117BC
118B
119A
120AA
121CC
122BB
123B
124AB
125CC
126BB
127DC
128BB
129CC
130CC
131B
132B
133C
134B
135C
136B
137CD
138BB
139BAnnulled
140D
141AA
142AAnnulled
143A
144DD
145C
146BC
147B
148C
149B
150DB
151BB
152CC
153C
154CD
155BB
156A
157D
158B
159AC
160AA
161CAnnulled
162CA
163C
164CC
165A
166BA
167DD
168C
169B
170BB
171A
172AB
173D
174AC
175BB
176A
177AD
178D
179BB
180BC
181BB
182BC
183D
184D
185DB
186DD
187DD
188CC
189C
190B
191DD
192D
193C
194AC
195DD
196A
197DC
198BA
199CB
200DD
201CC
202AA
203AA
204C
205BB
206CC
207A
208DAnnulled
209B
210CC