MedicalBenchmark
Meta: Llama 3.2 1B Instruct provider

Llama 3.2 1B Instruct

315

#315 of 319 models — MIR 2026

Net score

24.66 pts

Accuracy

22.0%

Correct / Incorrect

44 / 58

Total Cost

$0.02

Overall Performance

(vs. average)
Accuracy

22.0%

avg: 82.4%

Net score

24.66 pts

avg: 156.14 pts

Correct

44

avg: 165

Incorrect

58

avg: 26

Total Cost

$0.02

avg: $3.12

Average response time

2.7s

avg: 17.4s

Output Tokens

88K

avg: 415K

Reasoning Tokens

0

avg: 295K

Average confidence

50.7%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
0
Incorrect
5
Unanswered
2
Accuracy
0.0%
Average
71.0%
Cardiology
Correct
5
Incorrect
10
Unanswered
10
Accuracy
20.0%
Average
78.4%
Dermatology
Correct
1
Incorrect
4
Unanswered
6
Accuracy
9.1%
Average
73.2%
Endocrinology and Nutrition
Correct
6
Incorrect
2
Unanswered
7
Accuracy
40.0%
Average
84.7%
ENT
Correct
2
Incorrect
0
Unanswered
6
Accuracy
25.0%
Average
85.0%
Epidemiology
Correct
2
Incorrect
1
Unanswered
4
Accuracy
28.6%
Average
81.3%
Gastroenterology
Correct
9
Incorrect
8
Unanswered
13
Accuracy
30.0%
Average
80.2%
Genetics
Correct
2
Incorrect
3
Unanswered
6
Accuracy
18.2%
Average
79.7%
Geriatrics
Correct
4
Incorrect
2
Unanswered
7
Accuracy
30.8%
Average
83.7%
Gynecology and Obstetrics
Correct
3
Incorrect
2
Unanswered
7
Accuracy
25.0%
Average
85.2%
Health Planning and Management
Correct
2
Incorrect
3
Unanswered
5
Accuracy
20.0%
Average
79.4%
Hematology
Correct
0
Incorrect
4
Unanswered
5
Accuracy
0.0%
Average
77.6%
Immunology
Correct
2
Incorrect
2
Unanswered
2
Accuracy
33.3%
Average
91.8%
Infectious Diseases
Correct
5
Incorrect
1
Unanswered
8
Accuracy
35.7%
Average
79.0%
Legal Medicine and Bioethics
Correct
2
Incorrect
2
Unanswered
7
Accuracy
18.2%
Average
83.4%
Medical Oncology
Correct
2
Incorrect
3
Unanswered
18
Accuracy
8.7%
Average
83.7%
Nephrology
Correct
2
Incorrect
3
Unanswered
5
Accuracy
20.0%
Average
85.6%
Neurology
Correct
6
Incorrect
2
Unanswered
5
Accuracy
46.2%
Average
89.0%
Ophthalmology
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
84.5%
Palliative Care
Correct
2
Incorrect
1
Unanswered
3
Accuracy
33.3%
Average
80.8%
Pediatrics
Correct
5
Incorrect
8
Unanswered
9
Accuracy
22.7%
Average
88.1%
Pharmacology
Correct
2
Incorrect
2
Unanswered
7
Accuracy
18.2%
Average
79.6%
Psychiatry
Correct
2
Incorrect
4
Unanswered
2
Accuracy
25.0%
Average
88.4%
Pulmonology
Correct
5
Incorrect
4
Unanswered
7
Accuracy
31.3%
Average
83.6%
Radiology-Emergency
Correct
0
Incorrect
8
Unanswered
5
Accuracy
0.0%
Average
69.4%
Rheumatology
Correct
2
Incorrect
2
Unanswered
7
Accuracy
18.2%
Average
89.0%
Statistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
84.5%
Traumatology
Correct
1
Incorrect
5
Unanswered
5
Accuracy
9.1%
Average
66.6%
Urology
Correct
2
Incorrect
0
Unanswered
6
Accuracy
25.0%
Average
83.1%

Question Type Breakdown

Anatomy
Correct
0
Incorrect
1
Unanswered
2
Accuracy
0.0%
Average
83.4%
Biostatistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
84.5%
Diagnosis
Correct
15
Incorrect
22
Unanswered
44
Accuracy
18.5%
Average
83.0%
Epidemiology
Correct
3
Incorrect
1
Unanswered
5
Accuracy
33.3%
Average
89.1%
Ethics
Correct
1
Incorrect
2
Unanswered
3
Accuracy
16.7%
Average
92.2%
Interpretation
Correct
7
Incorrect
12
Unanswered
18
Accuracy
18.9%
Average
73.2%
Legal
Correct
1
Incorrect
1
Unanswered
7
Accuracy
11.1%
Average
82.9%
Pathophysiology
Correct
8
Incorrect
9
Unanswered
9
Accuracy
30.8%
Average
85.0%
Pharmacology
Correct
4
Incorrect
4
Unanswered
7
Accuracy
26.7%
Average
83.1%
Prevention
Correct
3
Incorrect
3
Unanswered
10
Accuracy
18.8%
Average
81.5%
Prognosis
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
93.2%
Risk
Correct
1
Incorrect
6
Unanswered
8
Accuracy
6.7%
Average
85.0%
Tests
Correct
10
Incorrect
7
Unanswered
16
Accuracy
30.3%
Average
81.2%
Treatment
Correct
17
Incorrect
24
Unanswered
31
Accuracy
23.6%
Average
80.9%
#AnswerCorrectStatus
1—A
2BB
3BD
4CD
5BB
6BC
7—B
8—D
9—D
10—A
11AB
12—A
13C—Annulled
14AC
15AA
16—C
17—C
18BD
19BB
20CB
21CB
22—C
23—B
24—A
25AC
26—A
27DB
28CD
29—A
30—D
31CC
32—C
33BB
34—B
35CC
36—D
37AD
38AA
39—C
40—A
41AD
42BA
43—B
44—B
45—B
46—B
47AD
48CC
49CC
50D—Annulled
51—A
52—C
53CC
54—C
55—A
56AA
57AA
58AA
59AB
60—B
61BC
62DB
63CB
64——Annulled
65—C
66CC
67BC
68AA
69AB
70BB
71AB
72—B
73—B
74CA
75—C
76BC
77—A
78—D
79CA
80BD
81—C
82DD
83DB
84—A
85—D
86—A
87—B
88—B
89—B
90BC
91—A
92—C
93DD
94BC
95AC
96AB
97—B
98—A
99AB
100—C
101CC
102—A
103—C
104AC
105BC
106AB
107AC
108BA
109BC
110—C
111—B
112—C
113—C
114CD
115—B
116CD
117—C
118CB
119—A
120DA
121—C
122—B
123BB
124DB
125CC
126—B
127CC
128BB
129—C
130CC
131CB
132—B
133—C
134—B
135—C
136—B
137CD
138—B
139C—Annulled
140CD
141—A
142——Annulled
143—A
144—D
145—C
146BC
147BB
148CC
149—B
150—B
151BB
152AC
153—C
154DD
155—B
156AA
157DD
158—B
159—C
160AA
161A—Annulled
162AA
163DC
164—C
165—A
166—A
167AD
168CC
169BB
170BB
171—A
172—B
173DD
174—C
175AB
176—A
177AD
178—D
179—B
180—C
181BB
182CC
183—D
184—D
185—B
186—D
187DD
188BC
189CC
190BB
191—D
192AD
193—C
194—C
195—D
196—A
197—C
198BA
199AB
200—D
201CC
202BA
203AA
204—C
205CB
206—C
207—A
208——Annulled
209DB
210—C