MedicalBenchmark
Meta: Llama 3.2 1B Instruct provider

Llama 3.2 1B Instruct

287

#287 of 290 modelsMIR 2026

Net score

24.66 pts

Accuracy

22.0%

Correct / Incorrect

44 / 58

Total Cost

$0.02

Overall Performance

(vs. average)
Accuracy

22.0%

avg: 81.6%

Net score

24.66 pts

avg: 154.00 pts

Correct

44

avg: 163

Incorrect

58

avg: 28

Total Cost

$0.02

avg: $3.33

Average response time

2.7s

avg: 16.2s

Output Tokens

88K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

50.7%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
0
Incorrect
5
Unanswered
2
Accuracy
0.0%
Average
69.6%
Cardiology
Correct
5
Incorrect
10
Unanswered
10
Accuracy
20.0%
Average
77.3%
Dermatology
Correct
1
Incorrect
4
Unanswered
6
Accuracy
9.1%
Average
72.3%
Endocrinology and Nutrition
Correct
6
Incorrect
2
Unanswered
7
Accuracy
40.0%
Average
84.0%
ENT
Correct
2
Incorrect
0
Unanswered
6
Accuracy
25.0%
Average
84.7%
Epidemiology
Correct
2
Incorrect
1
Unanswered
4
Accuracy
28.6%
Average
80.2%
Gastroenterology
Correct
9
Incorrect
8
Unanswered
13
Accuracy
30.0%
Average
79.3%
Genetics
Correct
2
Incorrect
3
Unanswered
6
Accuracy
18.2%
Average
78.7%
Geriatrics
Correct
4
Incorrect
2
Unanswered
7
Accuracy
30.8%
Average
83.0%
Gynecology and Obstetrics
Correct
3
Incorrect
2
Unanswered
7
Accuracy
25.0%
Average
84.3%
Health Planning and Management
Correct
2
Incorrect
3
Unanswered
5
Accuracy
20.0%
Average
78.4%
Hematology
Correct
0
Incorrect
4
Unanswered
5
Accuracy
0.0%
Average
76.6%
Immunology
Correct
2
Incorrect
2
Unanswered
2
Accuracy
33.3%
Average
91.4%
Infectious Diseases
Correct
5
Incorrect
1
Unanswered
8
Accuracy
35.7%
Average
77.9%
Legal Medicine and Bioethics
Correct
2
Incorrect
2
Unanswered
7
Accuracy
18.2%
Average
82.9%
Medical Oncology
Correct
2
Incorrect
3
Unanswered
18
Accuracy
8.7%
Average
83.0%
Nephrology
Correct
2
Incorrect
3
Unanswered
5
Accuracy
20.0%
Average
85.1%
Neurology
Correct
6
Incorrect
2
Unanswered
5
Accuracy
46.2%
Average
88.6%
Ophthalmology
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
83.7%
Palliative Care
Correct
2
Incorrect
1
Unanswered
3
Accuracy
33.3%
Average
80.2%
Pediatrics
Correct
5
Incorrect
8
Unanswered
9
Accuracy
22.7%
Average
87.6%
Pharmacology
Correct
2
Incorrect
2
Unanswered
7
Accuracy
18.2%
Average
78.6%
Psychiatry
Correct
2
Incorrect
4
Unanswered
2
Accuracy
25.0%
Average
87.9%
Pulmonology
Correct
5
Incorrect
4
Unanswered
7
Accuracy
31.3%
Average
82.8%
Radiology-Emergency
Correct
0
Incorrect
8
Unanswered
5
Accuracy
0.0%
Average
67.7%
Rheumatology
Correct
2
Incorrect
2
Unanswered
7
Accuracy
18.2%
Average
88.4%
Statistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
1
Incorrect
5
Unanswered
5
Accuracy
9.1%
Average
65.2%
Urology
Correct
2
Incorrect
0
Unanswered
6
Accuracy
25.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
0
Incorrect
1
Unanswered
2
Accuracy
0.0%
Average
82.6%
Biostatistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
15
Incorrect
22
Unanswered
44
Accuracy
18.5%
Average
82.2%
Epidemiology
Correct
3
Incorrect
1
Unanswered
5
Accuracy
33.3%
Average
88.7%
Ethics
Correct
1
Incorrect
2
Unanswered
3
Accuracy
16.7%
Average
92.0%
Interpretation
Correct
7
Incorrect
12
Unanswered
18
Accuracy
18.9%
Average
72.0%
Legal
Correct
1
Incorrect
1
Unanswered
7
Accuracy
11.1%
Average
82.4%
Pathophysiology
Correct
8
Incorrect
9
Unanswered
9
Accuracy
30.8%
Average
84.3%
Pharmacology
Correct
4
Incorrect
4
Unanswered
7
Accuracy
26.7%
Average
82.3%
Prevention
Correct
3
Incorrect
3
Unanswered
10
Accuracy
18.8%
Average
80.6%
Prognosis
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
93.2%
Risk
Correct
1
Incorrect
6
Unanswered
8
Accuracy
6.7%
Average
84.3%
Tests
Correct
10
Incorrect
7
Unanswered
16
Accuracy
30.3%
Average
80.3%
Treatment
Correct
17
Incorrect
24
Unanswered
31
Accuracy
23.6%
Average
80.1%
#AnswerCorrectStatus
1A
2BB
3BD
4CD
5BB
6BC
7B
8D
9D
10A
11AB
12A
13CAnnulled
14AC
15AA
16C
17C
18BD
19BB
20CB
21CB
22C
23B
24A
25AC
26A
27DB
28CD
29A
30D
31CC
32C
33BB
34B
35CC
36D
37AD
38AA
39C
40A
41AD
42BA
43B
44B
45B
46B
47AD
48CC
49CC
50DAnnulled
51A
52C
53CC
54C
55A
56AA
57AA
58AA
59AB
60B
61BC
62DB
63CB
64Annulled
65C
66CC
67BC
68AA
69AB
70BB
71AB
72B
73B
74CA
75C
76BC
77A
78D
79CA
80BD
81C
82DD
83DB
84A
85D
86A
87B
88B
89B
90BC
91A
92C
93DD
94BC
95AC
96AB
97B
98A
99AB
100C
101CC
102A
103C
104AC
105BC
106AB
107AC
108BA
109BC
110C
111B
112C
113C
114CD
115B
116CD
117C
118CB
119A
120DA
121C
122B
123BB
124DB
125CC
126B
127CC
128BB
129C
130CC
131CB
132B
133C
134B
135C
136B
137CD
138B
139CAnnulled
140CD
141A
142Annulled
143A
144D
145C
146BC
147BB
148CC
149B
150B
151BB
152AC
153C
154DD
155B
156AA
157DD
158B
159C
160AA
161AAnnulled
162AA
163DC
164C
165A
166A
167AD
168CC
169BB
170BB
171A
172B
173DD
174C
175AB
176A
177AD
178D
179B
180C
181BB
182CC
183D
184D
185B
186D
187DD
188BC
189CC
190BB
191D
192AD
193C
194C
195D
196A
197C
198BA
199AB
200D
201CC
202BA
203AA
204C
205CB
206C
207A
208Annulled
209DB
210C