MedicalBenchmark
Meta: Llama 3.2 3B Instruct provider

Llama 3.2 3B Instruct

273

#273 of 290 modelsMIR 2026

Net score

62.33 pts

Accuracy

45.5%

Correct / Incorrect

91 / 86

Total Cost

$0.01

Overall Performance

(vs. average)
Accuracy

45.5%

avg: 81.6%

Net score

62.33 pts

avg: 154.00 pts

Correct

91

avg: 163

Incorrect

86

avg: 28

Total Cost

$0.01

avg: $3.33

Average response time

21.9s

avg: 16.2s

Output Tokens

137K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

86.0%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
3
Unanswered
0
Accuracy
57.1%
Average
69.6%
Cardiology
Correct
10
Incorrect
13
Unanswered
2
Accuracy
40.0%
Average
77.3%
Dermatology
Correct
6
Incorrect
3
Unanswered
2
Accuracy
54.5%
Average
72.3%
Endocrinology and Nutrition
Correct
7
Incorrect
5
Unanswered
3
Accuracy
46.7%
Average
84.0%
ENT
Correct
3
Incorrect
4
Unanswered
1
Accuracy
37.5%
Average
84.7%
Epidemiology
Correct
3
Incorrect
2
Unanswered
2
Accuracy
42.9%
Average
80.2%
Gastroenterology
Correct
8
Incorrect
17
Unanswered
5
Accuracy
26.7%
Average
79.3%
Genetics
Correct
4
Incorrect
7
Unanswered
0
Accuracy
36.4%
Average
78.7%
Geriatrics
Correct
5
Incorrect
6
Unanswered
2
Accuracy
38.5%
Average
83.0%
Gynecology and Obstetrics
Correct
4
Incorrect
8
Unanswered
0
Accuracy
33.3%
Average
84.3%
Health Planning and Management
Correct
6
Incorrect
3
Unanswered
1
Accuracy
60.0%
Average
78.4%
Hematology
Correct
5
Incorrect
3
Unanswered
1
Accuracy
55.6%
Average
76.6%
Immunology
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
91.4%
Infectious Diseases
Correct
5
Incorrect
6
Unanswered
3
Accuracy
35.7%
Average
77.9%
Legal Medicine and Bioethics
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
82.9%
Medical Oncology
Correct
9
Incorrect
11
Unanswered
3
Accuracy
39.1%
Average
83.0%
Nephrology
Correct
4
Incorrect
3
Unanswered
3
Accuracy
40.0%
Average
85.1%
Neurology
Correct
8
Incorrect
4
Unanswered
1
Accuracy
61.5%
Average
88.6%
Ophthalmology
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
83.7%
Palliative Care
Correct
3
Incorrect
2
Unanswered
1
Accuracy
50.0%
Average
80.2%
Pediatrics
Correct
14
Incorrect
7
Unanswered
1
Accuracy
63.6%
Average
87.6%
Pharmacology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
78.6%
Psychiatry
Correct
7
Incorrect
0
Unanswered
1
Accuracy
87.5%
Average
87.9%
Pulmonology
Correct
8
Incorrect
6
Unanswered
2
Accuracy
50.0%
Average
82.8%
Radiology-Emergency
Correct
6
Incorrect
6
Unanswered
1
Accuracy
46.2%
Average
67.7%
Rheumatology
Correct
3
Incorrect
5
Unanswered
3
Accuracy
27.3%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
2
Incorrect
7
Unanswered
2
Accuracy
18.2%
Average
65.2%
Urology
Correct
6
Incorrect
0
Unanswered
2
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
33
Incorrect
38
Unanswered
10
Accuracy
40.7%
Average
82.2%
Epidemiology
Correct
6
Incorrect
2
Unanswered
1
Accuracy
66.7%
Average
88.7%
Ethics
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
13
Incorrect
20
Unanswered
4
Accuracy
35.1%
Average
72.0%
Legal
Correct
4
Incorrect
5
Unanswered
0
Accuracy
44.4%
Average
82.4%
Pathophysiology
Correct
15
Incorrect
8
Unanswered
3
Accuracy
57.7%
Average
84.3%
Pharmacology
Correct
7
Incorrect
7
Unanswered
1
Accuracy
46.7%
Average
82.3%
Prevention
Correct
6
Incorrect
8
Unanswered
2
Accuracy
37.5%
Average
80.6%
Prognosis
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
93.2%
Risk
Correct
4
Incorrect
8
Unanswered
3
Accuracy
26.7%
Average
84.3%
Tests
Correct
15
Incorrect
16
Unanswered
2
Accuracy
45.5%
Average
80.3%
Treatment
Correct
33
Incorrect
30
Unanswered
9
Accuracy
45.8%
Average
80.1%
#AnswerCorrectStatus
1CA
2BB
3AD
4CD
5AB
6BC
7AB
8D
9D
10BA
11BB
12CA
13BAnnulled
14BC
15AA
16CC
17DC
18DD
19BB
20B
21BB
22CC
23BB
24AA
25CC
26AA
27BB
28AD
29AA
30D
31DC
32CC
33DB
34B
35C
36AD
37DD
38BA
39AC
40BA
41DD
42DA
43AB
44BB
45BB
46BB
47DD
48CC
49CC
50Annulled
51BA
52BC
53BC
54BC
55AA
56CA
57AA
58AA
59BB
60BB
61CC
62BB
63B
64CAnnulled
65AC
66DC
67CC
68AA
69DB
70BB
71BB
72BB
73AB
74AA
75CC
76CC
77BA
78CD
79AA
80AD
81AC
82DD
83DB
84A
85DD
86AA
87BB
88BB
89B
90C
91BA
92BC
93D
94C
95AC
96AB
97DB
98AA
99DB
100DC
101CC
102CA
103CC
104DC
105BC
106BB
107DC
108BA
109AC
110DC
111AB
112CC
113BC
114DD
115AB
116CD
117AC
118BB
119A
120AA
121AC
122DB
123BB
124B
125CC
126AB
127CC
128CB
129C
130CC
131BB
132B
133CC
134CB
135CC
136AB
137BD
138DB
139AAnnulled
140CD
141AA
142BAnnulled
143AA
144BD
145CC
146DC
147B
148AC
149CB
150BB
151AB
152CC
153BC
154BD
155DB
156AA
157D
158BB
159AC
160AA
161CAnnulled
162AA
163CC
164AC
165A
166AA
167AD
168CC
169BB
170AB
171AA
172BB
173DD
174CC
175BB
176CA
177AD
178DD
179CB
180BC
181BB
182CC
183BD
184D
185AB
186DD
187AD
188BC
189CC
190B
191DD
192BD
193AC
194C
195D
196AA
197CC
198AA
199AB
200AD
201CC
202AA
203AA
204AC
205BB
206CC
207AA
208Annulled
209B
210CC