MedicalBenchmark
Sao10k: Llama 3 Euryale 70B v2.1 provider

Llama 3 Euryale 70B v2.1

214

#214 of 290 modelsMIR 2026

Net score

144.66 pts

Accuracy

78.5%

Correct / Incorrect

157 / 37

Total Cost

$0.28

Overall Performance

(vs. average)
Accuracy

78.5%

avg: 81.6%

Net score

144.66 pts

avg: 154.00 pts

Correct

157

avg: 163

Incorrect

37

avg: 28

Total Cost

$0.28

avg: $3.33

Average response time

9.1s

avg: 16.2s

Output Tokens

89K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

95.3%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
5
Incorrect
1
Unanswered
1
Accuracy
71.4%
Average
69.6%
Cardiology
Correct
18
Incorrect
6
Unanswered
1
Accuracy
72.0%
Average
77.3%
Dermatology
Correct
7
Incorrect
3
Unanswered
1
Accuracy
63.6%
Average
72.3%
Endocrinology and Nutrition
Correct
12
Incorrect
3
Unanswered
0
Accuracy
80.0%
Average
84.0%
ENT
Correct
5
Incorrect
3
Unanswered
0
Accuracy
62.5%
Average
84.7%
Epidemiology
Correct
5
Incorrect
2
Unanswered
0
Accuracy
71.4%
Average
80.2%
Gastroenterology
Correct
22
Incorrect
7
Unanswered
1
Accuracy
73.3%
Average
79.3%
Genetics
Correct
9
Incorrect
2
Unanswered
0
Accuracy
81.8%
Average
78.7%
Geriatrics
Correct
12
Incorrect
1
Unanswered
0
Accuracy
92.3%
Average
83.0%
Gynecology and Obstetrics
Correct
12
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
84.3%
Health Planning and Management
Correct
7
Incorrect
2
Unanswered
1
Accuracy
70.0%
Average
78.4%
Hematology
Correct
8
Incorrect
1
Unanswered
0
Accuracy
88.9%
Average
76.6%
Immunology
Correct
6
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
91.4%
Infectious Diseases
Correct
9
Incorrect
4
Unanswered
1
Accuracy
64.3%
Average
77.9%
Legal Medicine and Bioethics
Correct
7
Incorrect
3
Unanswered
1
Accuracy
63.6%
Average
82.9%
Medical Oncology
Correct
21
Incorrect
2
Unanswered
0
Accuracy
91.3%
Average
83.0%
Nephrology
Correct
6
Incorrect
3
Unanswered
1
Accuracy
60.0%
Average
85.1%
Neurology
Correct
12
Incorrect
1
Unanswered
0
Accuracy
92.3%
Average
88.6%
Ophthalmology
Correct
4
Incorrect
1
Unanswered
0
Accuracy
80.0%
Average
83.7%
Palliative Care
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
80.2%
Pediatrics
Correct
19
Incorrect
3
Unanswered
0
Accuracy
86.4%
Average
87.6%
Pharmacology
Correct
7
Incorrect
3
Unanswered
1
Accuracy
63.6%
Average
78.6%
Psychiatry
Correct
7
Incorrect
1
Unanswered
0
Accuracy
87.5%
Average
87.9%
Pulmonology
Correct
14
Incorrect
2
Unanswered
0
Accuracy
87.5%
Average
82.8%
Radiology-Emergency
Correct
9
Incorrect
3
Unanswered
1
Accuracy
69.2%
Average
67.7%
Rheumatology
Correct
10
Incorrect
0
Unanswered
1
Accuracy
90.9%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
65.2%
Urology
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
3
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
69
Incorrect
11
Unanswered
1
Accuracy
85.2%
Average
82.2%
Epidemiology
Correct
6
Incorrect
2
Unanswered
1
Accuracy
66.7%
Average
88.7%
Ethics
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
26
Incorrect
11
Unanswered
0
Accuracy
70.3%
Average
72.0%
Legal
Correct
6
Incorrect
2
Unanswered
1
Accuracy
66.7%
Average
82.4%
Pathophysiology
Correct
21
Incorrect
4
Unanswered
1
Accuracy
80.8%
Average
84.3%
Pharmacology
Correct
11
Incorrect
3
Unanswered
1
Accuracy
73.3%
Average
82.3%
Prevention
Correct
13
Incorrect
3
Unanswered
0
Accuracy
81.3%
Average
80.6%
Prognosis
Correct
4
Incorrect
1
Unanswered
0
Accuracy
80.0%
Average
93.2%
Risk
Correct
14
Incorrect
1
Unanswered
0
Accuracy
93.3%
Average
84.3%
Tests
Correct
27
Incorrect
6
Unanswered
0
Accuracy
81.8%
Average
80.3%
Treatment
Correct
52
Incorrect
16
Unanswered
4
Accuracy
72.2%
Average
80.1%
#AnswerCorrectStatus
1CA
2BB
3AD
4BD
5BB
6CC
7CB
8CD
9DD
10CA
11BB
12AA
13BAnnulled
14BC
15AA
16CC
17CC
18BD
19BB
20CB
21BB
22BC
23BB
24AA
25CC
26AA
27BB
28DD
29AA
30DD
31CC
32BC
33CB
34AB
35BC
36DD
37DD
38BA
39CC
40AA
41DD
42AA
43BB
44BB
45BB
46BB
47DD
48CC
49CC
50CAnnulled
51AA
52CC
53CC
54CC
55AA
56AA
57AA
58BA
59BB
60BB
61CC
62BB
63BB
64CAnnulled
65DC
66DC
67CC
68AA
69BB
70BB
71BB
72BB
73AB
74AA
75CC
76CC
77DA
78DD
79AA
80DD
81CC
82DD
83BB
84AA
85DD
86AA
87BB
88BB
89BB
90CC
91BA
92CC
93AD
94CC
95CC
96BB
97BB
98AA
99BB
100CC
101CC
102AA
103BC
104CC
105CC
106BB
107CC
108AA
109DC
110CC
111AB
112CC
113CC
114DD
115B
116DD
117CC
118BB
119AA
120AA
121BC
122BB
123BB
124AB
125CC
126BB
127CC
128CB
129CC
130CC
131BB
132AB
133CC
134BB
135CC
136BB
137DD
138BB
139AAnnulled
140CD
141AA
142AAnnulled
143AA
144DD
145C
146CC
147BB
148CC
149B
150BB
151BB
152CC
153CC
154DD
155BB
156AA
157DD
158BB
159BC
160AA
161CAnnulled
162AA
163CC
164CC
165AA
166AA
167DD
168CC
169BB
170AB
171AA
172AB
173DD
174CC
175BB
176AA
177DD
178DD
179B
180CC
181BB
182CC
183DD
184DD
185BB
186DD
187DD
188CC
189CC
190BB
191DD
192BD
193CC
194BC
195BD
196AA
197CC
198BA
199B
200DD
201CC
202AA
203A
204CC
205BB
206CC
207AA
208AAnnulled
209BB
210CC