MedicalBenchmark
Mistral: Mixtral 8x7B Instruct provider

Mixtral 8x7B Instruct

240

#240 of 290 modelsMIR 2026

Net score

115.00 pts

Accuracy

65.5%

Correct / Incorrect

131 / 48

Total Cost

$0.12

Overall Performance

(vs. average)
Accuracy

65.5%

avg: 81.6%

Net score

115.00 pts

avg: 154.00 pts

Correct

131

avg: 163

Incorrect

48

avg: 28

Total Cost

$0.12

avg: $3.33

Average response time

7.0s

avg: 16.2s

Output Tokens

84K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

89.4%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
69.6%
Cardiology
Correct
11
Incorrect
11
Unanswered
3
Accuracy
44.0%
Average
77.3%
Dermatology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
72.3%
Endocrinology and Nutrition
Correct
12
Incorrect
2
Unanswered
1
Accuracy
80.0%
Average
84.0%
ENT
Correct
7
Incorrect
1
Unanswered
0
Accuracy
87.5%
Average
84.7%
Epidemiology
Correct
5
Incorrect
1
Unanswered
1
Accuracy
71.4%
Average
80.2%
Gastroenterology
Correct
19
Incorrect
9
Unanswered
2
Accuracy
63.3%
Average
79.3%
Genetics
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
78.7%
Geriatrics
Correct
8
Incorrect
4
Unanswered
1
Accuracy
61.5%
Average
83.0%
Gynecology and Obstetrics
Correct
9
Incorrect
0
Unanswered
3
Accuracy
75.0%
Average
84.3%
Health Planning and Management
Correct
7
Incorrect
2
Unanswered
1
Accuracy
70.0%
Average
78.4%
Hematology
Correct
4
Incorrect
1
Unanswered
4
Accuracy
44.4%
Average
76.6%
Immunology
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
91.4%
Infectious Diseases
Correct
10
Incorrect
3
Unanswered
1
Accuracy
71.4%
Average
77.9%
Legal Medicine and Bioethics
Correct
8
Incorrect
1
Unanswered
2
Accuracy
72.7%
Average
82.9%
Medical Oncology
Correct
17
Incorrect
5
Unanswered
1
Accuracy
73.9%
Average
83.0%
Nephrology
Correct
7
Incorrect
2
Unanswered
1
Accuracy
70.0%
Average
85.1%
Neurology
Correct
12
Incorrect
1
Unanswered
0
Accuracy
92.3%
Average
88.6%
Ophthalmology
Correct
4
Incorrect
1
Unanswered
0
Accuracy
80.0%
Average
83.7%
Palliative Care
Correct
4
Incorrect
0
Unanswered
2
Accuracy
66.7%
Average
80.2%
Pediatrics
Correct
16
Incorrect
3
Unanswered
3
Accuracy
72.7%
Average
87.6%
Pharmacology
Correct
7
Incorrect
3
Unanswered
1
Accuracy
63.6%
Average
78.6%
Psychiatry
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
87.9%
Pulmonology
Correct
10
Incorrect
4
Unanswered
2
Accuracy
62.5%
Average
82.8%
Radiology-Emergency
Correct
4
Incorrect
8
Unanswered
1
Accuracy
30.8%
Average
67.7%
Rheumatology
Correct
10
Incorrect
1
Unanswered
0
Accuracy
90.9%
Average
88.4%
Statistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
65.2%
Urology
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
82.6%
Biostatistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
55
Incorrect
20
Unanswered
6
Accuracy
67.9%
Average
82.2%
Epidemiology
Correct
8
Incorrect
0
Unanswered
1
Accuracy
88.9%
Average
88.7%
Ethics
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
19
Incorrect
14
Unanswered
4
Accuracy
51.4%
Average
72.0%
Legal
Correct
6
Incorrect
1
Unanswered
2
Accuracy
66.7%
Average
82.4%
Pathophysiology
Correct
17
Incorrect
7
Unanswered
2
Accuracy
65.4%
Average
84.3%
Pharmacology
Correct
8
Incorrect
4
Unanswered
3
Accuracy
53.3%
Average
82.3%
Prevention
Correct
8
Incorrect
6
Unanswered
2
Accuracy
50.0%
Average
80.6%
Prognosis
Correct
4
Incorrect
0
Unanswered
1
Accuracy
80.0%
Average
93.2%
Risk
Correct
9
Incorrect
3
Unanswered
3
Accuracy
60.0%
Average
84.3%
Tests
Correct
22
Incorrect
7
Unanswered
4
Accuracy
66.7%
Average
80.3%
Treatment
Correct
46
Incorrect
17
Unanswered
9
Accuracy
63.9%
Average
80.1%
#AnswerCorrectStatus
1CA
2BB
3AD
4BD
5BB
6DC
7BB
8BD
9BD
10A
11CB
12CA
13CAnnulled
14BC
15CA
16CC
17DC
18D
19DB
20BB
21BB
22C
23CB
24AA
25CC
26BA
27BB
28DD
29AA
30DD
31AC
32CC
33B
34BB
35CC
36D
37DD
38AA
39CC
40AA
41D
42AA
43BB
44CB
45B
46BB
47DD
48CC
49CC
50Annulled
51A
52CC
53CC
54CC
55A
56AA
57A
58A
59BB
60BB
61CC
62BB
63DB
64AAnnulled
65CC
66DC
67CC
68AA
69AB
70BB
71BB
72BB
73B
74AA
75CC
76CC
77CA
78DD
79AA
80DD
81CC
82BD
83BB
84AA
85DD
86AA
87CB
88BB
89BB
90CC
91BA
92CC
93DD
94AC
95CC
96BB
97BB
98AA
99BB
100CC
101CC
102AA
103CC
104CC
105CC
106BB
107CC
108AA
109BC
110AC
111BB
112CC
113CC
114CD
115BB
116DD
117CC
118AB
119A
120CA
121AC
122BB
123B
124BB
125CC
126CB
127CC
128BB
129C
130CC
131BB
132AB
133CC
134BB
135CC
136BB
137BD
138BB
139AAnnulled
140BD
141AA
142BAnnulled
143BA
144DD
145C
146AC
147BB
148CC
149B
150CB
151BB
152CC
153BC
154DD
155BB
156BA
157DD
158BB
159BC
160AA
161Annulled
162AA
163CC
164CC
165AA
166AA
167DD
168CC
169BB
170BB
171AA
172AB
173DD
174CC
175B
176A
177DD
178D
179BB
180CC
181DB
182CC
183DD
184DD
185DB
186DD
187DD
188CC
189CC
190BB
191DD
192DD
193CC
194CC
195DD
196CA
197DC
198BA
199AB
200DD
201CC
202A
203AA
204AC
205BB
206CC
207A
208AAnnulled
209BB
210C