MedicalBenchmark
Mistral: Ministral 8B provider

Ministral 8B

254

#254 of 290 modelsMIR 2026

Net score

99.33 pts

Accuracy

61.0%

Correct / Incorrect

122 / 68

Total Cost

$0.02

Overall Performance

(vs. average)
Accuracy

61.0%

avg: 81.6%

Net score

99.33 pts

avg: 154.00 pts

Correct

122

avg: 163

Incorrect

68

avg: 28

Total Cost

$0.02

avg: $3.33

Average response time

1.8s

avg: 16.2s

Output Tokens

68K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

93.2%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
69.6%
Cardiology
Correct
13
Incorrect
12
Unanswered
0
Accuracy
52.0%
Average
77.3%
Dermatology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
72.3%
Endocrinology and Nutrition
Correct
12
Incorrect
2
Unanswered
1
Accuracy
80.0%
Average
84.0%
ENT
Correct
5
Incorrect
1
Unanswered
2
Accuracy
62.5%
Average
84.7%
Epidemiology
Correct
3
Incorrect
2
Unanswered
2
Accuracy
42.9%
Average
80.2%
Gastroenterology
Correct
20
Incorrect
10
Unanswered
0
Accuracy
66.7%
Average
79.3%
Genetics
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
78.7%
Geriatrics
Correct
10
Incorrect
3
Unanswered
0
Accuracy
76.9%
Average
83.0%
Gynecology and Obstetrics
Correct
10
Incorrect
2
Unanswered
0
Accuracy
83.3%
Average
84.3%
Health Planning and Management
Correct
6
Incorrect
3
Unanswered
1
Accuracy
60.0%
Average
78.4%
Hematology
Correct
4
Incorrect
4
Unanswered
1
Accuracy
44.4%
Average
76.6%
Immunology
Correct
3
Incorrect
2
Unanswered
1
Accuracy
50.0%
Average
91.4%
Infectious Diseases
Correct
6
Incorrect
6
Unanswered
2
Accuracy
42.9%
Average
77.9%
Legal Medicine and Bioethics
Correct
9
Incorrect
1
Unanswered
1
Accuracy
81.8%
Average
82.9%
Medical Oncology
Correct
17
Incorrect
6
Unanswered
0
Accuracy
73.9%
Average
83.0%
Nephrology
Correct
6
Incorrect
4
Unanswered
0
Accuracy
60.0%
Average
85.1%
Neurology
Correct
10
Incorrect
2
Unanswered
1
Accuracy
76.9%
Average
88.6%
Ophthalmology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
83.7%
Palliative Care
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
80.2%
Pediatrics
Correct
13
Incorrect
8
Unanswered
1
Accuracy
59.1%
Average
87.6%
Pharmacology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
78.6%
Psychiatry
Correct
5
Incorrect
2
Unanswered
1
Accuracy
62.5%
Average
87.9%
Pulmonology
Correct
11
Incorrect
4
Unanswered
1
Accuracy
68.8%
Average
82.8%
Radiology-Emergency
Correct
5
Incorrect
7
Unanswered
1
Accuracy
38.5%
Average
67.7%
Rheumatology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
3
Incorrect
8
Unanswered
0
Accuracy
27.3%
Average
65.2%
Urology
Correct
7
Incorrect
1
Unanswered
0
Accuracy
87.5%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
47
Incorrect
30
Unanswered
4
Accuracy
58.0%
Average
82.2%
Epidemiology
Correct
7
Incorrect
1
Unanswered
1
Accuracy
77.8%
Average
88.7%
Ethics
Correct
6
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
92.0%
Interpretation
Correct
12
Incorrect
24
Unanswered
1
Accuracy
32.4%
Average
72.0%
Legal
Correct
8
Incorrect
1
Unanswered
0
Accuracy
88.9%
Average
82.4%
Pathophysiology
Correct
16
Incorrect
9
Unanswered
1
Accuracy
61.5%
Average
84.3%
Pharmacology
Correct
9
Incorrect
5
Unanswered
1
Accuracy
60.0%
Average
82.3%
Prevention
Correct
6
Incorrect
8
Unanswered
2
Accuracy
37.5%
Average
80.6%
Prognosis
Correct
4
Incorrect
0
Unanswered
1
Accuracy
80.0%
Average
93.2%
Risk
Correct
8
Incorrect
5
Unanswered
2
Accuracy
53.3%
Average
84.3%
Tests
Correct
22
Incorrect
7
Unanswered
4
Accuracy
66.7%
Average
80.3%
Treatment
Correct
45
Incorrect
25
Unanswered
2
Accuracy
62.5%
Average
80.1%
#AnswerCorrectStatus
1DA
2CB
3AD
4AD
5CB
6DC
7CB
8D
9AD
10AA
11DB
12AA
13AAnnulled
14BC
15BA
16CC
17CC
18BD
19BB
20BB
21DB
22BC
23AB
24DA
25CC
26DA
27B
28DD
29AA
30DD
31DC
32CC
33DB
34B
35BC
36CD
37DD
38A
39CC
40BA
41AD
42BA
43BB
44BB
45BB
46BB
47DD
48CC
49CC
50Annulled
51AA
52CC
53CC
54CC
55BA
56BA
57AA
58AA
59AB
60B
61CC
62BB
63DB
64AAnnulled
65DC
66DC
67CC
68AA
69AB
70BB
71BB
72BB
73BB
74AA
75CC
76CC
77CA
78DD
79AA
80DD
81CC
82DD
83BB
84AA
85DD
86AA
87BB
88BB
89BB
90CC
91AA
92BC
93AD
94BC
95CC
96AB
97BB
98AA
99BB
100CC
101CC
102AA
103C
104CC
105CC
106DB
107DC
108BA
109CC
110AC
111AB
112CC
113CC
114DD
115BB
116DD
117CC
118AB
119DA
120AA
121AC
122BB
123DB
124DB
125CC
126BB
127BC
128BB
129DC
130CC
131BB
132AB
133CC
134CB
135CC
136BB
137BD
138DB
139AAnnulled
140AD
141AA
142BAnnulled
143BA
144DD
145CC
146AC
147BB
148CC
149BB
150BB
151BB
152CC
153CC
154DD
155BB
156AA
157DD
158BB
159BC
160AA
161CAnnulled
162AA
163C
164CC
165AA
166AA
167DD
168CC
169B
170AB
171AA
172BB
173DD
174DC
175B
176DA
177DD
178DD
179DB
180BC
181BB
182BC
183BD
184DD
185B
186DD
187DD
188CC
189CC
190AB
191DD
192BD
193CC
194CC
195DD
196AA
197CC
198BA
199AB
200DD
201CC
202AA
203AA
204AC
205BB
206CC
207A
208DAnnulled
209DB
210BC