MedicalBenchmark
Mistral: Codestral 2508 provider

Codestral 2508

287

#287 of 319 models — MIR 2026

Net score

81.66 pts

Accuracy

54.0%

Correct / Incorrect

108 / 79

Total Cost

$0.10

Overall Performance

(vs. average)
Accuracy

54.0%

avg: 82.4%

Net score

81.66 pts

avg: 156.14 pts

Correct

108

avg: 165

Incorrect

79

avg: 26

Total Cost

$0.10

avg: $3.12

Average response time

2.1s

avg: 17.4s

Output Tokens

83K

avg: 415K

Reasoning Tokens

0

avg: 295K

Average confidence

92.9%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
3
Unanswered
0
Accuracy
57.1%
Average
71.0%
Cardiology
Correct
12
Incorrect
13
Unanswered
0
Accuracy
48.0%
Average
78.4%
Dermatology
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
73.2%
Endocrinology and Nutrition
Correct
6
Incorrect
6
Unanswered
3
Accuracy
40.0%
Average
84.7%
ENT
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
85.0%
Epidemiology
Correct
1
Incorrect
4
Unanswered
2
Accuracy
14.3%
Average
81.3%
Gastroenterology
Correct
13
Incorrect
14
Unanswered
3
Accuracy
43.3%
Average
80.2%
Genetics
Correct
5
Incorrect
4
Unanswered
2
Accuracy
45.5%
Average
79.7%
Geriatrics
Correct
7
Incorrect
5
Unanswered
1
Accuracy
53.8%
Average
83.7%
Gynecology and Obstetrics
Correct
7
Incorrect
5
Unanswered
0
Accuracy
58.3%
Average
85.2%
Health Planning and Management
Correct
5
Incorrect
2
Unanswered
3
Accuracy
50.0%
Average
79.4%
Hematology
Correct
3
Incorrect
5
Unanswered
1
Accuracy
33.3%
Average
77.6%
Immunology
Correct
3
Incorrect
2
Unanswered
1
Accuracy
50.0%
Average
91.8%
Infectious Diseases
Correct
7
Incorrect
5
Unanswered
2
Accuracy
50.0%
Average
79.0%
Legal Medicine and Bioethics
Correct
8
Incorrect
3
Unanswered
0
Accuracy
72.7%
Average
83.4%
Medical Oncology
Correct
14
Incorrect
8
Unanswered
1
Accuracy
60.9%
Average
83.7%
Nephrology
Correct
4
Incorrect
4
Unanswered
2
Accuracy
40.0%
Average
85.6%
Neurology
Correct
8
Incorrect
4
Unanswered
1
Accuracy
61.5%
Average
89.0%
Ophthalmology
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
84.5%
Palliative Care
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
80.8%
Pediatrics
Correct
13
Incorrect
8
Unanswered
1
Accuracy
59.1%
Average
88.1%
Pharmacology
Correct
4
Incorrect
7
Unanswered
0
Accuracy
36.4%
Average
79.6%
Psychiatry
Correct
5
Incorrect
3
Unanswered
0
Accuracy
62.5%
Average
88.4%
Pulmonology
Correct
10
Incorrect
6
Unanswered
0
Accuracy
62.5%
Average
83.6%
Radiology-Emergency
Correct
7
Incorrect
6
Unanswered
0
Accuracy
53.8%
Average
69.4%
Rheumatology
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
89.0%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
84.5%
Traumatology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
66.6%
Urology
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
83.1%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
83.4%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
84.5%
Diagnosis
Correct
41
Incorrect
35
Unanswered
5
Accuracy
50.6%
Average
83.0%
Epidemiology
Correct
5
Incorrect
2
Unanswered
2
Accuracy
55.6%
Average
89.1%
Ethics
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
92.2%
Interpretation
Correct
18
Incorrect
18
Unanswered
1
Accuracy
48.6%
Average
73.2%
Legal
Correct
8
Incorrect
1
Unanswered
0
Accuracy
88.9%
Average
82.9%
Pathophysiology
Correct
15
Incorrect
7
Unanswered
4
Accuracy
57.7%
Average
85.0%
Pharmacology
Correct
7
Incorrect
8
Unanswered
0
Accuracy
46.7%
Average
83.1%
Prevention
Correct
6
Incorrect
7
Unanswered
3
Accuracy
37.5%
Average
81.5%
Prognosis
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
93.2%
Risk
Correct
6
Incorrect
9
Unanswered
0
Accuracy
40.0%
Average
85.0%
Tests
Correct
17
Incorrect
14
Unanswered
2
Accuracy
51.5%
Average
81.2%
Treatment
Correct
39
Incorrect
31
Unanswered
2
Accuracy
54.2%
Average
80.9%
#AnswerCorrectStatus
1CA
2BB
3AD
4BD
5AB
6—C
7DB
8BD
9DD
10CA
11BB
12CA
13D—Annulled
14BC
15BA
16CC
17DC
18CD
19BB
20BB
21BB
22CC
23BB
24AA
25CC
26—A
27—B
28DD
29AA
30—D
31DC
32CC
33DB
34CB
35CC
36CD
37CD
38CA
39CC
40AA
41AD
42AA
43BB
44BB
45CB
46BB
47DD
48CC
49CC
50A—Annulled
51DA
52AC
53CC
54AC
55CA
56CA
57AA
58CA
59AB
60DB
61CC
62BB
63BB
64A—Annulled
65CC
66DC
67CC
68—A
69AB
70BB
71BB
72BB
73BB
74AA
75CC
76CC
77CA
78DD
79CA
80AD
81CC
82BD
83BB
84AA
85DD
86—A
87BB
88BB
89DB
90CC
91AA
92CC
93DD
94DC
95AC
96BB
97AB
98AA
99BB
100CC
101CC
102AA
103AC
104CC
105CC
106BB
107AC
108BA
109CC
110AC
111BB
112AC
113CC
114DD
115DB
116BD
117AC
118AB
119DA
120AA
121DC
122DB
123BB
124BB
125BC
126AB
127BC
128CB
129CC
130CC
131BB
132AB
133CC
134BB
135CC
136BB
137BD
138DB
139A—Annulled
140DD
141AA
142B—Annulled
143BA
144BD
145CC
146DC
147BB
148CC
149AB
150—B
151AB
152CC
153CC
154DD
155BB
156BA
157DD
158BB
159CC
160AA
161C—Annulled
162AA
163AC
164BC
165AA
166AA
167DD
168CC
169—B
170AB
171—A
172AB
173DD
174—C
175DB
176DA
177AD
178—D
179AB
180BC
181BB
182CC
183AD
184DD
185DB
186DD
187DD
188CC
189AC
190—B
191BD
192DD
193CC
194—C
195DD
196AA
197DC
198BA
199BB
200DD
201CC
202AA
203AA
204CC
205BB
206AC
207CA
208D—Annulled
209AB
210CC