MedicalBenchmark
Mistral: Mistral Nemo provider

Mistral Nemo

245

#245 of 290 modelsMIR 2026

Net score

109.00 pts

Accuracy

64.0%

Correct / Incorrect

128 / 57

Total Cost

$0.01

Overall Performance

(vs. average)
Accuracy

64.0%

avg: 81.6%

Net score

109.00 pts

avg: 154.00 pts

Correct

128

avg: 163

Incorrect

57

avg: 28

Total Cost

$0.01

avg: $3.33

Average response time

6.3s

avg: 16.2s

Output Tokens

52K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

91.1%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
69.6%
Cardiology
Correct
13
Incorrect
11
Unanswered
1
Accuracy
52.0%
Average
77.3%
Dermatology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
72.3%
Endocrinology and Nutrition
Correct
12
Incorrect
3
Unanswered
0
Accuracy
80.0%
Average
84.0%
ENT
Correct
4
Incorrect
3
Unanswered
1
Accuracy
50.0%
Average
84.7%
Epidemiology
Correct
5
Incorrect
2
Unanswered
0
Accuracy
71.4%
Average
80.2%
Gastroenterology
Correct
23
Incorrect
6
Unanswered
1
Accuracy
76.7%
Average
79.3%
Genetics
Correct
8
Incorrect
2
Unanswered
1
Accuracy
72.7%
Average
78.7%
Geriatrics
Correct
7
Incorrect
4
Unanswered
2
Accuracy
53.8%
Average
83.0%
Gynecology and Obstetrics
Correct
10
Incorrect
2
Unanswered
0
Accuracy
83.3%
Average
84.3%
Health Planning and Management
Correct
7
Incorrect
3
Unanswered
0
Accuracy
70.0%
Average
78.4%
Hematology
Correct
4
Incorrect
2
Unanswered
3
Accuracy
44.4%
Average
76.6%
Immunology
Correct
2
Incorrect
1
Unanswered
3
Accuracy
33.3%
Average
91.4%
Infectious Diseases
Correct
9
Incorrect
3
Unanswered
2
Accuracy
64.3%
Average
77.9%
Legal Medicine and Bioethics
Correct
9
Incorrect
2
Unanswered
0
Accuracy
81.8%
Average
82.9%
Medical Oncology
Correct
16
Incorrect
5
Unanswered
2
Accuracy
69.6%
Average
83.0%
Nephrology
Correct
6
Incorrect
4
Unanswered
0
Accuracy
60.0%
Average
85.1%
Neurology
Correct
11
Incorrect
2
Unanswered
0
Accuracy
84.6%
Average
88.6%
Ophthalmology
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
83.7%
Palliative Care
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
80.2%
Pediatrics
Correct
16
Incorrect
5
Unanswered
1
Accuracy
72.7%
Average
87.6%
Pharmacology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
78.6%
Psychiatry
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
87.9%
Pulmonology
Correct
7
Incorrect
7
Unanswered
2
Accuracy
43.8%
Average
82.8%
Radiology-Emergency
Correct
6
Incorrect
5
Unanswered
2
Accuracy
46.2%
Average
67.7%
Rheumatology
Correct
7
Incorrect
1
Unanswered
3
Accuracy
63.6%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
65.2%
Urology
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
49
Incorrect
25
Unanswered
7
Accuracy
60.5%
Average
82.2%
Epidemiology
Correct
7
Incorrect
2
Unanswered
0
Accuracy
77.8%
Average
88.7%
Ethics
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
16
Incorrect
19
Unanswered
2
Accuracy
43.2%
Average
72.0%
Legal
Correct
7
Incorrect
2
Unanswered
0
Accuracy
77.8%
Average
82.4%
Pathophysiology
Correct
19
Incorrect
5
Unanswered
2
Accuracy
73.1%
Average
84.3%
Pharmacology
Correct
6
Incorrect
5
Unanswered
4
Accuracy
40.0%
Average
82.3%
Prevention
Correct
10
Incorrect
5
Unanswered
1
Accuracy
62.5%
Average
80.6%
Prognosis
Correct
4
Incorrect
0
Unanswered
1
Accuracy
80.0%
Average
93.2%
Risk
Correct
11
Incorrect
3
Unanswered
1
Accuracy
73.3%
Average
84.3%
Tests
Correct
19
Incorrect
11
Unanswered
3
Accuracy
57.6%
Average
80.3%
Treatment
Correct
49
Incorrect
19
Unanswered
4
Accuracy
68.1%
Average
80.1%
#AnswerCorrectStatus
1DA
2BB
3AD
4AD
5BB
6C
7CB
8CD
9DD
10CA
11BB
12CA
13DAnnulled
14BC
15BA
16CC
17CC
18AD
19CB
20BB
21CB
22AC
23BB
24AA
25CC
26AA
27DB
28DD
29AA
30DD
31CC
32CC
33DB
34BB
35CC
36BD
37DD
38A
39AC
40AA
41AD
42AA
43BB
44B
45BB
46BB
47DD
48CC
49CC
50BAnnulled
51AA
52CC
53CC
54CC
55AA
56DA
57AA
58AA
59DB
60BB
61DC
62BB
63BB
64AAnnulled
65CC
66DC
67CC
68AA
69CB
70BB
71AB
72BB
73DB
74AA
75CC
76CC
77BA
78DD
79AA
80DD
81AC
82DD
83BB
84AA
85DD
86A
87BB
88BB
89BB
90CC
91AA
92CC
93DD
94BC
95CC
96BB
97BB
98AA
99BB
100CC
101CC
102A
103CC
104CC
105CC
106AB
107CC
108BA
109C
110AC
111CB
112CC
113CC
114DD
115CB
116DD
117C
118BB
119DA
120AA
121AC
122DB
123DB
124BB
125CC
126BB
127DC
128BB
129DC
130CC
131BB
132AB
133CC
134AB
135CC
136B
137CD
138BB
139BAnnulled
140CD
141AA
142BAnnulled
143A
144DD
145CC
146DC
147BB
148BC
149BB
150BB
151BB
152CC
153CC
154DD
155BB
156BA
157DD
158BB
159BC
160AA
161CAnnulled
162AA
163C
164CC
165AA
166AA
167DD
168CC
169AB
170BB
171AA
172BB
173CD
174AC
175B
176DA
177DD
178AD
179AB
180CC
181BB
182C
183DD
184D
185DB
186DD
187DD
188CC
189CC
190DB
191DD
192BD
193CC
194CC
195DD
196AA
197CC
198BA
199B
200DD
201CC
202A
203AA
204CC
205BB
206CC
207AA
208DAnnulled
209BB
210CC