MedicalBenchmark
Mistral: Mistral Nemo provider

Mistral Nemo

276

#276 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

279.66 pts

Accuracy

58.5%

Correct / Incorrect

351 / 214

Total Cost

$0.02

Overall Performance

(vs. average)
Accuracy

58.5%

avg: 80.6%

Net score

279.66 pts

avg: 453.30 pts

Correct

351

avg: 483

Incorrect

214

avg: 90

Total Cost

$0.02

avg: $9.58

Average response time

6.9s

avg: 17.9s

Output Tokens

157K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

92.4%

avg: 95.4%

Breakdown by Exam

MIR 2024
276
Correct
118
Incorrect
74
Accuracy
59.0%
Net score
93.33
MIR 2025
277
Correct
105
Incorrect
83
Accuracy
52.5%
Net score
77.33
MIR 2026
273
Correct
128
Incorrect
57
Accuracy
64.0%
Net score
109.00