MedicalBenchmark
Mistral: Devstral Small 1.1 provider

Devstral Small 1.1

227

#227 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

446.66 pts

Accuracy

80.0%

Correct / Incorrect

480 / 100

Total Cost

$0.10

Overall Performance

(vs. average)
Accuracy

80.0%

avg: 80.6%

Net score

446.66 pts

avg: 453.30 pts

Correct

480

avg: 483

Incorrect

100

avg: 90

Total Cost

$0.10

avg: $9.58

Average response time

2.4s

avg: 17.9s

Output Tokens

251K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

95.9%

avg: 95.4%

Breakdown by Exam

MIR 2024
221
Correct
165
Incorrect
33
Accuracy
82.5%
Net score
154.00
MIR 2025
224
Correct
153
Incorrect
40
Accuracy
76.5%
Net score
139.66
MIR 2026
230
Correct
162
Incorrect
27
Accuracy
81.0%
Net score
153.00