MedicalBenchmark
Mistral: Mistral 7B Instruct v0.1 provider

Mistral 7B Instruct v0.1

303

#303 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

131.33 pts

Accuracy

36.7%

Correct / Incorrect

220 / 266

Total Cost

$0.08

Overall Performance

(vs. average)
Accuracy

36.7%

avg: 80.6%

Net score

131.33 pts

avg: 453.30 pts

Correct

220

avg: 483

Incorrect

266

avg: 90

Total Cost

$0.08

avg: $9.58

Average response time

23.3s

avg: 17.9s

Output Tokens

228K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

81.9%

avg: 95.4%

Breakdown by Exam

MIR 2024
301
Correct
75
Incorrect
90
Accuracy
37.5%
Net score
45.00
MIR 2025
302
Correct
65
Incorrect
92
Accuracy
32.5%
Net score
34.33
MIR 2026
305
Correct
80
Incorrect
84
Accuracy
40.0%
Net score
52.00