MedicalBenchmark
Mistral: Mistral 7B Instruct v0.3 provider

Mistral 7B Instruct v0.3

293

#293 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

177.66 pts

Accuracy

45.7%

Correct / Incorrect

274 / 289

Total Cost

$0.11

Overall Performance

(vs. average)
Accuracy

45.7%

avg: 80.6%

Net score

177.66 pts

avg: 453.30 pts

Correct

274

avg: 483

Incorrect

289

avg: 90

Total Cost

$0.11

avg: $9.58

Average response time

1.8s

avg: 17.9s

Output Tokens

205K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

92.6%

avg: 95.4%

Breakdown by Exam

MIR 2024
298
Correct
87
Incorrect
103
Accuracy
43.5%
Net score
52.66
MIR 2025
295
Correct
83
Incorrect
101
Accuracy
41.5%
Net score
49.33
MIR 2026
290
Correct
104
Incorrect
85
Accuracy
52.0%
Net score
75.66