MedicalBenchmark
Qwen: Qwen2.5 7B Instruct provider

Qwen2.5 7B Instruct

280

#280 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

248.66 pts

Accuracy

53.3%

Correct / Incorrect

320 / 214

Total Cost

$0.05

Overall Performance

(vs. average)
Accuracy

53.3%

avg: 80.6%

Net score

248.66 pts

avg: 453.30 pts

Correct

320

avg: 483

Incorrect

214

avg: 90

Total Cost

$0.05

avg: $9.58

Average response time

10.3s

avg: 17.9s

Output Tokens

355K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

88.4%

avg: 95.4%

Breakdown by Exam

MIR 2024
285
Correct
100
Incorrect
81
Accuracy
50.0%
Net score
73.00
MIR 2025
285
Correct
93
Incorrect
73
Accuracy
46.5%
Net score
68.66
MIR 2026
276
Correct
127
Incorrect
60
Accuracy
63.5%
Net score
107.00