MedicalBenchmark
Nous: Hermes 3 70B Instruct provider

Hermes 3 70B Instruct

289

#289 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

187.33 pts

Accuracy

40.3%

Correct / Incorrect

242 / 164

Total Cost

$1.62

Overall Performance

(vs. average)
Accuracy

40.3%

avg: 80.6%

Net score

187.33 pts

avg: 453.30 pts

Correct

242

avg: 483

Incorrect

164

avg: 90

Total Cost

$1.62

avg: $9.58

Average response time

172.1s

avg: 17.9s

Output Tokens

5.1M

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

63.7%

avg: 95.4%

Breakdown by Exam

MIR 2024
293
Correct
78
Incorrect
57
Accuracy
39.0%
Net score
59.00
MIR 2025
283
Correct
88
Incorrect
51
Accuracy
44.0%
Net score
71.00
MIR 2026
303
Correct
76
Incorrect
56
Accuracy
38.0%
Net score
57.33