MedicalBenchmark
Nous: Hermes 3 405B Instruct provider

Hermes 3 405B Instruct

192

#192 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

480.66 pts

Accuracy

84.2%

Correct / Incorrect

505 / 73

Total Cost

$0.49

Overall Performance

(vs. average)
Accuracy

84.2%

avg: 80.6%

Net score

480.66 pts

avg: 453.30 pts

Correct

505

avg: 483

Incorrect

73

avg: 90

Total Cost

$0.49

avg: $9.58

Average response time

22.8s

avg: 17.9s

Output Tokens

196K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

96.0%

avg: 95.4%

Breakdown by Exam

MIR 2024
181
Correct
175
Incorrect
21
Accuracy
87.5%
Net score
168.00
MIR 2025
193
Correct
162
Incorrect
28
Accuracy
81.0%
Net score
152.66
MIR 2026
205
Correct
168
Incorrect
24
Accuracy
84.0%
Net score
160.00