Hermes 2 Pro - Llama-3 8B
302
#302 of 319 models in the general ranking
Cumulative performance across 3 MIR exams
Net score
146.33 pts
Accuracy
40.3%
Correct / Incorrect
242 / 287
Total Cost
$0.08
Overall Performance
(vs. average)Accuracy
40.3%
avg: 80.6%
Net score
146.33 pts
avg: 453.30 pts
Correct
242
avg: 483
Incorrect
287
avg: 90
Total Cost
$0.08
avg: $9.58
Average response time
4.1s
avg: 17.9s
Output Tokens
268K
avg: 1.3M
Reasoning Tokens
0
avg: 898K
Average confidence
84.5%
avg: 95.4%
Breakdown by Exam
| Exam | Position | Correct | Incorrect | Accuracy | Net score | Total Cost | |
|---|---|---|---|---|---|---|---|
| MIR 2024 | 309 | 72 | 105 | 36.0% | 37.00 | $0.03 | View detail |
| MIR 2025 | 298 | 78 | 101 | 39.0% | 44.33 | $0.03 | View detail |
| MIR 2026 | 298 | 92 | 81 | 46.0% | 65.00 | $0.03 | View detail |