Llemma 7b
318
#318 of 319 models in the general ranking
Cumulative performance across 3 MIR exams
Net score
8.33 pts
Accuracy
7.0%
Correct / Incorrect
42 / 101
Total Cost
$1.98
Overall Performance
(vs. average)Accuracy
7.0%
avg: 80.6%
Net score
8.33 pts
avg: 453.30 pts
Correct
42
avg: 483
Incorrect
101
avg: 90
Total Cost
$1.98
avg: $9.58
Average response time
69.0s
avg: 17.9s
Output Tokens
1.4M
avg: 1.3M
Reasoning Tokens
0
avg: 898K
Average confidence
22.8%
avg: 95.4%
Breakdown by Exam
| Exam | Position | Correct | Incorrect | Accuracy | Net score | Total Cost | |
|---|---|---|---|---|---|---|---|
| MIR 2024 | 320 | 7 | 37 | 3.5% | 0.00 | $0.65 | View detail |
| MIR 2025 | 316 | 17 | 41 | 8.5% | 3.33 | $0.64 | View detail |
| MIR 2026 | 317 | 18 | 23 | 9.0% | 10.33 | $0.70 | View detail |