CodeLLaMa 7B Instruct Solidity
319
#319 of 319 models in the general ranking
Cumulative performance across 3 MIR exams
Net score
0.00 pts
Accuracy
3.5%
Correct / Incorrect
21 / 69
Total Cost
$1.04
Overall Performance
(vs. average)Accuracy
3.5%
avg: 80.6%
Net score
0.00 pts
avg: 453.30 pts
Correct
21
avg: 483
Incorrect
69
avg: 90
Total Cost
$1.04
avg: $9.58
Average response time
30.1s
avg: 17.9s
Output Tokens
620K
avg: 1.3M
Reasoning Tokens
0
avg: 898K
Average confidence
18.6%
avg: 95.4%
Breakdown by Exam
| Exam | Position | Correct | Incorrect | Accuracy | Net score | Total Cost | |
|---|---|---|---|---|---|---|---|
| MIR 2024 | 318 | 11 | 26 | 5.5% | 2.33 | $0.35 | View detail |
| MIR 2025 | 319 | 7 | 22 | 3.5% | 0.00 | $0.37 | View detail |
| MIR 2026 | 319 | 3 | 21 | 1.5% | 0.00 | $0.32 | View detail |