MedicalBenchmark
Sao10K: Llama 3.1 70B Hanami x1 provider

Llama 3.1 70B Hanami x1

236

#236 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

431.00 pts

Accuracy

77.5%

Correct / Incorrect

465 / 102

Total Cost

$1.87

Overall Performance

(vs. average)
Accuracy

77.5%

avg: 80.6%

Net score

431.00 pts

avg: 453.30 pts

Correct

465

avg: 483

Incorrect

102

avg: 90

Total Cost

$1.87

avg: $9.58

Average response time

31.4s

avg: 17.9s

Output Tokens

315K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

92.7%

avg: 95.4%

Breakdown by Exam

MIR 2024
242
Correct
155
Incorrect
34
Accuracy
77.5%
Net score
143.66
MIR 2025
241
Correct
147
Incorrect
46
Accuracy
73.5%
Net score
131.66
MIR 2026
219
Correct
163
Incorrect
22
Accuracy
81.5%
Net score
155.66