MedicalBenchmark
Google: Gemma 2 27B provider

Gemma 2 27B

261

#261 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

344.66 pts

Accuracy

66.3%

Correct / Incorrect

398 / 160

Total Cost

$0.26

Overall Performance

(vs. average)
Accuracy

66.3%

avg: 80.6%

Net score

344.66 pts

avg: 453.30 pts

Correct

398

avg: 483

Incorrect

160

avg: 90

Total Cost

$0.26

avg: $9.58

Average response time

5.4s

avg: 17.9s

Output Tokens

138K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

92.3%

avg: 95.4%

Breakdown by Exam

MIR 2024
264
Correct
133
Incorrect
52
Accuracy
66.5%
Net score
115.66
MIR 2025
257
Correct
130
Incorrect
58
Accuracy
65.0%
Net score
110.66
MIR 2026
263
Correct
135
Incorrect
50
Accuracy
67.5%
Net score
118.33