MedicalBenchmark
Google: Gemma 3 12B provider

Gemma 3 12B

256

#256 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

368.66 pts

Accuracy

71.0%

Correct / Incorrect

426 / 172

Total Cost

$0.08

Overall Performance

(vs. average)
Accuracy

71.0%

avg: 80.6%

Net score

368.66 pts

avg: 453.30 pts

Correct

426

avg: 483

Incorrect

172

avg: 90

Total Cost

$0.08

avg: $9.58

Average response time

12.8s

avg: 17.9s

Output Tokens

269K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

99.3%

avg: 95.4%

Breakdown by Exam

MIR 2024
259
Correct
141
Incorrect
58
Accuracy
70.5%
Net score
121.66
MIR 2025
250
Correct
141
Incorrect
58
Accuracy
70.5%
Net score
121.66
MIR 2026
258
Correct
144
Incorrect
56
Accuracy
72.0%
Net score
125.33