MedicalBenchmark
Google: Gemma 3 4B provider

Gemma 3 4B

258

#258 of 290 modelsMIR 2026

Net score

84.00 pts

Accuracy

56.0%

Correct / Incorrect

112 / 84

Total Cost

$0.01

Overall Performance

(vs. average)
Accuracy

56.0%

avg: 81.6%

Net score

84.00 pts

avg: 154.00 pts

Correct

112

avg: 163

Incorrect

84

avg: 28

Total Cost

$0.01

avg: $3.33

Average response time

12.1s

avg: 16.2s

Output Tokens

95K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

96.5%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
5
Incorrect
2
Unanswered
0
Accuracy
71.4%
Average
69.6%
Cardiology
Correct
13
Incorrect
12
Unanswered
0
Accuracy
52.0%
Average
77.3%
Dermatology
Correct
8
Incorrect
3
Unanswered
0
Accuracy
72.7%
Average
72.3%
Endocrinology and Nutrition
Correct
9
Incorrect
6
Unanswered
0
Accuracy
60.0%
Average
84.0%
ENT
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
84.7%
Epidemiology
Correct
2
Incorrect
4
Unanswered
1
Accuracy
28.6%
Average
80.2%
Gastroenterology
Correct
14
Incorrect
15
Unanswered
1
Accuracy
46.7%
Average
79.3%
Genetics
Correct
4
Incorrect
6
Unanswered
1
Accuracy
36.4%
Average
78.7%
Geriatrics
Correct
7
Incorrect
5
Unanswered
1
Accuracy
53.8%
Average
83.0%
Gynecology and Obstetrics
Correct
5
Incorrect
7
Unanswered
0
Accuracy
41.7%
Average
84.3%
Health Planning and Management
Correct
5
Incorrect
4
Unanswered
1
Accuracy
50.0%
Average
78.4%
Hematology
Correct
5
Incorrect
4
Unanswered
0
Accuracy
55.6%
Average
76.6%
Immunology
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
91.4%
Infectious Diseases
Correct
7
Incorrect
5
Unanswered
2
Accuracy
50.0%
Average
77.9%
Legal Medicine and Bioethics
Correct
8
Incorrect
3
Unanswered
0
Accuracy
72.7%
Average
82.9%
Medical Oncology
Correct
13
Incorrect
10
Unanswered
0
Accuracy
56.5%
Average
83.0%
Nephrology
Correct
6
Incorrect
4
Unanswered
0
Accuracy
60.0%
Average
85.1%
Neurology
Correct
5
Incorrect
8
Unanswered
0
Accuracy
38.5%
Average
88.6%
Ophthalmology
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
83.7%
Palliative Care
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
80.2%
Pediatrics
Correct
16
Incorrect
6
Unanswered
0
Accuracy
72.7%
Average
87.6%
Pharmacology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
78.6%
Psychiatry
Correct
4
Incorrect
4
Unanswered
0
Accuracy
50.0%
Average
87.9%
Pulmonology
Correct
11
Incorrect
5
Unanswered
0
Accuracy
68.8%
Average
82.8%
Radiology-Emergency
Correct
6
Incorrect
7
Unanswered
0
Accuracy
46.2%
Average
67.7%
Rheumatology
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
88.4%
Statistics
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
83.8%
Traumatology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
65.2%
Urology
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
83.8%
Diagnosis
Correct
41
Incorrect
37
Unanswered
3
Accuracy
50.6%
Average
82.2%
Epidemiology
Correct
5
Incorrect
3
Unanswered
1
Accuracy
55.6%
Average
88.7%
Ethics
Correct
6
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
92.0%
Interpretation
Correct
22
Incorrect
15
Unanswered
0
Accuracy
59.5%
Average
72.0%
Legal
Correct
6
Incorrect
3
Unanswered
0
Accuracy
66.7%
Average
82.4%
Pathophysiology
Correct
17
Incorrect
9
Unanswered
0
Accuracy
65.4%
Average
84.3%
Pharmacology
Correct
8
Incorrect
6
Unanswered
1
Accuracy
53.3%
Average
82.3%
Prevention
Correct
7
Incorrect
8
Unanswered
1
Accuracy
43.8%
Average
80.6%
Prognosis
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
93.2%
Risk
Correct
4
Incorrect
11
Unanswered
0
Accuracy
26.7%
Average
84.3%
Tests
Correct
16
Incorrect
15
Unanswered
2
Accuracy
48.5%
Average
80.3%
Treatment
Correct
45
Incorrect
27
Unanswered
0
Accuracy
62.5%
Average
80.1%
#AnswerCorrectStatus
1CA
2BB
3BD
4DD
5BB
6DC
7CB
8DD
9DD
10AA
11BB
12AA
13DAnnulled
14DC
15CA
16CC
17CC
18BD
19BB
20CB
21BB
22CC
23DB
24AA
25CC
26DA
27BB
28DD
29CA
30D
31AC
32CC
33DB
34CB
35CC
36BD
37DD
38A
39CC
40BA
41DD
42AA
43BB
44BB
45BB
46BB
47DD
48CC
49CC
50AAnnulled
51AA
52CC
53CC
54BC
55BA
56DA
57CA
58BA
59AB
60BB
61DC
62BB
63AB
64BAnnulled
65CC
66DC
67CC
68AA
69CB
70BB
71AB
72BB
73BB
74AA
75CC
76CC
77AA
78CD
79DA
80DD
81CC
82CD
83AB
84AA
85DD
86DA
87BB
88BB
89BB
90BC
91BA
92BC
93BD
94AC
95AC
96BB
97DB
98AA
99BB
100CC
101BC
102CA
103CC
104CC
105BC
106CB
107DC
108BA
109C
110BC
111BB
112CC
113DC
114DD
115DB
116DD
117CC
118AB
119DA
120AA
121AC
122DB
123DB
124BB
125CC
126BB
127BC
128BB
129CC
130CC
131BB
132CB
133DC
134BB
135CC
136CB
137CD
138BB
139BAnnulled
140BD
141AA
142DAnnulled
143CA
144DD
145CC
146DC
147BB
148CC
149BB
150CB
151B
152AC
153BC
154CD
155BB
156AA
157DD
158BB
159BC
160AA
161CAnnulled
162AA
163DC
164AC
165AA
166AA
167CD
168CC
169BB
170AB
171AA
172DB
173AD
174AC
175BB
176AA
177AD
178BD
179BB
180BC
181BB
182CC
183DD
184BD
185AB
186DD
187DD
188BC
189CC
190DB
191DD
192BD
193CC
194CC
195DD
196BA
197CC
198AA
199AB
200CD
201CC
202AA
203AA
204CC
205BB
206CC
207DA
208DAnnulled
209BB
210CC