MedicalBenchmark
TheDrummer: UnslopNemo 12B provider

UnslopNemo 12B

274

#274 of 290 modelsMIR 2025

Net score

35.33 pts

Accuracy

28.0%

Correct / Incorrect

56 / 62

Total Cost

$0.07

Overall Performance

(vs. average)
Accuracy

28.0%

avg: 75.9%

Net score

35.33 pts

avg: 138.99 pts

Correct

56

avg: 152

Incorrect

62

avg: 38

Total Cost

$0.07

avg: $3.59

Average response time

8.3s

avg: 18.1s

Output Tokens

91K

avg: 443K

Reasoning Tokens

0

avg: 320K

Average confidence

59.4%

avg: 94.7%

Subject Breakdown

Allergology
Correct
2
Incorrect
2
Unanswered
0
Accuracy
50.0%
Average
86.9%
Anesthesiology and Resuscitation
Correct
3
Incorrect
1
Unanswered
2
Accuracy
50.0%
Average
81.3%
Cardiology
Correct
7
Incorrect
4
Unanswered
11
Accuracy
31.8%
Average
77.4%
Dermatology
Correct
2
Incorrect
7
Unanswered
4
Accuracy
15.4%
Average
62.8%
Endocrinology and Nutrition
Correct
5
Incorrect
2
Unanswered
9
Accuracy
31.3%
Average
82.5%
ENT
Correct
1
Incorrect
4
Unanswered
3
Accuracy
12.5%
Average
73.8%
Epidemiology
Correct
1
Incorrect
2
Unanswered
4
Accuracy
14.3%
Average
67.1%
Gastroenterology
Correct
4
Incorrect
10
Unanswered
7
Accuracy
19.0%
Average
72.9%
Genetics
Correct
1
Incorrect
2
Unanswered
3
Accuracy
16.7%
Average
68.2%
Geriatrics
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
71.2%
Gynecology and Obstetrics
Correct
8
Incorrect
4
Unanswered
7
Accuracy
42.1%
Average
85.9%
Health Planning and Management
Correct
0
Incorrect
1
Unanswered
1
Accuracy
0.0%
Average
81.6%
Hematology
Correct
2
Incorrect
0
Unanswered
9
Accuracy
18.2%
Average
81.8%
Immunology
Correct
1
Incorrect
6
Unanswered
2
Accuracy
11.1%
Average
82.5%
Infectious Diseases
Correct
6
Incorrect
7
Unanswered
15
Accuracy
21.4%
Average
71.1%
Legal Medicine and Bioethics
Correct
3
Incorrect
1
Unanswered
1
Accuracy
60.0%
Average
67.2%
Medical Oncology
Correct
10
Incorrect
3
Unanswered
12
Accuracy
40.0%
Average
86.3%
Nephrology
Correct
2
Incorrect
4
Unanswered
9
Accuracy
13.3%
Average
78.2%
Neurology
Correct
7
Incorrect
7
Unanswered
6
Accuracy
35.0%
Average
76.2%
Ophthalmology
Correct
0
Incorrect
3
Unanswered
2
Accuracy
0.0%
Average
72.6%
Palliative Care
Correct
1
Incorrect
1
Unanswered
2
Accuracy
25.0%
Average
77.2%
Pediatrics
Correct
3
Incorrect
8
Unanswered
14
Accuracy
12.0%
Average
72.7%
Pharmacology
Correct
4
Incorrect
7
Unanswered
6
Accuracy
23.5%
Average
73.1%
Psychiatry
Correct
2
Incorrect
4
Unanswered
2
Accuracy
25.0%
Average
82.0%
Pulmonology
Correct
6
Incorrect
4
Unanswered
4
Accuracy
42.9%
Average
73.0%
Radiology-Emergency
Correct
1
Incorrect
7
Unanswered
6
Accuracy
7.1%
Average
67.9%
Rheumatology
Correct
3
Incorrect
5
Unanswered
6
Accuracy
21.4%
Average
74.6%
Statistics
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
74.9%
Traumatology
Correct
5
Incorrect
6
Unanswered
7
Accuracy
27.8%
Average
78.2%
Urology
Correct
2
Incorrect
2
Unanswered
3
Accuracy
28.6%
Average
79.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
5
Unanswered
1
Accuracy
14.3%
Average
77.1%
Biostatistics
Correct
1
Incorrect
1
Unanswered
2
Accuracy
25.0%
Average
78.4%
Diagnosis
Correct
22
Incorrect
25
Unanswered
42
Accuracy
24.7%
Average
77.9%
Epidemiology
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
75.0%
Ethics
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
72.0%
Interpretation
Correct
6
Incorrect
12
Unanswered
24
Accuracy
14.3%
Average
69.3%
Legal
Correct
2
Incorrect
1
Unanswered
1
Accuracy
50.0%
Average
63.6%
Pathophysiology
Correct
8
Incorrect
12
Unanswered
7
Accuracy
29.6%
Average
72.6%
Pharmacology
Correct
4
Incorrect
6
Unanswered
3
Accuracy
30.8%
Average
82.4%
Prevention
Correct
4
Incorrect
0
Unanswered
8
Accuracy
33.3%
Average
74.5%
Prognosis
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
77.8%
Risk
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
84.3%
Tests
Correct
8
Incorrect
7
Unanswered
11
Accuracy
30.8%
Average
76.3%
Treatment
Correct
25
Incorrect
24
Unanswered
33
Accuracy
30.5%
Average
75.2%
#AnswerCorrectStatus
1B
2DA
3CC
4CB
5AA
6C
7C
8A
9AA
10BD
11DD
12D
13B
14D
15
16B
17B
18CA
19AC
20A
21B
22D
23C
24DD
25AC
26AAnnulled
27C
28AAnnulled
29CD
30B
31CD
32DA
33DD
34BD
35B
36CD
37AC
38DC
39DD
40DA
41DD
42C
43B
44D
45D
46DA
47AA
48AA
49D
50DB
51AC
52AB
53D
54DB
55CA
56Annulled
57C
58B
59DD
60A
61AA
62DD
63BB
64D
65A
66BA
67AB
68B
69B
70A
71D
72CA
73D
74CC
75A
76CB
77BB
78BB
79AC
80C
81CC
82D
83AB
84BD
85DC
86AC
87A
88BD
89BB
90AA
91CB
92DC
93B
94C
95AA
96CC
97CD
98C
99A
100CC
101BB
102CD
103BA
104C
105AA
106C
107B
108D
109AB
110CC
111AA
112CC
113BB
114DD
115D
116C
117AA
118AD
119AC
120DB
121BD
122C
123CC
124CC
125DD
126AD
127AB
128D
129AA
130DD
131D
132AA
133AB
134C
135B
136DC
137CA
138DD
139DD
140B
141A
142A
143AB
144B
145D
146C
147BB
148A
149DA
150AA
151DA
152AA
153DB
154AB
155B
156CC
157A
158C
159C
160A
161DA
162
163DD
164C
165A
166B
167C
168BD
169DB
170B
171CC
172BA
173A
174BB
175CB
176C
177AC
178A
179AD
180AA
181BB
182CC
183DB
184BB
185B
186CAnnulled
187C
188DD
189D
190DA
191BB
192A
193C
194AA
195CA
196CA
197B
198AC
199DD
200C
201B
202A
203DD
204CC
205DB
206CD
207AA
208C
209CC
210AB