MedicalBenchmark
TheDrummer: UnslopNemo 12B provider

UnslopNemo 12B

272

#272 of 291 modelsMIR 2024

Net score

52.33 pts

Accuracy

37.0%

Correct / Incorrect

74 / 65

Total Cost

$0.07

Overall Performance

(vs. average)
Accuracy

37.0%

avg: 80.5%

Net score

52.33 pts

avg: 150.85 pts

Correct

74

avg: 161

Incorrect

65

avg: 30

Total Cost

$0.07

avg: $3.32

Average response time

9.6s

avg: 16.4s

Output Tokens

76K

avg: 427K

Reasoning Tokens

0

avg: 310K

Average confidence

68.3%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
2
Accuracy
33.3%
Average
90.5%
Anesthesiology and Resuscitation
Correct
1
Incorrect
1
Unanswered
2
Accuracy
25.0%
Average
87.1%
Cardiology
Correct
11
Incorrect
4
Unanswered
6
Accuracy
52.4%
Average
79.7%
Dermatology
Correct
7
Incorrect
3
Unanswered
4
Accuracy
50.0%
Average
80.2%
Endocrinology and Nutrition
Correct
7
Incorrect
7
Unanswered
5
Accuracy
36.8%
Average
84.2%
ENT
Correct
2
Incorrect
2
Unanswered
3
Accuracy
28.6%
Average
74.4%
Epidemiology
Correct
5
Incorrect
3
Unanswered
0
Accuracy
62.5%
Average
89.3%
Gastroenterology
Correct
8
Incorrect
6
Unanswered
8
Accuracy
36.4%
Average
70.5%
Genetics
Correct
3
Incorrect
3
Unanswered
1
Accuracy
42.9%
Average
86.5%
Geriatrics
Correct
4
Incorrect
3
Unanswered
3
Accuracy
40.0%
Average
86.9%
Gynecology and Obstetrics
Correct
7
Incorrect
2
Unanswered
5
Accuracy
50.0%
Average
81.2%
Health Planning and Management
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
73.2%
Hematology
Correct
6
Incorrect
5
Unanswered
2
Accuracy
46.2%
Average
81.5%
Immunology
Correct
2
Incorrect
2
Unanswered
4
Accuracy
25.0%
Average
89.1%
Infectious Diseases
Correct
10
Incorrect
7
Unanswered
6
Accuracy
43.5%
Average
81.8%
Legal Medicine and Bioethics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
91.7%
Medical Oncology
Correct
7
Incorrect
6
Unanswered
8
Accuracy
33.3%
Average
80.2%
Nephrology
Correct
4
Incorrect
6
Unanswered
3
Accuracy
30.8%
Average
80.8%
Neurology
Correct
7
Incorrect
4
Unanswered
11
Accuracy
31.8%
Average
83.7%
Ophthalmology
Correct
1
Incorrect
2
Unanswered
2
Accuracy
20.0%
Average
80.0%
Palliative Care
Correct
2
Incorrect
0
Unanswered
2
Accuracy
50.0%
Average
88.2%
Pediatrics
Correct
6
Incorrect
7
Unanswered
4
Accuracy
35.3%
Average
82.0%
Pharmacology
Correct
8
Incorrect
6
Unanswered
9
Accuracy
34.8%
Average
85.4%
Psychiatry
Correct
5
Incorrect
3
Unanswered
2
Accuracy
50.0%
Average
89.5%
Pulmonology
Correct
4
Incorrect
7
Unanswered
8
Accuracy
21.1%
Average
80.6%
Radiology-Emergency
Correct
3
Incorrect
7
Unanswered
4
Accuracy
21.4%
Average
64.9%
Rheumatology
Correct
5
Incorrect
5
Unanswered
4
Accuracy
35.7%
Average
81.4%
Statistics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
91.1%
Traumatology
Correct
3
Incorrect
6
Unanswered
6
Accuracy
20.0%
Average
74.5%
Urology
Correct
2
Incorrect
3
Unanswered
1
Accuracy
33.3%
Average
78.2%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
3
Unanswered
2
Accuracy
16.7%
Average
79.8%
Biostatistics
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
90.7%
Diagnosis
Correct
27
Incorrect
24
Unanswered
22
Accuracy
37.0%
Average
79.2%
Epidemiology
Correct
6
Incorrect
5
Unanswered
1
Accuracy
50.0%
Average
81.2%
Ethics
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
94.5%
Interpretation
Correct
8
Incorrect
20
Unanswered
9
Accuracy
21.6%
Average
69.6%
Pathophysiology
Correct
15
Incorrect
7
Unanswered
11
Accuracy
45.5%
Average
85.4%
Pharmacology
Correct
6
Incorrect
6
Unanswered
13
Accuracy
24.0%
Average
84.0%
Prevention
Correct
7
Incorrect
1
Unanswered
4
Accuracy
58.3%
Average
89.8%
Prognosis
Correct
2
Incorrect
2
Unanswered
3
Accuracy
28.6%
Average
83.9%
Risk
Correct
6
Incorrect
5
Unanswered
2
Accuracy
46.2%
Average
83.6%
Tests
Correct
7
Incorrect
9
Unanswered
5
Accuracy
33.3%
Average
73.9%
Treatment
Correct
25
Incorrect
20
Unanswered
26
Accuracy
35.2%
Average
81.3%
#AnswerCorrectStatus
1AB
2D
3DB
4C
5DC
6DB
7DD
8C
9BA
10BD
11DD
12A
13CC
14A
15AB
16CA
17C
18A
19CB
20AC
21AD
22AB
23AA
24CA
25C
26B
27CC
28A
29AB
30AC
31D
32A
33CC
34DB
35D
36DD
37A
38DA
39C
40BB
41BC
42DD
43DA
44BD
45AD
46BB
47CC
48CC
49AB
50BC
51AA
52D
53AC
54BB
55C
56D
57DA
58DA
59A
60A
61A
62DD
63CD
64Annulled
65DD
66C
67B
68DAnnulled
69AA
70BB
71B
72D
73DB
74AC
75B
76BA
77AD
78C
79DB
80AA
81CC
82DC
83BB
84C
85AA
86A
87DB
88CD
89BB
90AA
91D
92A
93CC
94BB
95D
96B
97BB
98B
99A
100BB
101A
102D
103BB
104AD
105BB
106BC
107C
108BB
109BD
110DD
111B
112CC
113DAnnulled
114DD
115DD
116AA
117DD
118DD
119CA
120CC
121A
122DB
123CD
124AD
125CB
126D
127A
128BB
129DD
130AC
131AC
132DD
133AA
134CC
135AA
136DD
137AA
138C
139A
140C
141B
142AC
143DA
144DD
145DC
146BC
147CC
148AA
149AC
150DD
151CA
152AA
153C
154BB
155DD
156CC
157CC
158DD
159DD
160CB
161B
162AB
163DB
164AB
165CA
166AC
167A
168BB
169DC
170BA
171DD
172B
173DA
174B
175AA
176CC
177C
178B
179DC
180Annulled
181DB
182DD
183C
184A
185CC
186BD
187AA
188CC
189AD
190DD
191BB
192BB
193C
194DC
195CC
196BB
197AA
198B
199DD
200A
201B
202D
203B
204DD
205D
206BAnnulled
207A
208AA
209BB
210DD