MedicalBenchmark
TheDrummer: Rocinante 12B provider

Rocinante 12B

302

#302 of 319 models — MIR 2026

Net score

61.66 pts

Accuracy

41.0%

Correct / Incorrect

82 / 61

Total Cost

$0.07

Overall Performance

(vs. average)
Accuracy

41.0%

avg: 82.4%

Net score

61.66 pts

avg: 156.14 pts

Correct

82

avg: 165

Incorrect

61

avg: 26

Total Cost

$0.07

avg: $3.12

Average response time

9.1s

avg: 17.4s

Output Tokens

122K

avg: 415K

Reasoning Tokens

0

avg: 295K

Average confidence

68.4%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
2
Incorrect
2
Unanswered
3
Accuracy
28.6%
Average
71.0%
Cardiology
Correct
10
Incorrect
8
Unanswered
7
Accuracy
40.0%
Average
78.4%
Dermatology
Correct
6
Incorrect
1
Unanswered
4
Accuracy
54.5%
Average
73.2%
Endocrinology and Nutrition
Correct
7
Incorrect
4
Unanswered
4
Accuracy
46.7%
Average
84.7%
ENT
Correct
4
Incorrect
1
Unanswered
3
Accuracy
50.0%
Average
85.0%
Epidemiology
Correct
3
Incorrect
3
Unanswered
1
Accuracy
42.9%
Average
81.3%
Gastroenterology
Correct
7
Incorrect
11
Unanswered
12
Accuracy
23.3%
Average
80.2%
Genetics
Correct
6
Incorrect
1
Unanswered
4
Accuracy
54.5%
Average
79.7%
Geriatrics
Correct
4
Incorrect
9
Unanswered
0
Accuracy
30.8%
Average
83.7%
Gynecology and Obstetrics
Correct
6
Incorrect
4
Unanswered
2
Accuracy
50.0%
Average
85.2%
Health Planning and Management
Correct
4
Incorrect
3
Unanswered
3
Accuracy
40.0%
Average
79.4%
Hematology
Correct
3
Incorrect
3
Unanswered
3
Accuracy
33.3%
Average
77.6%
Immunology
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
91.8%
Infectious Diseases
Correct
5
Incorrect
6
Unanswered
3
Accuracy
35.7%
Average
79.0%
Legal Medicine and Bioethics
Correct
5
Incorrect
4
Unanswered
2
Accuracy
45.5%
Average
83.4%
Medical Oncology
Correct
11
Incorrect
5
Unanswered
7
Accuracy
47.8%
Average
83.7%
Nephrology
Correct
4
Incorrect
5
Unanswered
1
Accuracy
40.0%
Average
85.6%
Neurology
Correct
6
Incorrect
3
Unanswered
4
Accuracy
46.2%
Average
89.0%
Ophthalmology
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
84.5%
Palliative Care
Correct
1
Incorrect
4
Unanswered
1
Accuracy
16.7%
Average
80.8%
Pediatrics
Correct
9
Incorrect
6
Unanswered
7
Accuracy
40.9%
Average
88.1%
Pharmacology
Correct
2
Incorrect
3
Unanswered
6
Accuracy
18.2%
Average
79.6%
Psychiatry
Correct
3
Incorrect
1
Unanswered
4
Accuracy
37.5%
Average
88.4%
Pulmonology
Correct
8
Incorrect
4
Unanswered
4
Accuracy
50.0%
Average
83.6%
Radiology-Emergency
Correct
5
Incorrect
4
Unanswered
4
Accuracy
38.5%
Average
69.4%
Rheumatology
Correct
5
Incorrect
3
Unanswered
3
Accuracy
45.5%
Average
89.0%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
84.5%
Traumatology
Correct
5
Incorrect
3
Unanswered
3
Accuracy
45.5%
Average
66.6%
Urology
Correct
5
Incorrect
2
Unanswered
1
Accuracy
62.5%
Average
83.1%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
83.4%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
84.5%
Diagnosis
Correct
38
Incorrect
21
Unanswered
22
Accuracy
46.9%
Average
83.0%
Epidemiology
Correct
6
Incorrect
1
Unanswered
2
Accuracy
66.7%
Average
89.1%
Ethics
Correct
3
Incorrect
1
Unanswered
2
Accuracy
50.0%
Average
92.2%
Interpretation
Correct
13
Incorrect
11
Unanswered
13
Accuracy
35.1%
Average
73.2%
Legal
Correct
5
Incorrect
2
Unanswered
2
Accuracy
55.6%
Average
82.9%
Pathophysiology
Correct
12
Incorrect
8
Unanswered
6
Accuracy
46.2%
Average
85.0%
Pharmacology
Correct
4
Incorrect
6
Unanswered
5
Accuracy
26.7%
Average
83.1%
Prevention
Correct
3
Incorrect
8
Unanswered
5
Accuracy
18.8%
Average
81.5%
Prognosis
Correct
1
Incorrect
2
Unanswered
2
Accuracy
20.0%
Average
93.2%
Risk
Correct
5
Incorrect
5
Unanswered
5
Accuracy
33.3%
Average
85.0%
Tests
Correct
15
Incorrect
8
Unanswered
10
Accuracy
45.5%
Average
81.2%
Treatment
Correct
24
Incorrect
21
Unanswered
27
Accuracy
33.3%
Average
80.9%
#AnswerCorrectStatus
1—A
2—B
3DD
4BD
5—B
6—C
7BB
8—D
9BD
10AA
11AB
12CA
13C—Annulled
14—C
15DA
16CC
17CC
18—D
19—B
20BB
21BB
22—C
23AB
24AA
25—C
26DA
27BB
28DD
29AA
30—D
31DC
32CC
33AB
34DB
35—C
36CD
37—D
38AA
39CC
40CA
41AD
42BA
43—B
44AB
45CB
46BB
47DD
48CC
49—C
50B—Annulled
51AA
52CC
53CC
54AC
55—A
56—A
57BA
58—A
59DB
60—B
61CC
62—B
63BB
64C—Annulled
65—C
66DC
67CC
68BA
69CB
70BB
71AB
72BB
73—B
74AA
75CC
76CC
77AA
78DD
79—A
80DD
81—C
82—D
83AB
84AA
85DD
86AA
87AB
88BB
89DB
90CC
91AA
92CC
93—D
94DC
95—C
96—B
97—B
98AA
99AB
100—C
101CC
102AA
103BC
104—C
105—C
106DB
107CC
108BA
109CC
110AC
111BB
112CC
113CC
114—D
115CB
116DD
117—C
118BB
119—A
120AA
121CC
122—B
123BB
124BB
125AC
126CB
127AC
128DB
129AC
130AC
131BB
132—B
133—C
134AB
135CC
136AB
137AD
138—B
139A—Annulled
140CD
141AA
142B—Annulled
143—A
144—D
145—C
146AC
147BB
148AC
149—B
150CB
151BB
152—C
153CC
154—D
155AB
156—A
157DD
158BB
159AC
160AA
161C—Annulled
162AA
163—C
164—C
165BA
166AA
167DD
168BC
169—B
170BB
171AA
172—B
173DD
174CC
175CB
176DA
177—D
178BD
179—B
180—C
181BB
182CC
183—D
184DD
185AB
186DD
187DD
188BC
189CC
190AB
191DD
192BD
193CC
194—C
195DD
196—A
197CC
198CA
199BB
200CD
201CC
202AA
203AA
204AC
205—B
206BC
207BA
208——Annulled
209—B
210BC