MedicalBenchmark
Cohere: Command R7B (12-2024) provider

Command R7B (12-2024)

269

#269 of 290 modelsMIR 2026

Net score

65.66 pts

Accuracy

48.5%

Correct / Incorrect

97 / 94

Total Cost

$0.01

Overall Performance

(vs. average)
Accuracy

48.5%

avg: 81.6%

Net score

65.66 pts

avg: 154.00 pts

Correct

97

avg: 163

Incorrect

94

avg: 28

Total Cost

$0.01

avg: $3.33

Average response time

3.4s

avg: 16.2s

Output Tokens

72K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

94.9%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
69.6%
Cardiology
Correct
9
Incorrect
15
Unanswered
1
Accuracy
36.0%
Average
77.3%
Dermatology
Correct
4
Incorrect
6
Unanswered
1
Accuracy
36.4%
Average
72.3%
Endocrinology and Nutrition
Correct
7
Incorrect
8
Unanswered
0
Accuracy
46.7%
Average
84.0%
ENT
Correct
5
Incorrect
3
Unanswered
0
Accuracy
62.5%
Average
84.7%
Epidemiology
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
80.2%
Gastroenterology
Correct
17
Incorrect
11
Unanswered
2
Accuracy
56.7%
Average
79.3%
Genetics
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
78.7%
Geriatrics
Correct
8
Incorrect
5
Unanswered
0
Accuracy
61.5%
Average
83.0%
Gynecology and Obstetrics
Correct
4
Incorrect
8
Unanswered
0
Accuracy
33.3%
Average
84.3%
Health Planning and Management
Correct
5
Incorrect
4
Unanswered
1
Accuracy
50.0%
Average
78.4%
Hematology
Correct
4
Incorrect
4
Unanswered
1
Accuracy
44.4%
Average
76.6%
Immunology
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
91.4%
Infectious Diseases
Correct
2
Incorrect
11
Unanswered
1
Accuracy
14.3%
Average
77.9%
Legal Medicine and Bioethics
Correct
7
Incorrect
3
Unanswered
1
Accuracy
63.6%
Average
82.9%
Medical Oncology
Correct
15
Incorrect
7
Unanswered
1
Accuracy
65.2%
Average
83.0%
Nephrology
Correct
3
Incorrect
6
Unanswered
1
Accuracy
30.0%
Average
85.1%
Neurology
Correct
8
Incorrect
5
Unanswered
0
Accuracy
61.5%
Average
88.6%
Ophthalmology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
83.7%
Palliative Care
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
80.2%
Pediatrics
Correct
14
Incorrect
7
Unanswered
1
Accuracy
63.6%
Average
87.6%
Pharmacology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
78.6%
Psychiatry
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
87.9%
Pulmonology
Correct
9
Incorrect
5
Unanswered
2
Accuracy
56.3%
Average
82.8%
Radiology-Emergency
Correct
5
Incorrect
7
Unanswered
1
Accuracy
38.5%
Average
67.7%
Rheumatology
Correct
4
Incorrect
6
Unanswered
1
Accuracy
36.4%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
4
Incorrect
7
Unanswered
0
Accuracy
36.4%
Average
65.2%
Urology
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
36
Incorrect
40
Unanswered
5
Accuracy
44.4%
Average
82.2%
Epidemiology
Correct
5
Incorrect
4
Unanswered
0
Accuracy
55.6%
Average
88.7%
Ethics
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
92.0%
Interpretation
Correct
9
Incorrect
24
Unanswered
4
Accuracy
24.3%
Average
72.0%
Legal
Correct
6
Incorrect
2
Unanswered
1
Accuracy
66.7%
Average
82.4%
Pathophysiology
Correct
15
Incorrect
11
Unanswered
0
Accuracy
57.7%
Average
84.3%
Pharmacology
Correct
7
Incorrect
8
Unanswered
0
Accuracy
46.7%
Average
82.3%
Prevention
Correct
6
Incorrect
9
Unanswered
1
Accuracy
37.5%
Average
80.6%
Prognosis
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
93.2%
Risk
Correct
5
Incorrect
10
Unanswered
0
Accuracy
33.3%
Average
84.3%
Tests
Correct
12
Incorrect
21
Unanswered
0
Accuracy
36.4%
Average
80.3%
Treatment
Correct
41
Incorrect
29
Unanswered
2
Accuracy
56.9%
Average
80.1%
#AnswerCorrectStatus
1CA
2BB
3D
4BD
5BB
6AC
7CB
8BD
9BD
10CA
11CB
12A
13AAnnulled
14BC
15CA
16CC
17AC
18BD
19B
20CB
21BB
22C
23BB
24BA
25CC
26A
27DB
28DD
29AA
30BD
31AC
32CC
33DB
34DB
35AC
36DD
37BD
38CA
39AC
40BA
41DD
42A
43AB
44DB
45BB
46BB
47DD
48CC
49CC
50CAnnulled
51BA
52BC
53DC
54AC
55CA
56CA
57CA
58AA
59AB
60DB
61CC
62BB
63BB
64AAnnulled
65CC
66DC
67CC
68AA
69CB
70AB
71AB
72DB
73BB
74AA
75C
76CC
77CA
78DD
79AA
80DD
81CC
82DD
83BB
84AA
85DD
86AA
87BB
88BB
89BB
90BC
91AA
92BC
93AD
94AC
95AC
96AB
97BB
98DA
99BB
100CC
101CC
102BA
103CC
104CC
105CC
106CB
107AC
108BA
109AC
110AC
111AB
112CC
113CC
114DD
115AB
116CD
117DC
118CB
119BA
120AA
121AC
122DB
123DB
124BB
125CC
126BB
127BC
128BB
129CC
130CC
131BB
132AB
133CC
134BB
135CC
136CB
137CD
138BB
139BAnnulled
140DD
141AA
142DAnnulled
143A
144AD
145CC
146CC
147BB
148CC
149BB
150BB
151BB
152CC
153CC
154DD
155BB
156BA
157DD
158BB
159AC
160AA
161CAnnulled
162AA
163BC
164AC
165BA
166AA
167DD
168CC
169AB
170BB
171AA
172DB
173BD
174AC
175BB
176CA
177CD
178DD
179AB
180BC
181BB
182AC
183CD
184DD
185AB
186DD
187DD
188BC
189CC
190AB
191DD
192BD
193CC
194AC
195D
196AA
197DC
198CA
199CB
200DD
201CC
202AA
203CA
204AC
205BB
206AC
207CA
208DAnnulled
209BB
210CC