MedicalBenchmark
Cohere: Command R+ (08-2024) provider

Command R+ (08-2024)

247

#247 of 290 modelsMIR 2026

Net score

107.66 pts

Accuracy

63.5%

Correct / Incorrect

127 / 58

Total Cost

$0.95

Overall Performance

(vs. average)
Accuracy

63.5%

avg: 81.6%

Net score

107.66 pts

avg: 154.00 pts

Correct

127

avg: 163

Incorrect

58

avg: 28

Total Cost

$0.95

avg: $3.33

Average response time

13.0s

avg: 16.2s

Output Tokens

72K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

91.8%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
69.6%
Cardiology
Correct
13
Incorrect
8
Unanswered
4
Accuracy
52.0%
Average
77.3%
Dermatology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
72.3%
Endocrinology and Nutrition
Correct
9
Incorrect
6
Unanswered
0
Accuracy
60.0%
Average
84.0%
ENT
Correct
5
Incorrect
2
Unanswered
1
Accuracy
62.5%
Average
84.7%
Epidemiology
Correct
4
Incorrect
3
Unanswered
0
Accuracy
57.1%
Average
80.2%
Gastroenterology
Correct
21
Incorrect
8
Unanswered
1
Accuracy
70.0%
Average
79.3%
Genetics
Correct
5
Incorrect
4
Unanswered
2
Accuracy
45.5%
Average
78.7%
Geriatrics
Correct
9
Incorrect
3
Unanswered
1
Accuracy
69.2%
Average
83.0%
Gynecology and Obstetrics
Correct
6
Incorrect
4
Unanswered
2
Accuracy
50.0%
Average
84.3%
Health Planning and Management
Correct
7
Incorrect
3
Unanswered
0
Accuracy
70.0%
Average
78.4%
Hematology
Correct
3
Incorrect
5
Unanswered
1
Accuracy
33.3%
Average
76.6%
Immunology
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
91.4%
Infectious Diseases
Correct
7
Incorrect
6
Unanswered
1
Accuracy
50.0%
Average
77.9%
Legal Medicine and Bioethics
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
82.9%
Medical Oncology
Correct
16
Incorrect
7
Unanswered
0
Accuracy
69.6%
Average
83.0%
Nephrology
Correct
7
Incorrect
3
Unanswered
0
Accuracy
70.0%
Average
85.1%
Neurology
Correct
12
Incorrect
0
Unanswered
1
Accuracy
92.3%
Average
88.6%
Ophthalmology
Correct
4
Incorrect
1
Unanswered
0
Accuracy
80.0%
Average
83.7%
Palliative Care
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
80.2%
Pediatrics
Correct
14
Incorrect
7
Unanswered
1
Accuracy
63.6%
Average
87.6%
Pharmacology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
78.6%
Psychiatry
Correct
5
Incorrect
2
Unanswered
1
Accuracy
62.5%
Average
87.9%
Pulmonology
Correct
10
Incorrect
5
Unanswered
1
Accuracy
62.5%
Average
82.8%
Radiology-Emergency
Correct
6
Incorrect
7
Unanswered
0
Accuracy
46.2%
Average
67.7%
Rheumatology
Correct
9
Incorrect
0
Unanswered
2
Accuracy
81.8%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
65.2%
Urology
Correct
5
Incorrect
2
Unanswered
1
Accuracy
62.5%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
53
Incorrect
23
Unanswered
5
Accuracy
65.4%
Average
82.2%
Epidemiology
Correct
8
Incorrect
1
Unanswered
0
Accuracy
88.9%
Average
88.7%
Ethics
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
15
Incorrect
17
Unanswered
5
Accuracy
40.5%
Average
72.0%
Legal
Correct
6
Incorrect
3
Unanswered
0
Accuracy
66.7%
Average
82.4%
Pathophysiology
Correct
18
Incorrect
7
Unanswered
1
Accuracy
69.2%
Average
84.3%
Pharmacology
Correct
11
Incorrect
3
Unanswered
1
Accuracy
73.3%
Average
82.3%
Prevention
Correct
9
Incorrect
6
Unanswered
1
Accuracy
56.3%
Average
80.6%
Prognosis
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
93.2%
Risk
Correct
8
Incorrect
6
Unanswered
1
Accuracy
53.3%
Average
84.3%
Tests
Correct
22
Incorrect
7
Unanswered
4
Accuracy
66.7%
Average
80.3%
Treatment
Correct
41
Incorrect
23
Unanswered
8
Accuracy
56.9%
Average
80.1%
#AnswerCorrectStatus
1CA
2BB
3DD
4DD
5BB
6C
7DB
8D
9DD
10AA
11DB
12CA
13DAnnulled
14BC
15A
16CC
17CC
18DD
19CB
20CB
21DB
22C
23CB
24A
25DC
26AA
27BB
28DD
29AA
30DD
31AC
32CC
33DB
34CB
35CC
36BD
37CD
38A
39CC
40BA
41DD
42A
43BB
44BB
45CB
46BB
47DD
48CC
49CC
50AAnnulled
51CA
52CC
53CC
54BC
55CA
56A
57A
58BA
59BB
60B
61CC
62BB
63DB
64BAnnulled
65CC
66DC
67CC
68DA
69BB
70BB
71BB
72BB
73DB
74AA
75CC
76CC
77DA
78DD
79AA
80DD
81CC
82CD
83BB
84CA
85DD
86AA
87B
88BB
89BB
90CC
91BA
92CC
93DD
94DC
95CC
96AB
97BB
98AA
99BB
100CC
101CC
102DA
103CC
104CC
105CC
106BB
107CC
108BA
109CC
110AC
111AB
112CC
113CC
114DD
115AB
116DD
117CC
118BB
119AA
120AA
121AC
122BB
123B
124BB
125CC
126BB
127BC
128BB
129DC
130CC
131BB
132AB
133CC
134BB
135CC
136BB
137DD
138CB
139Annulled
140CD
141DA
142BAnnulled
143BA
144DD
145AC
146DC
147BB
148C
149BB
150BB
151BB
152CC
153BC
154DD
155BB
156BA
157DD
158BB
159CC
160AA
161CAnnulled
162AA
163DC
164CC
165AA
166AA
167DD
168CC
169BB
170BB
171AA
172DB
173DD
174AC
175BB
176DA
177DD
178BD
179B
180CC
181BB
182CC
183DD
184DD
185DB
186DD
187DD
188DC
189CC
190AB
191DD
192DD
193CC
194CC
195DD
196CA
197C
198BA
199BB
200DD
201CC
202AA
203AA
204CC
205BB
206CC
207AA
208AAnnulled
209BB
210CC