MedicalBenchmark
Upstage: Solar Pro 3 provider

Solar Pro 3

319

#319 of 320 models — MIR 2024

Net score

0.00 pts

Accuracy

0.0%

Correct / Incorrect

0 / 0

Total Cost

$0.00

Overall Performance

(vs. average)
Accuracy

0.0%

avg: 81.3%

Net score

0.00 pts

avg: 153.08 pts

Correct

0

avg: 163

Incorrect

0

avg: 29

Total Cost

$0.00

avg: $3.09

Output Tokens

0

avg: 414K

Reasoning Tokens

0

avg: 296K

Subject Breakdown

Allergology
Correct
0
Incorrect
0
Unanswered
3
Accuracy
0.0%
Average
90.8%
Anesthesiology and Resuscitation
Correct
0
Incorrect
0
Unanswered
4
Accuracy
0.0%
Average
87.7%
Cardiology
Correct
0
Incorrect
0
Unanswered
21
Accuracy
0.0%
Average
80.4%
Dermatology
Correct
0
Incorrect
0
Unanswered
14
Accuracy
0.0%
Average
81.0%
Endocrinology and Nutrition
Correct
0
Incorrect
0
Unanswered
19
Accuracy
0.0%
Average
85.1%
ENT
Correct
0
Incorrect
0
Unanswered
7
Accuracy
0.0%
Average
75.1%
Epidemiology
Correct
0
Incorrect
0
Unanswered
8
Accuracy
0.0%
Average
89.7%
Gastroenterology
Correct
0
Incorrect
0
Unanswered
22
Accuracy
0.0%
Average
71.5%
Genetics
Correct
0
Incorrect
0
Unanswered
7
Accuracy
0.0%
Average
87.1%
Geriatrics
Correct
0
Incorrect
0
Unanswered
10
Accuracy
0.0%
Average
87.7%
Gynecology and Obstetrics
Correct
0
Incorrect
0
Unanswered
14
Accuracy
0.0%
Average
82.0%
Health Planning and Management
Correct
0
Incorrect
0
Unanswered
2
Accuracy
0.0%
Average
75.1%
Hematology
Correct
0
Incorrect
0
Unanswered
13
Accuracy
0.0%
Average
82.4%
Immunology
Correct
0
Incorrect
0
Unanswered
8
Accuracy
0.0%
Average
89.7%
Infectious Diseases
Correct
0
Incorrect
0
Unanswered
23
Accuracy
0.0%
Average
82.5%
Legal Medicine and Bioethics
Correct
0
Incorrect
0
Unanswered
2
Accuracy
0.0%
Average
91.8%
Medical Oncology
Correct
0
Incorrect
0
Unanswered
21
Accuracy
0.0%
Average
80.9%
Nephrology
Correct
0
Incorrect
0
Unanswered
13
Accuracy
0.0%
Average
81.8%
Neurology
Correct
0
Incorrect
0
Unanswered
22
Accuracy
0.0%
Average
84.5%
Ophthalmology
Correct
0
Incorrect
0
Unanswered
5
Accuracy
0.0%
Average
81.3%
Palliative Care
Correct
0
Incorrect
0
Unanswered
4
Accuracy
0.0%
Average
88.6%
Pediatrics
Correct
0
Incorrect
0
Unanswered
17
Accuracy
0.0%
Average
82.9%
Pharmacology
Correct
0
Incorrect
0
Unanswered
23
Accuracy
0.0%
Average
85.8%
Psychiatry
Correct
0
Incorrect
0
Unanswered
10
Accuracy
0.0%
Average
90.0%
Pulmonology
Correct
0
Incorrect
0
Unanswered
19
Accuracy
0.0%
Average
81.6%
Radiology-Emergency
Correct
0
Incorrect
0
Unanswered
14
Accuracy
0.0%
Average
66.0%
Rheumatology
Correct
0
Incorrect
0
Unanswered
14
Accuracy
0.0%
Average
82.4%
Statistics
Correct
0
Incorrect
0
Unanswered
3
Accuracy
0.0%
Average
91.6%
Traumatology
Correct
0
Incorrect
0
Unanswered
15
Accuracy
0.0%
Average
75.4%
Urology
Correct
0
Incorrect
0
Unanswered
6
Accuracy
0.0%
Average
79.0%

Question Type Breakdown

Anatomy
Correct
0
Incorrect
0
Unanswered
6
Accuracy
0.0%
Average
81.1%
Biostatistics
Correct
0
Incorrect
0
Unanswered
5
Accuracy
0.0%
Average
91.3%
Diagnosis
Correct
0
Incorrect
0
Unanswered
73
Accuracy
0.0%
Average
80.0%
Epidemiology
Correct
0
Incorrect
0
Unanswered
12
Accuracy
0.0%
Average
82.1%
Ethics
Correct
0
Incorrect
0
Unanswered
1
Accuracy
0.0%
Average
94.0%
Interpretation
Correct
0
Incorrect
0
Unanswered
37
Accuracy
0.0%
Average
70.5%
Pathophysiology
Correct
0
Incorrect
0
Unanswered
33
Accuracy
0.0%
Average
86.1%
Pharmacology
Correct
0
Incorrect
0
Unanswered
25
Accuracy
0.0%
Average
84.7%
Prevention
Correct
0
Incorrect
0
Unanswered
12
Accuracy
0.0%
Average
90.3%
Prognosis
Correct
0
Incorrect
0
Unanswered
7
Accuracy
0.0%
Average
84.6%
Risk
Correct
0
Incorrect
0
Unanswered
13
Accuracy
0.0%
Average
84.5%
Tests
Correct
0
Incorrect
0
Unanswered
21
Accuracy
0.0%
Average
75.0%
Treatment
Correct
0
Incorrect
0
Unanswered
71
Accuracy
0.0%
Average
82.1%
#AnswerCorrectStatus
1—B
2—D
3—B
4—C
5—C
6—B
7—D
8—C
9—A
10—D
11—D
12—A
13—C
14—A
15—B
16—A
17—C
18—A
19—B
20—C
21—D
22—B
23—A
24—A
25—C
26—B
27—C
28—A
29—B
30—C
31—D
32—A
33—C
34—B
35—D
36—D
37—A
38—A
39—C
40—B
41—C
42—D
43—A
44—D
45—D
46—B
47—C
48—C
49—B
50—C
51—A
52—D
53—C
54—B
55—C
56—D
57—A
58—A
59—A
60—A
61—A
62—D
63—D
64——Annulled
65—D
66—C
67—B
68——Annulled
69—A
70—B
71—B
72—D
73—B
74—C
75—B
76—A
77—D
78—C
79—B
80—A
81—C
82—C
83—B
84—C
85—A
86—A
87—B
88—D
89—B
90—A
91—D
92—A
93—C
94—B
95—D
96—B
97—B
98—B
99—A
100—B
101—A
102—D
103—B
104—D
105—B
106—C
107—C
108—B
109—D
110—D
111—B
112—C
113——Annulled
114—D
115—D
116—A
117—D
118—D
119—A
120—C
121—A
122—B
123—D
124—D
125—B
126—D
127—A
128—B
129—D
130—C
131—C
132—D
133—A
134—C
135—A
136—D
137—A
138—C
139—A
140—C
141—B
142—C
143—A
144—D
145—C
146—C
147—C
148—A
149—C
150—D
151—A
152—A
153—C
154—B
155—D
156—C
157—C
158—D
159—D
160—B
161—B
162—B
163—B
164—B
165—A
166—C
167—A
168—B
169—C
170—A
171—D
172—B
173—A
174—B
175—A
176—C
177—C
178—B
179—C
180——Annulled
181—B
182—D
183—C
184—A
185—C
186—D
187—A
188—C
189—D
190—D
191—B
192—B
193—C
194—C
195—C
196—B
197—A
198—B
199—D
200—A
201—B
202—D
203—B
204—D
205—D
206——Annulled
207—A
208—A
209—B
210—D