MedicalBenchmark
Morph: Morph V3 Fast provider

Morph V3 Fast

316

#316 of 320 models — MIR 2024

Net score

9.33 pts

Accuracy

13.0%

Correct / Incorrect

26 / 50

Total Cost

$1.42

Overall Performance

(vs. average)
Accuracy

13.0%

avg: 81.3%

Net score

9.33 pts

avg: 153.08 pts

Correct

26

avg: 163

Incorrect

50

avg: 29

Total Cost

$1.42

avg: $3.09

Average response time

2.3s

avg: 17.7s

Output Tokens

1.1M

avg: 414K

Reasoning Tokens

0

avg: 296K

Average confidence

32.9%

avg: 95.7%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
2
Accuracy
33.3%
Average
90.8%
Anesthesiology and Resuscitation
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
87.7%
Cardiology
Correct
3
Incorrect
5
Unanswered
13
Accuracy
14.3%
Average
80.4%
Dermatology
Correct
4
Incorrect
2
Unanswered
8
Accuracy
28.6%
Average
81.0%
Endocrinology and Nutrition
Correct
4
Incorrect
3
Unanswered
12
Accuracy
21.1%
Average
85.1%
ENT
Correct
0
Incorrect
2
Unanswered
5
Accuracy
0.0%
Average
75.1%
Epidemiology
Correct
1
Incorrect
2
Unanswered
5
Accuracy
12.5%
Average
89.7%
Gastroenterology
Correct
2
Incorrect
3
Unanswered
17
Accuracy
9.1%
Average
71.5%
Genetics
Correct
3
Incorrect
1
Unanswered
3
Accuracy
42.9%
Average
87.1%
Geriatrics
Correct
3
Incorrect
4
Unanswered
3
Accuracy
30.0%
Average
87.7%
Gynecology and Obstetrics
Correct
2
Incorrect
3
Unanswered
9
Accuracy
14.3%
Average
82.0%
Health Planning and Management
Correct
0
Incorrect
1
Unanswered
1
Accuracy
0.0%
Average
75.1%
Hematology
Correct
3
Incorrect
4
Unanswered
6
Accuracy
23.1%
Average
82.4%
Immunology
Correct
1
Incorrect
2
Unanswered
5
Accuracy
12.5%
Average
89.7%
Infectious Diseases
Correct
2
Incorrect
4
Unanswered
17
Accuracy
8.7%
Average
82.5%
Legal Medicine and Bioethics
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
91.8%
Medical Oncology
Correct
3
Incorrect
3
Unanswered
15
Accuracy
14.3%
Average
80.9%
Nephrology
Correct
3
Incorrect
3
Unanswered
7
Accuracy
23.1%
Average
81.8%
Neurology
Correct
3
Incorrect
5
Unanswered
14
Accuracy
13.6%
Average
84.5%
Ophthalmology
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
81.3%
Palliative Care
Correct
0
Incorrect
2
Unanswered
2
Accuracy
0.0%
Average
88.6%
Pediatrics
Correct
3
Incorrect
6
Unanswered
8
Accuracy
17.6%
Average
82.9%
Pharmacology
Correct
2
Incorrect
7
Unanswered
14
Accuracy
8.7%
Average
85.8%
Psychiatry
Correct
1
Incorrect
5
Unanswered
4
Accuracy
10.0%
Average
90.0%
Pulmonology
Correct
2
Incorrect
2
Unanswered
15
Accuracy
10.5%
Average
81.6%
Radiology-Emergency
Correct
0
Incorrect
4
Unanswered
10
Accuracy
0.0%
Average
66.0%
Rheumatology
Correct
2
Incorrect
4
Unanswered
8
Accuracy
14.3%
Average
82.4%
Statistics
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
91.6%
Traumatology
Correct
1
Incorrect
5
Unanswered
9
Accuracy
6.7%
Average
75.4%
Urology
Correct
0
Incorrect
0
Unanswered
6
Accuracy
0.0%
Average
79.0%

Question Type Breakdown

Anatomy
Correct
0
Incorrect
3
Unanswered
3
Accuracy
0.0%
Average
81.1%
Biostatistics
Correct
1
Incorrect
2
Unanswered
2
Accuracy
20.0%
Average
91.3%
Diagnosis
Correct
14
Incorrect
18
Unanswered
41
Accuracy
19.2%
Average
80.0%
Epidemiology
Correct
1
Incorrect
3
Unanswered
8
Accuracy
8.3%
Average
82.1%
Ethics
Correct
0
Incorrect
1
Unanswered
0
Accuracy
0.0%
Average
94.0%
Interpretation
Correct
2
Incorrect
8
Unanswered
27
Accuracy
5.4%
Average
70.5%
Pathophysiology
Correct
8
Incorrect
7
Unanswered
18
Accuracy
24.2%
Average
86.1%
Pharmacology
Correct
2
Incorrect
7
Unanswered
16
Accuracy
8.0%
Average
84.7%
Prevention
Correct
2
Incorrect
4
Unanswered
6
Accuracy
16.7%
Average
90.3%
Prognosis
Correct
0
Incorrect
2
Unanswered
5
Accuracy
0.0%
Average
84.6%
Risk
Correct
1
Incorrect
1
Unanswered
11
Accuracy
7.7%
Average
84.5%
Tests
Correct
2
Incorrect
7
Unanswered
12
Accuracy
9.5%
Average
75.0%
Treatment
Correct
7
Incorrect
15
Unanswered
49
Accuracy
9.9%
Average
82.1%
#AnswerCorrectStatus
1—B
2—D
3—B
4BC
5—C
6—B
7—D
8—C
9—A
10—D
11AD
12BA
13—C
14—A
15CB
16—A
17—C
18AA
19—B
20—C
21—D
22—B
23—A
24—A
25—C
26BB
27—C
28AA
29—B
30AC
31DD
32—A
33—C
34AB
35—D
36—D
37—A
38—A
39—C
40BB
41AC
42—D
43DA
44CD
45—D
46BB
47—C
48—C
49—B
50—C
51—A
52CD
53—C
54BB
55AC
56—D
57—A
58—A
59DA
60DA
61—A
62—D
63BD
64——Annulled
65—D
66—C
67—B
68——Annulled
69—A
70CB
71—B
72—D
73—B
74—C
75—B
76—A
77DD
78AC
79AB
80—A
81CC
82AC
83—B
84AC
85—A
86DA
87AB
88AD
89BB
90—A
91AD
92—A
93—C
94—B
95DD
96CB
97—B
98—B
99DA
100—B
101BA
102BD
103BB
104—D
105AB
106AC
107—C
108—B
109BD
110AD
111—B
112BC
113——Annulled
114—D
115—D
116AA
117—D
118AD
119—A
120—C
121—A
122—B
123AD
124—D
125—B
126—D
127—A
128—B
129—D
130—C
131—C
132—D
133—A
134—C
135—A
136—D
137—A
138—C
139—A
140DC
141—B
142AC
143CA
144AD
145CC
146—C
147—C
148—A
149AC
150DD
151AA
152—A
153—C
154—B
155AD
156BC
157DC
158DD
159—D
160AB
161BB
162AB
163—B
164—B
165—A
166—C
167—A
168BB
169—C
170—A
171—D
172—B
173—A
174BB
175AA
176—C
177—C
178—B
179—C
180——Annulled
181—B
182AD
183—C
184DA
185—C
186BD
187—A
188—C
189—D
190DD
191—B
192DB
193CC
194—C
195—C
196—B
197AA
198BB
199—D
200—A
201AB
202—D
203CB
204DD
205—D
206——Annulled
207—A
208—A
209—B
210—D