MedicalBenchmark
Morph: Morph V3 Fast provider

Morph V3 Fast

288

#288 of 291 modelsMIR 2024

Net score

9.33 pts

Accuracy

13.0%

Correct / Incorrect

26 / 50

Total Cost

$1.42

Overall Performance

(vs. average)
Accuracy

13.0%

avg: 80.5%

Net score

9.33 pts

avg: 150.85 pts

Correct

26

avg: 161

Incorrect

50

avg: 30

Total Cost

$1.42

avg: $3.32

Average response time

2.3s

avg: 16.4s

Output Tokens

1.1M

avg: 427K

Reasoning Tokens

0

avg: 310K

Average confidence

32.9%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
2
Accuracy
33.3%
Average
90.5%
Anesthesiology and Resuscitation
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
87.1%
Cardiology
Correct
3
Incorrect
5
Unanswered
13
Accuracy
14.3%
Average
79.7%
Dermatology
Correct
4
Incorrect
2
Unanswered
8
Accuracy
28.6%
Average
80.2%
Endocrinology and Nutrition
Correct
4
Incorrect
3
Unanswered
12
Accuracy
21.1%
Average
84.2%
ENT
Correct
0
Incorrect
2
Unanswered
5
Accuracy
0.0%
Average
74.4%
Epidemiology
Correct
1
Incorrect
2
Unanswered
5
Accuracy
12.5%
Average
89.3%
Gastroenterology
Correct
2
Incorrect
3
Unanswered
17
Accuracy
9.1%
Average
70.5%
Genetics
Correct
3
Incorrect
1
Unanswered
3
Accuracy
42.9%
Average
86.5%
Geriatrics
Correct
3
Incorrect
4
Unanswered
3
Accuracy
30.0%
Average
86.9%
Gynecology and Obstetrics
Correct
2
Incorrect
3
Unanswered
9
Accuracy
14.3%
Average
81.2%
Health Planning and Management
Correct
0
Incorrect
1
Unanswered
1
Accuracy
0.0%
Average
73.2%
Hematology
Correct
3
Incorrect
4
Unanswered
6
Accuracy
23.1%
Average
81.5%
Immunology
Correct
1
Incorrect
2
Unanswered
5
Accuracy
12.5%
Average
89.1%
Infectious Diseases
Correct
2
Incorrect
4
Unanswered
17
Accuracy
8.7%
Average
81.8%
Legal Medicine and Bioethics
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
91.7%
Medical Oncology
Correct
3
Incorrect
3
Unanswered
15
Accuracy
14.3%
Average
80.2%
Nephrology
Correct
3
Incorrect
3
Unanswered
7
Accuracy
23.1%
Average
80.8%
Neurology
Correct
3
Incorrect
5
Unanswered
14
Accuracy
13.6%
Average
83.7%
Ophthalmology
Correct
0
Incorrect
2
Unanswered
3
Accuracy
0.0%
Average
80.0%
Palliative Care
Correct
0
Incorrect
2
Unanswered
2
Accuracy
0.0%
Average
88.2%
Pediatrics
Correct
3
Incorrect
6
Unanswered
8
Accuracy
17.6%
Average
82.0%
Pharmacology
Correct
2
Incorrect
7
Unanswered
14
Accuracy
8.7%
Average
85.4%
Psychiatry
Correct
1
Incorrect
5
Unanswered
4
Accuracy
10.0%
Average
89.5%
Pulmonology
Correct
2
Incorrect
2
Unanswered
15
Accuracy
10.5%
Average
80.6%
Radiology-Emergency
Correct
0
Incorrect
4
Unanswered
10
Accuracy
0.0%
Average
64.9%
Rheumatology
Correct
2
Incorrect
4
Unanswered
8
Accuracy
14.3%
Average
81.4%
Statistics
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
91.1%
Traumatology
Correct
1
Incorrect
5
Unanswered
9
Accuracy
6.7%
Average
74.5%
Urology
Correct
0
Incorrect
0
Unanswered
6
Accuracy
0.0%
Average
78.2%

Question Type Breakdown

Anatomy
Correct
0
Incorrect
3
Unanswered
3
Accuracy
0.0%
Average
79.8%
Biostatistics
Correct
1
Incorrect
2
Unanswered
2
Accuracy
20.0%
Average
90.7%
Diagnosis
Correct
14
Incorrect
18
Unanswered
41
Accuracy
19.2%
Average
79.2%
Epidemiology
Correct
1
Incorrect
3
Unanswered
8
Accuracy
8.3%
Average
81.2%
Ethics
Correct
0
Incorrect
1
Unanswered
0
Accuracy
0.0%
Average
94.5%
Interpretation
Correct
2
Incorrect
8
Unanswered
27
Accuracy
5.4%
Average
69.6%
Pathophysiology
Correct
8
Incorrect
7
Unanswered
18
Accuracy
24.2%
Average
85.4%
Pharmacology
Correct
2
Incorrect
7
Unanswered
16
Accuracy
8.0%
Average
84.0%
Prevention
Correct
2
Incorrect
4
Unanswered
6
Accuracy
16.7%
Average
89.8%
Prognosis
Correct
0
Incorrect
2
Unanswered
5
Accuracy
0.0%
Average
83.9%
Risk
Correct
1
Incorrect
1
Unanswered
11
Accuracy
7.7%
Average
83.6%
Tests
Correct
2
Incorrect
7
Unanswered
12
Accuracy
9.5%
Average
73.9%
Treatment
Correct
7
Incorrect
15
Unanswered
49
Accuracy
9.9%
Average
81.3%
#AnswerCorrectStatus
1B
2D
3B
4BC
5C
6B
7D
8C
9A
10D
11AD
12BA
13C
14A
15CB
16A
17C
18AA
19B
20C
21D
22B
23A
24A
25C
26BB
27C
28AA
29B
30AC
31DD
32A
33C
34AB
35D
36D
37A
38A
39C
40BB
41AC
42D
43DA
44CD
45D
46BB
47C
48C
49B
50C
51A
52CD
53C
54BB
55AC
56D
57A
58A
59DA
60DA
61A
62D
63BD
64Annulled
65D
66C
67B
68Annulled
69A
70CB
71B
72D
73B
74C
75B
76A
77DD
78AC
79AB
80A
81CC
82AC
83B
84AC
85A
86DA
87AB
88AD
89BB
90A
91AD
92A
93C
94B
95DD
96CB
97B
98B
99DA
100B
101BA
102BD
103BB
104D
105AB
106AC
107C
108B
109BD
110AD
111B
112BC
113Annulled
114D
115D
116AA
117D
118AD
119A
120C
121A
122B
123AD
124D
125B
126D
127A
128B
129D
130C
131C
132D
133A
134C
135A
136D
137A
138C
139A
140DC
141B
142AC
143CA
144AD
145CC
146C
147C
148A
149AC
150DD
151AA
152A
153C
154B
155AD
156BC
157DC
158DD
159D
160AB
161BB
162AB
163B
164B
165A
166C
167A
168BB
169C
170A
171D
172B
173A
174BB
175AA
176C
177C
178B
179C
180Annulled
181B
182AD
183C
184DA
185C
186BD
187A
188C
189D
190DD
191B
192DB
193CC
194C
195C
196B
197AA
198BB
199D
200A
201AB
202D
203CB
204DD
205D
206Annulled
207A
208A
209B
210D