MedicalBenchmark
Morph: Morph V3 Large provider

Morph V3 Large

283

#283 of 291 modelsMIR 2024

Net score

29.66 pts

Accuracy

21.5%

Correct / Incorrect

43 / 40

Total Cost

$0.28

Overall Performance

(vs. average)
Accuracy

21.5%

avg: 80.5%

Net score

29.66 pts

avg: 150.85 pts

Correct

43

avg: 161

Incorrect

40

avg: 30

Total Cost

$0.28

avg: $3.32

Average response time

2.0s

avg: 16.4s

Output Tokens

92K

avg: 427K

Reasoning Tokens

0

avg: 310K

Average confidence

41.1%

avg: 95.4%

Subject Breakdown

Allergology
Correct
2
Incorrect
0
Unanswered
1
Accuracy
66.7%
Average
90.5%
Anesthesiology and Resuscitation
Correct
0
Incorrect
0
Unanswered
4
Accuracy
0.0%
Average
87.1%
Cardiology
Correct
3
Incorrect
8
Unanswered
10
Accuracy
14.3%
Average
79.7%
Dermatology
Correct
3
Incorrect
2
Unanswered
9
Accuracy
21.4%
Average
80.2%
Endocrinology and Nutrition
Correct
2
Incorrect
3
Unanswered
14
Accuracy
10.5%
Average
84.2%
ENT
Correct
3
Incorrect
1
Unanswered
3
Accuracy
42.9%
Average
74.4%
Epidemiology
Correct
2
Incorrect
1
Unanswered
5
Accuracy
25.0%
Average
89.3%
Gastroenterology
Correct
4
Incorrect
5
Unanswered
13
Accuracy
18.2%
Average
70.5%
Genetics
Correct
2
Incorrect
1
Unanswered
4
Accuracy
28.6%
Average
86.5%
Geriatrics
Correct
4
Incorrect
0
Unanswered
6
Accuracy
40.0%
Average
86.9%
Gynecology and Obstetrics
Correct
2
Incorrect
1
Unanswered
11
Accuracy
14.3%
Average
81.2%
Health Planning and Management
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
73.2%
Hematology
Correct
2
Incorrect
3
Unanswered
8
Accuracy
15.4%
Average
81.5%
Immunology
Correct
3
Incorrect
0
Unanswered
5
Accuracy
37.5%
Average
89.1%
Infectious Diseases
Correct
6
Incorrect
2
Unanswered
15
Accuracy
26.1%
Average
81.8%
Legal Medicine and Bioethics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
91.7%
Medical Oncology
Correct
9
Incorrect
1
Unanswered
11
Accuracy
42.9%
Average
80.2%
Nephrology
Correct
2
Incorrect
5
Unanswered
6
Accuracy
15.4%
Average
80.8%
Neurology
Correct
4
Incorrect
4
Unanswered
14
Accuracy
18.2%
Average
83.7%
Ophthalmology
Correct
0
Incorrect
3
Unanswered
2
Accuracy
0.0%
Average
80.0%
Palliative Care
Correct
1
Incorrect
0
Unanswered
3
Accuracy
25.0%
Average
88.2%
Pediatrics
Correct
4
Incorrect
1
Unanswered
12
Accuracy
23.5%
Average
82.0%
Pharmacology
Correct
4
Incorrect
7
Unanswered
12
Accuracy
17.4%
Average
85.4%
Psychiatry
Correct
2
Incorrect
2
Unanswered
6
Accuracy
20.0%
Average
89.5%
Pulmonology
Correct
7
Incorrect
3
Unanswered
9
Accuracy
36.8%
Average
80.6%
Radiology-Emergency
Correct
3
Incorrect
2
Unanswered
9
Accuracy
21.4%
Average
64.9%
Rheumatology
Correct
5
Incorrect
1
Unanswered
8
Accuracy
35.7%
Average
81.4%
Statistics
Correct
0
Incorrect
1
Unanswered
2
Accuracy
0.0%
Average
91.1%
Traumatology
Correct
3
Incorrect
1
Unanswered
11
Accuracy
20.0%
Average
74.5%
Urology
Correct
1
Incorrect
2
Unanswered
3
Accuracy
16.7%
Average
78.2%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
0
Unanswered
4
Accuracy
33.3%
Average
79.8%
Biostatistics
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
90.7%
Diagnosis
Correct
14
Incorrect
16
Unanswered
43
Accuracy
19.2%
Average
79.2%
Epidemiology
Correct
4
Incorrect
1
Unanswered
7
Accuracy
33.3%
Average
81.2%
Ethics
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
94.5%
Interpretation
Correct
4
Incorrect
12
Unanswered
21
Accuracy
10.8%
Average
69.6%
Pathophysiology
Correct
8
Incorrect
4
Unanswered
21
Accuracy
24.2%
Average
85.4%
Pharmacology
Correct
3
Incorrect
7
Unanswered
15
Accuracy
12.0%
Average
84.0%
Prevention
Correct
5
Incorrect
0
Unanswered
7
Accuracy
41.7%
Average
89.8%
Prognosis
Correct
2
Incorrect
2
Unanswered
3
Accuracy
28.6%
Average
83.9%
Risk
Correct
5
Incorrect
0
Unanswered
8
Accuracy
38.5%
Average
83.6%
Tests
Correct
5
Incorrect
7
Unanswered
9
Accuracy
23.8%
Average
73.9%
Treatment
Correct
14
Incorrect
16
Unanswered
41
Accuracy
19.7%
Average
81.3%
#AnswerCorrectStatus
1B
2CD
3B
4C
5C
6DB
7D
8CC
9A
10D
11D
12BA
13DC
14A
15B
16DA
17AC
18CA
19B
20C
21D
22B
23DA
24A
25C
26B
27AC
28A
29BB
30C
31D
32BA
33C
34B
35D
36D
37AA
38A
39CC
40B
41CC
42DD
43A
44D
45BD
46B
47CC
48AC
49B
50C
51A
52AD
53C
54B
55CC
56DD
57AA
58A
59CA
60A
61BA
62DD
63D
64CAnnulled
65D
66C
67BB
68Annulled
69A
70B
71DB
72D
73B
74C
75BB
76A
77D
78CC
79B
80AA
81C
82DC
83B
84C
85AA
86AA
87B
88DD
89B
90A
91D
92CA
93C
94B
95D
96B
97B
98B
99A
100B
101A
102D
103B
104D
105BB
106BC
107C
108B
109DD
110D
111AB
112C
113Annulled
114DD
115D
116CA
117DD
118D
119A
120AC
121A
122DB
123AD
124DD
125B
126D
127A
128AB
129DD
130CC
131BC
132CD
133A
134BC
135A
136AD
137A
138C
139A
140C
141B
142DC
143BA
144AD
145C
146C
147CC
148BA
149BC
150D
151AA
152A
153DC
154B
155D
156CC
157C
158DD
159DD
160B
161B
162B
163BB
164B
165CA
166C
167AA
168CB
169C
170A
171DD
172B
173AA
174DB
175A
176C
177C
178B
179CC
180Annulled
181BB
182DD
183C
184A
185C
186D
187A
188C
189CD
190D
191BB
192BB
193CC
194DC
195CC
196BB
197A
198B
199D
200A
201B
202DD
203B
204D
205D
206CAnnulled
207AA
208AA
209B
210D