MedicalBenchmark
Qwen: Qwen2.5-VL 7B Instruct provider

Qwen2.5-VL 7B Instruct

260

#260 of 290 modelsMIR 2025

Net score

59.66 pts

Accuracy

42.0%

Correct / Incorrect

84 / 73

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

42.0%

avg: 75.9%

Net score

59.66 pts

avg: 138.99 pts

Correct

84

avg: 152

Incorrect

73

avg: 38

Total Cost

$0.04

avg: $3.59

Average response time

6.2s

avg: 18.1s

Output Tokens

107K

avg: 443K

Reasoning Tokens

0

avg: 320K

Average confidence

76.8%

avg: 94.7%

Subject Breakdown

Allergology
Correct
2
Incorrect
0
Unanswered
2
Accuracy
50.0%
Average
86.9%
Anesthesiology and Resuscitation
Correct
1
Incorrect
4
Unanswered
1
Accuracy
16.7%
Average
81.3%
Cardiology
Correct
7
Incorrect
10
Unanswered
5
Accuracy
31.8%
Average
77.4%
Dermatology
Correct
3
Incorrect
7
Unanswered
3
Accuracy
23.1%
Average
62.8%
Endocrinology and Nutrition
Correct
7
Incorrect
4
Unanswered
5
Accuracy
43.8%
Average
82.5%
ENT
Correct
4
Incorrect
4
Unanswered
0
Accuracy
50.0%
Average
73.8%
Epidemiology
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
67.1%
Gastroenterology
Correct
7
Incorrect
9
Unanswered
5
Accuracy
33.3%
Average
72.9%
Genetics
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
68.2%
Geriatrics
Correct
4
Incorrect
2
Unanswered
5
Accuracy
36.4%
Average
71.2%
Gynecology and Obstetrics
Correct
13
Incorrect
2
Unanswered
4
Accuracy
68.4%
Average
85.9%
Health Planning and Management
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
81.6%
Hematology
Correct
5
Incorrect
3
Unanswered
3
Accuracy
45.5%
Average
81.8%
Immunology
Correct
5
Incorrect
2
Unanswered
2
Accuracy
55.6%
Average
82.5%
Infectious Diseases
Correct
6
Incorrect
14
Unanswered
8
Accuracy
21.4%
Average
71.1%
Legal Medicine and Bioethics
Correct
1
Incorrect
2
Unanswered
2
Accuracy
20.0%
Average
67.2%
Medical Oncology
Correct
13
Incorrect
6
Unanswered
6
Accuracy
52.0%
Average
86.3%
Nephrology
Correct
6
Incorrect
4
Unanswered
5
Accuracy
40.0%
Average
78.2%
Neurology
Correct
10
Incorrect
8
Unanswered
2
Accuracy
50.0%
Average
76.2%
Ophthalmology
Correct
1
Incorrect
3
Unanswered
1
Accuracy
20.0%
Average
72.6%
Palliative Care
Correct
0
Incorrect
3
Unanswered
1
Accuracy
0.0%
Average
77.2%
Pediatrics
Correct
11
Incorrect
9
Unanswered
5
Accuracy
44.0%
Average
72.7%
Pharmacology
Correct
3
Incorrect
8
Unanswered
6
Accuracy
17.6%
Average
73.1%
Psychiatry
Correct
4
Incorrect
2
Unanswered
2
Accuracy
50.0%
Average
82.0%
Pulmonology
Correct
4
Incorrect
8
Unanswered
2
Accuracy
28.6%
Average
73.0%
Radiology-Emergency
Correct
7
Incorrect
3
Unanswered
4
Accuracy
50.0%
Average
67.9%
Rheumatology
Correct
6
Incorrect
3
Unanswered
5
Accuracy
42.9%
Average
74.6%
Statistics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
74.9%
Traumatology
Correct
12
Incorrect
5
Unanswered
1
Accuracy
66.7%
Average
78.2%
Urology
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
79.5%

Question Type Breakdown

Anatomy
Correct
4
Incorrect
3
Unanswered
0
Accuracy
57.1%
Average
77.1%
Biostatistics
Correct
1
Incorrect
3
Unanswered
0
Accuracy
25.0%
Average
78.4%
Diagnosis
Correct
42
Incorrect
35
Unanswered
12
Accuracy
47.2%
Average
77.9%
Epidemiology
Correct
1
Incorrect
3
Unanswered
1
Accuracy
20.0%
Average
75.0%
Ethics
Correct
0
Incorrect
1
Unanswered
2
Accuracy
0.0%
Average
72.0%
Interpretation
Correct
16
Incorrect
19
Unanswered
7
Accuracy
38.1%
Average
69.3%
Legal
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
63.6%
Pathophysiology
Correct
12
Incorrect
8
Unanswered
7
Accuracy
44.4%
Average
72.6%
Pharmacology
Correct
2
Incorrect
7
Unanswered
4
Accuracy
15.4%
Average
82.4%
Prevention
Correct
5
Incorrect
2
Unanswered
5
Accuracy
41.7%
Average
74.5%
Prognosis
Correct
2
Incorrect
3
Unanswered
1
Accuracy
33.3%
Average
77.8%
Risk
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
84.3%
Tests
Correct
14
Incorrect
5
Unanswered
7
Accuracy
53.8%
Average
76.3%
Treatment
Correct
32
Incorrect
29
Unanswered
21
Accuracy
39.0%
Average
75.2%
#AnswerCorrectStatus
1BB
2BA
3CC
4CB
5AA
6CC
7CC
8AA
9CA
10AD
11DD
12DD
13DB
14D
15D
16CB
17AB
18CA
19CC
20AA
21DB
22D
23AC
24BD
25C
26AAnnulled
27AC
28Annulled
29DD
30BB
31AD
32AA
33DD
34DD
35BB
36BD
37CC
38C
39DD
40CA
41CD
42BC
43BB
44DD
45DD
46CA
47A
48AA
49DD
50BB
51CC
52B
53CD
54DB
55DA
56BAnnulled
57CC
58BB
59DD
60BA
61AA
62DD
63BB
64DD
65BA
66AA
67B
68B
69AB
70A
71CD
72CA
73DD
74CC
75A
76BB
77BB
78BB
79C
80BC
81AC
82DD
83CB
84D
85DC
86BC
87CA
88AD
89BB
90AA
91DB
92C
93BB
94CC
95A
96CC
97D
98DC
99BA
100CC
101DB
102CD
103DA
104CC
105A
106C
107BB
108DD
109AB
110CC
111CA
112CC
113BB
114BD
115D
116C
117AA
118DD
119AC
120DB
121CD
122CC
123CC
124DC
125CD
126D
127BB
128D
129BA
130D
131BD
132AA
133B
134CC
135DB
136CC
137AA
138DD
139D
140BB
141AA
142BA
143BB
144BB
145DD
146CC
147B
148BA
149A
150AA
151A
152DA
153B
154BB
155B
156C
157A
158DC
159CC
160A
161CA
162B
163CD
164BC
165AA
166B
167CC
168BD
169CB
170B
171C
172A
173BA
174BB
175B
176CC
177C
178BA
179CD
180AA
181DB
182C
183DB
184BB
185DB
186Annulled
187CC
188CD
189CD
190AA
191B
192A
193CC
194AA
195AA
196AA
197BB
198BC
199BD
200CC
201CB
202DA
203D
204C
205B
206AD
207AA
208AC
209CC
210BB