MedicalBenchmark
Qwen: Qwen2.5-VL 7B Instruct provider

Qwen2.5-VL 7B Instruct

267

#267 of 290 modelsMIR 2026

Net score

67.66 pts

Accuracy

44.0%

Correct / Incorrect

88 / 61

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

44.0%

avg: 81.6%

Net score

67.66 pts

avg: 154.00 pts

Correct

88

avg: 163

Incorrect

61

avg: 28

Total Cost

$0.04

avg: $3.33

Average response time

5.9s

avg: 16.2s

Output Tokens

99K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

72.2%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
2
Incorrect
4
Unanswered
1
Accuracy
28.6%
Average
69.6%
Cardiology
Correct
6
Incorrect
10
Unanswered
9
Accuracy
24.0%
Average
77.3%
Dermatology
Correct
3
Incorrect
3
Unanswered
5
Accuracy
27.3%
Average
72.3%
Endocrinology and Nutrition
Correct
4
Incorrect
6
Unanswered
5
Accuracy
26.7%
Average
84.0%
ENT
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
84.7%
Epidemiology
Correct
2
Incorrect
1
Unanswered
4
Accuracy
28.6%
Average
80.2%
Gastroenterology
Correct
16
Incorrect
6
Unanswered
8
Accuracy
53.3%
Average
79.3%
Genetics
Correct
3
Incorrect
4
Unanswered
4
Accuracy
27.3%
Average
78.7%
Geriatrics
Correct
9
Incorrect
3
Unanswered
1
Accuracy
69.2%
Average
83.0%
Gynecology and Obstetrics
Correct
7
Incorrect
4
Unanswered
1
Accuracy
58.3%
Average
84.3%
Health Planning and Management
Correct
5
Incorrect
3
Unanswered
2
Accuracy
50.0%
Average
78.4%
Hematology
Correct
3
Incorrect
2
Unanswered
4
Accuracy
33.3%
Average
76.6%
Immunology
Correct
4
Incorrect
0
Unanswered
2
Accuracy
66.7%
Average
91.4%
Infectious Diseases
Correct
5
Incorrect
1
Unanswered
8
Accuracy
35.7%
Average
77.9%
Legal Medicine and Bioethics
Correct
7
Incorrect
2
Unanswered
2
Accuracy
63.6%
Average
82.9%
Medical Oncology
Correct
13
Incorrect
6
Unanswered
4
Accuracy
56.5%
Average
83.0%
Nephrology
Correct
4
Incorrect
4
Unanswered
2
Accuracy
40.0%
Average
85.1%
Neurology
Correct
6
Incorrect
3
Unanswered
4
Accuracy
46.2%
Average
88.6%
Ophthalmology
Correct
2
Incorrect
2
Unanswered
1
Accuracy
40.0%
Average
83.7%
Palliative Care
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
80.2%
Pediatrics
Correct
7
Incorrect
8
Unanswered
7
Accuracy
31.8%
Average
87.6%
Pharmacology
Correct
4
Incorrect
5
Unanswered
2
Accuracy
36.4%
Average
78.6%
Psychiatry
Correct
5
Incorrect
1
Unanswered
2
Accuracy
62.5%
Average
87.9%
Pulmonology
Correct
8
Incorrect
7
Unanswered
1
Accuracy
50.0%
Average
82.8%
Radiology-Emergency
Correct
3
Incorrect
10
Unanswered
0
Accuracy
23.1%
Average
67.7%
Rheumatology
Correct
6
Incorrect
1
Unanswered
4
Accuracy
54.5%
Average
88.4%
Statistics
Correct
0
Incorrect
0
Unanswered
2
Accuracy
0.0%
Average
83.8%
Traumatology
Correct
3
Incorrect
8
Unanswered
0
Accuracy
27.3%
Average
65.2%
Urology
Correct
5
Incorrect
2
Unanswered
1
Accuracy
62.5%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
0
Incorrect
0
Unanswered
2
Accuracy
0.0%
Average
83.8%
Diagnosis
Correct
37
Incorrect
22
Unanswered
22
Accuracy
45.7%
Average
82.2%
Epidemiology
Correct
4
Incorrect
2
Unanswered
3
Accuracy
44.4%
Average
88.7%
Ethics
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
11
Incorrect
13
Unanswered
13
Accuracy
29.7%
Average
72.0%
Legal
Correct
7
Incorrect
2
Unanswered
0
Accuracy
77.8%
Average
82.4%
Pathophysiology
Correct
12
Incorrect
9
Unanswered
5
Accuracy
46.2%
Average
84.3%
Pharmacology
Correct
7
Incorrect
4
Unanswered
4
Accuracy
46.7%
Average
82.3%
Prevention
Correct
5
Incorrect
6
Unanswered
5
Accuracy
31.3%
Average
80.6%
Prognosis
Correct
3
Incorrect
1
Unanswered
1
Accuracy
60.0%
Average
93.2%
Risk
Correct
6
Incorrect
4
Unanswered
5
Accuracy
40.0%
Average
84.3%
Tests
Correct
15
Incorrect
9
Unanswered
9
Accuracy
45.5%
Average
80.3%
Treatment
Correct
29
Incorrect
27
Unanswered
16
Accuracy
40.3%
Average
80.1%
#AnswerCorrectStatus
1AA
2BB
3AD
4DD
5BB
6C
7AB
8AD
9DD
10A
11B
12CA
13Annulled
14BC
15A
16CC
17C
18BD
19B
20B
21CB
22AC
23DB
24AA
25CC
26A
27DB
28DD
29A
30DD
31C
32C
33B
34B
35C
36CD
37D
38AA
39C
40A
41DD
42A
43BB
44B
45AB
46BB
47BD
48CC
49CC
50Annulled
51A
52BC
53CC
54AC
55AA
56CA
57AA
58A
59B
60BB
61CC
62BB
63AB
64AAnnulled
65DC
66DC
67CC
68AA
69CB
70BB
71AB
72BB
73BB
74A
75CC
76CC
77CA
78AD
79AA
80AD
81CC
82D
83CB
84CA
85DD
86AA
87BB
88B
89BB
90BC
91BA
92BC
93DD
94BC
95CC
96AB
97BB
98AA
99B
100CC
101CC
102AA
103C
104C
105C
106B
107DC
108BA
109CC
110AC
111BB
112AC
113CC
114CD
115BB
116D
117CC
118AB
119A
120CA
121AC
122AB
123B
124CB
125CC
126CB
127CC
128BB
129CC
130CC
131BB
132AB
133C
134BB
135CC
136BB
137CD
138B
139BAnnulled
140D
141AA
142BAnnulled
143A
144D
145BC
146DC
147BB
148CC
149BB
150B
151BB
152AC
153BC
154D
155BB
156BA
157DD
158BB
159CC
160AA
161Annulled
162AA
163CC
164C
165A
166AA
167DD
168CC
169DB
170AB
171AA
172CB
173D
174C
175BB
176A
177CD
178DD
179B
180CC
181B
182CC
183D
184DD
185DB
186D
187DD
188BC
189DC
190DB
191DD
192D
193CC
194C
195DD
196AA
197DC
198BA
199CB
200DD
201CC
202BA
203AA
204CC
205BB
206CC
207A
208DAnnulled
209B
210C