MedicalBenchmark
Qwen: Qwen2.5 7B Instruct provider

Qwen2.5 7B Instruct

248

#248 of 290 modelsMIR 2026

Net score

107.00 pts

Accuracy

63.5%

Correct / Incorrect

127 / 60

Total Cost

$0.02

Overall Performance

(vs. average)
Accuracy

63.5%

avg: 81.6%

Net score

107.00 pts

avg: 154.00 pts

Correct

127

avg: 163

Incorrect

60

avg: 28

Total Cost

$0.02

avg: $3.33

Average response time

9.9s

avg: 16.2s

Output Tokens

114K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

90.3%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
69.6%
Cardiology
Correct
12
Incorrect
11
Unanswered
2
Accuracy
48.0%
Average
77.3%
Dermatology
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
72.3%
Endocrinology and Nutrition
Correct
10
Incorrect
4
Unanswered
1
Accuracy
66.7%
Average
84.0%
ENT
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
84.7%
Epidemiology
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
80.2%
Gastroenterology
Correct
21
Incorrect
9
Unanswered
0
Accuracy
70.0%
Average
79.3%
Genetics
Correct
7
Incorrect
3
Unanswered
1
Accuracy
63.6%
Average
78.7%
Geriatrics
Correct
9
Incorrect
1
Unanswered
3
Accuracy
69.2%
Average
83.0%
Gynecology and Obstetrics
Correct
7
Incorrect
4
Unanswered
1
Accuracy
58.3%
Average
84.3%
Health Planning and Management
Correct
6
Incorrect
2
Unanswered
2
Accuracy
60.0%
Average
78.4%
Hematology
Correct
5
Incorrect
4
Unanswered
0
Accuracy
55.6%
Average
76.6%
Immunology
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
91.4%
Infectious Diseases
Correct
8
Incorrect
6
Unanswered
0
Accuracy
57.1%
Average
77.9%
Legal Medicine and Bioethics
Correct
8
Incorrect
1
Unanswered
2
Accuracy
72.7%
Average
82.9%
Medical Oncology
Correct
14
Incorrect
8
Unanswered
1
Accuracy
60.9%
Average
83.0%
Nephrology
Correct
5
Incorrect
5
Unanswered
0
Accuracy
50.0%
Average
85.1%
Neurology
Correct
9
Incorrect
3
Unanswered
1
Accuracy
69.2%
Average
88.6%
Ophthalmology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
83.7%
Palliative Care
Correct
2
Incorrect
3
Unanswered
1
Accuracy
33.3%
Average
80.2%
Pediatrics
Correct
17
Incorrect
5
Unanswered
0
Accuracy
77.3%
Average
87.6%
Pharmacology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
78.6%
Psychiatry
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
87.9%
Pulmonology
Correct
12
Incorrect
4
Unanswered
0
Accuracy
75.0%
Average
82.8%
Radiology-Emergency
Correct
7
Incorrect
5
Unanswered
1
Accuracy
53.8%
Average
67.7%
Rheumatology
Correct
10
Incorrect
1
Unanswered
0
Accuracy
90.9%
Average
88.4%
Statistics
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
83.8%
Traumatology
Correct
5
Incorrect
4
Unanswered
2
Accuracy
45.5%
Average
65.2%
Urology
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
1
Unanswered
1
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
83.8%
Diagnosis
Correct
52
Incorrect
26
Unanswered
3
Accuracy
64.2%
Average
82.2%
Epidemiology
Correct
6
Incorrect
2
Unanswered
1
Accuracy
66.7%
Average
88.7%
Ethics
Correct
5
Incorrect
0
Unanswered
1
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
22
Incorrect
14
Unanswered
1
Accuracy
59.5%
Average
72.0%
Legal
Correct
6
Incorrect
1
Unanswered
2
Accuracy
66.7%
Average
82.4%
Pathophysiology
Correct
17
Incorrect
8
Unanswered
1
Accuracy
65.4%
Average
84.3%
Pharmacology
Correct
8
Incorrect
5
Unanswered
2
Accuracy
53.3%
Average
82.3%
Prevention
Correct
9
Incorrect
6
Unanswered
1
Accuracy
56.3%
Average
80.6%
Prognosis
Correct
4
Incorrect
0
Unanswered
1
Accuracy
80.0%
Average
93.2%
Risk
Correct
9
Incorrect
4
Unanswered
2
Accuracy
60.0%
Average
84.3%
Tests
Correct
24
Incorrect
8
Unanswered
1
Accuracy
72.7%
Average
80.3%
Treatment
Correct
42
Incorrect
25
Unanswered
5
Accuracy
58.3%
Average
80.1%
#AnswerCorrectStatus
1BA
2BB
3AD
4DD
5BB
6C
7CB
8BD
9CD
10AA
11BB
12CA
13Annulled
14BC
15DA
16CC
17CC
18BD
19BB
20CB
21BB
22CC
23BB
24AA
25CC
26AA
27B
28DD
29AA
30BD
31DC
32CC
33BB
34BB
35CC
36CD
37DD
38DA
39AC
40DA
41DD
42AA
43BB
44BB
45BB
46BB
47DD
48CC
49CC
50Annulled
51AA
52CC
53CC
54BC
55BA
56BA
57A
58CA
59BB
60BB
61CC
62BB
63DB
64AAnnulled
65CC
66DC
67CC
68AA
69CB
70BB
71AB
72BB
73B
74AA
75CC
76CC
77CA
78AD
79AA
80DD
81CC
82CD
83B
84CA
85DD
86AA
87BB
88BB
89BB
90CC
91AA
92BC
93DD
94AC
95CC
96AB
97DB
98AA
99BB
100CC
101CC
102A
103CC
104CC
105CC
106AB
107DC
108AA
109C
110AC
111BB
112C
113CC
114DD
115CB
116AD
117CC
118AB
119A
120AA
121BC
122BB
123BB
124CB
125CC
126BB
127CC
128CB
129BC
130CC
131BB
132AB
133CC
134BB
135CC
136BB
137BD
138BB
139BAnnulled
140CD
141AA
142BAnnulled
143CA
144DD
145C
146C
147BB
148AC
149BB
150BB
151BB
152CC
153CC
154DD
155BB
156BA
157DD
158BB
159CC
160AA
161AAnnulled
162AA
163CC
164CC
165A
166AA
167DD
168CC
169AB
170BB
171AA
172AB
173DD
174BC
175BB
176AA
177AD
178DD
179BB
180CC
181DB
182CC
183DD
184DD
185BB
186DD
187DD
188BC
189CC
190DB
191DD
192BD
193CC
194BC
195DD
196AA
197BC
198AA
199B
200DD
201CC
202BA
203AA
204BC
205BB
206CC
207A
208AAnnulled
209B
210CC