MedicalBenchmark
Mancer: Weaver (alpha) provider

Weaver (alpha)

281

#281 of 290 modelsMIR 2026

Net score

44.66 pts

Accuracy

36.0%

Correct / Incorrect

72 / 82

Total Cost

$0.22

Overall Performance

(vs. average)
Accuracy

36.0%

avg: 81.6%

Net score

44.66 pts

avg: 154.00 pts

Correct

72

avg: 163

Incorrect

82

avg: 28

Total Cost

$0.22

avg: $3.33

Average response time

13.2s

avg: 16.2s

Output Tokens

117K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

76.2%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
2
Incorrect
4
Unanswered
1
Accuracy
28.6%
Average
69.6%
Cardiology
Correct
4
Incorrect
13
Unanswered
8
Accuracy
16.0%
Average
77.3%
Dermatology
Correct
3
Incorrect
3
Unanswered
5
Accuracy
27.3%
Average
72.3%
Endocrinology and Nutrition
Correct
8
Incorrect
4
Unanswered
3
Accuracy
53.3%
Average
84.0%
ENT
Correct
2
Incorrect
3
Unanswered
3
Accuracy
25.0%
Average
84.7%
Epidemiology
Correct
5
Incorrect
1
Unanswered
1
Accuracy
71.4%
Average
80.2%
Gastroenterology
Correct
12
Incorrect
12
Unanswered
6
Accuracy
40.0%
Average
79.3%
Genetics
Correct
4
Incorrect
5
Unanswered
2
Accuracy
36.4%
Average
78.7%
Geriatrics
Correct
6
Incorrect
4
Unanswered
3
Accuracy
46.2%
Average
83.0%
Gynecology and Obstetrics
Correct
4
Incorrect
6
Unanswered
2
Accuracy
33.3%
Average
84.3%
Health Planning and Management
Correct
6
Incorrect
3
Unanswered
1
Accuracy
60.0%
Average
78.4%
Hematology
Correct
3
Incorrect
5
Unanswered
1
Accuracy
33.3%
Average
76.6%
Immunology
Correct
0
Incorrect
3
Unanswered
3
Accuracy
0.0%
Average
91.4%
Infectious Diseases
Correct
7
Incorrect
6
Unanswered
1
Accuracy
50.0%
Average
77.9%
Legal Medicine and Bioethics
Correct
6
Incorrect
3
Unanswered
2
Accuracy
54.5%
Average
82.9%
Medical Oncology
Correct
7
Incorrect
10
Unanswered
6
Accuracy
30.4%
Average
83.0%
Nephrology
Correct
3
Incorrect
2
Unanswered
5
Accuracy
30.0%
Average
85.1%
Neurology
Correct
8
Incorrect
5
Unanswered
0
Accuracy
61.5%
Average
88.6%
Ophthalmology
Correct
0
Incorrect
1
Unanswered
4
Accuracy
0.0%
Average
83.7%
Palliative Care
Correct
1
Incorrect
4
Unanswered
1
Accuracy
16.7%
Average
80.2%
Pediatrics
Correct
8
Incorrect
10
Unanswered
4
Accuracy
36.4%
Average
87.6%
Pharmacology
Correct
2
Incorrect
4
Unanswered
5
Accuracy
18.2%
Average
78.6%
Psychiatry
Correct
2
Incorrect
5
Unanswered
1
Accuracy
25.0%
Average
87.9%
Pulmonology
Correct
7
Incorrect
5
Unanswered
4
Accuracy
43.8%
Average
82.8%
Radiology-Emergency
Correct
6
Incorrect
5
Unanswered
2
Accuracy
46.2%
Average
67.7%
Rheumatology
Correct
1
Incorrect
6
Unanswered
4
Accuracy
9.1%
Average
88.4%
Statistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
3
Incorrect
6
Unanswered
2
Accuracy
27.3%
Average
65.2%
Urology
Correct
4
Incorrect
4
Unanswered
0
Accuracy
50.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
82.6%
Biostatistics
Correct
1
Incorrect
0
Unanswered
1
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
25
Incorrect
30
Unanswered
26
Accuracy
30.9%
Average
82.2%
Epidemiology
Correct
6
Incorrect
2
Unanswered
1
Accuracy
66.7%
Average
88.7%
Ethics
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
92.0%
Interpretation
Correct
9
Incorrect
15
Unanswered
13
Accuracy
24.3%
Average
72.0%
Legal
Correct
5
Incorrect
3
Unanswered
1
Accuracy
55.6%
Average
82.4%
Pathophysiology
Correct
10
Incorrect
8
Unanswered
8
Accuracy
38.5%
Average
84.3%
Pharmacology
Correct
3
Incorrect
6
Unanswered
6
Accuracy
20.0%
Average
82.3%
Prevention
Correct
6
Incorrect
9
Unanswered
1
Accuracy
37.5%
Average
80.6%
Prognosis
Correct
1
Incorrect
1
Unanswered
3
Accuracy
20.0%
Average
93.2%
Risk
Correct
5
Incorrect
8
Unanswered
2
Accuracy
33.3%
Average
84.3%
Tests
Correct
8
Incorrect
18
Unanswered
7
Accuracy
24.2%
Average
80.3%
Treatment
Correct
29
Incorrect
32
Unanswered
11
Accuracy
40.3%
Average
80.1%
#AnswerCorrectStatus
1A
2BB
3D
4DD
5BB
6BC
7CB
8AD
9D
10BA
11AB
12AA
13AAnnulled
14C
15BA
16CC
17C
18BD
19B
20DB
21BB
22CC
23AB
24AA
25C
26AA
27BB
28DD
29AA
30AD
31CC
32BC
33B
34BB
35CC
36BD
37AD
38AA
39AC
40BA
41DD
42DA
43AB
44B
45B
46AB
47DD
48BC
49CC
50AAnnulled
51AA
52BC
53AC
54CC
55CA
56BA
57A
58BA
59B
60AB
61DC
62DB
63AB
64CAnnulled
65DC
66C
67AC
68A
69B
70BB
71AB
72BB
73BB
74AA
75BC
76CC
77CA
78DD
79AA
80D
81C
82D
83BB
84CA
85AD
86DA
87BB
88AB
89B
90AC
91AA
92BC
93DD
94AC
95DC
96AB
97B
98AA
99AB
100AC
101CC
102A
103C
104CC
105AC
106B
107C
108A
109C
110AC
111DB
112CC
113CC
114DD
115BB
116D
117C
118DB
119AA
120AA
121C
122CB
123B
124DB
125C
126BB
127AC
128CB
129BC
130CC
131AB
132BB
133CC
134B
135C
136CB
137DD
138DB
139BAnnulled
140CD
141A
142AAnnulled
143A
144CD
145CC
146AC
147BB
148CC
149BB
150CB
151B
152CC
153BC
154D
155AB
156A
157DD
158BB
159C
160AA
161CAnnulled
162AA
163BC
164DC
165AA
166AA
167BD
168CC
169CB
170AB
171AA
172AB
173DD
174C
175CB
176CA
177AD
178DD
179B
180AC
181BB
182DC
183D
184AD
185DB
186DD
187CD
188C
189CC
190B
191DD
192D
193CC
194DC
195AD
196AA
197BC
198AA
199AB
200BD
201CC
202AA
203AA
204C
205BB
206DC
207A
208Annulled
209BB
210CC