MedicalBenchmark
Noromaid 20B provider

Noromaid 20B

312

#312 of 319 modelsMIR 2025

Net score

19.00 pts

Accuracy

27.0%

Correct / Incorrect

54 / 105

Total Cost

$0.29

Overall Performance

(vs. average)
Accuracy

27.0%

avg: 77.9%

Net score

19.00 pts

avg: 143.96 pts

Correct

54

avg: 156

Incorrect

105

avg: 35

Total Cost

$0.29

avg: $3.36

Average response time

13.5s

avg: 19.0s

Output Tokens

89K

avg: 430K

Reasoning Tokens

0

avg: 306K

Average confidence

78.7%

avg: 95.2%

Subject Breakdown

Allergology
Correct
0
Incorrect
3
Unanswered
1
Accuracy
0.0%
Average
87.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
82.3%
Cardiology
Correct
5
Incorrect
8
Unanswered
9
Accuracy
22.7%
Average
78.6%
Dermatology
Correct
5
Incorrect
7
Unanswered
0
Accuracy
41.7%
Average
69.4%
Endocrinology and Nutrition
Correct
4
Incorrect
8
Unanswered
4
Accuracy
25.0%
Average
83.5%
ENT
Correct
1
Incorrect
5
Unanswered
2
Accuracy
12.5%
Average
74.8%
Epidemiology
Correct
1
Incorrect
5
Unanswered
1
Accuracy
14.3%
Average
69.1%
Gastroenterology
Correct
4
Incorrect
13
Unanswered
4
Accuracy
19.0%
Average
74.1%
Genetics
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
69.5%
Geriatrics
Correct
2
Incorrect
7
Unanswered
2
Accuracy
18.2%
Average
77.5%
Gynecology and Obstetrics
Correct
7
Incorrect
7
Unanswered
5
Accuracy
36.8%
Average
86.7%
Health Planning and Management
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
82.6%
Hematology
Correct
1
Incorrect
9
Unanswered
1
Accuracy
9.1%
Average
82.7%
Immunology
Correct
4
Incorrect
5
Unanswered
0
Accuracy
44.4%
Average
83.3%
Infectious Diseases
Correct
8
Incorrect
15
Unanswered
4
Accuracy
29.6%
Average
74.9%
Legal Medicine and Bioethics
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
68.4%
Medical Oncology
Correct
10
Incorrect
13
Unanswered
2
Accuracy
40.0%
Average
87.2%
Nephrology
Correct
3
Incorrect
8
Unanswered
3
Accuracy
21.4%
Average
84.8%
Neurology
Correct
8
Incorrect
10
Unanswered
2
Accuracy
40.0%
Average
77.3%
Ophthalmology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
74.2%
Palliative Care
Correct
3
Incorrect
1
Unanswered
0
Accuracy
75.0%
Average
78.6%
Pediatrics
Correct
8
Incorrect
11
Unanswered
7
Accuracy
30.8%
Average
71.9%
Pharmacology
Correct
6
Incorrect
11
Unanswered
0
Accuracy
35.3%
Average
74.1%
Psychiatry
Correct
1
Incorrect
5
Unanswered
2
Accuracy
12.5%
Average
83.0%
Pulmonology
Correct
5
Incorrect
8
Unanswered
1
Accuracy
35.7%
Average
80.4%
Radiology-Emergency
Correct
3
Incorrect
7
Unanswered
4
Accuracy
21.4%
Average
69.4%
Rheumatology
Correct
1
Incorrect
10
Unanswered
4
Accuracy
6.7%
Average
76.6%
Statistics
Correct
0
Incorrect
2
Unanswered
1
Accuracy
0.0%
Average
76.6%
Traumatology
Correct
5
Incorrect
9
Unanswered
4
Accuracy
27.8%
Average
79.3%
Urology
Correct
0
Incorrect
5
Unanswered
2
Accuracy
0.0%
Average
80.7%

Question Type Breakdown

Anatomy
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
78.6%
Biostatistics
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
79.8%
Diagnosis
Correct
26
Incorrect
38
Unanswered
24
Accuracy
29.5%
Average
79.9%
Epidemiology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
76.7%
Ethics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
74.1%
Interpretation
Correct
11
Incorrect
23
Unanswered
8
Accuracy
26.2%
Average
70.7%
Legal
Correct
1
Incorrect
3
Unanswered
0
Accuracy
25.0%
Average
64.6%
Pathophysiology
Correct
6
Incorrect
18
Unanswered
3
Accuracy
22.2%
Average
76.1%
Pharmacology
Correct
4
Incorrect
9
Unanswered
0
Accuracy
30.8%
Average
83.3%
Prevention
Correct
2
Incorrect
8
Unanswered
2
Accuracy
16.7%
Average
75.6%
Prognosis
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
80.8%
Risk
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
85.2%
Tests
Correct
5
Incorrect
10
Unanswered
12
Accuracy
18.5%
Average
77.9%
Treatment
Correct
23
Incorrect
45
Unanswered
13
Accuracy
28.4%
Average
77.3%
#AnswerCorrectStatus
1BB
2BA
3DC
4DB
5AA
6CC
7DC
8AA
9CA
10D
11DD
12BD
13AB
14DD
15Annulled
16DB
17AB
18CA
19DC
20A
21DB
22AD
23CC
24DD
25CC
26Annulled
27AC
28DAnnulled
29D
30DB
31AD
32DA
33DD
34DD
35BB
36CD
37CC
38AC
39BD
40BA
41D
42CC
43AB
44D
45AD
46AA
47AA
48AA
49AD
50BB
51DC
52CB
53CD
54DB
55A
56DAnnulled
57C
58B
59DD
60A
61AA
62D
63AB
64D
65A
66A
67B
68B
69AB
70DA
71DD
72A
73AD
74DC
75AA
76CB
77AB
78BB
79DC
80CC
81CC
82BD
83B
84DD
85AC
86CC
87A
88CD
89BB
90DA
91BB
92BC
93B
94BC
95A
96DC
97BD
98C
99BA
100DC
101B
102DD
103DA
104C
105DA
106DC
107B
108D
109BB
110CC
111DA
112DC
113B
114BD
115AD
116BC
117A
118D
119BC
120DB
121AD
122CC
123CC
124CC
125AD
126D
127BB
128CD
129AA
130BD
131AD
132BA
133BB
134CC
135DB
136C
137DA
138AD
139BD
140BB
141AA
142DA
143AB
144AB
145AD
146BC
147AB
148CA
149DA
150CD
151DA
152CA
153CB
154AB
155AB
156BC
157DA
158CC
159C
160BA
161CA
162BAnnulled
163DD
164DC
165A
166CB
167C
168DD
169DB
170B
171AC
172DA
173DA
174CB
175CB
176CC
177BC
178BA
179BD
180AA
181DB
182CC
183B
184BB
185BB
186CAnnulled
187AC
188DD
189DD
190AA
191B
192DA
193C
194BA
195DA
196CA
197BB
198CC
199BD
200BC
201B
202A
203D
204C
205CB
206BD
207AA
208C
209AC
210CB