MedicalBenchmark
Noromaid 20B provider

Noromaid 20B

282

#282 of 290 modelsMIR 2025

Net score

19.33 pts

Accuracy

27.0%

Correct / Incorrect

54 / 104

Total Cost

$0.29

Overall Performance

(vs. average)
Accuracy

27.0%

avg: 75.9%

Net score

19.33 pts

avg: 138.99 pts

Correct

54

avg: 152

Incorrect

104

avg: 38

Total Cost

$0.29

avg: $3.59

Average response time

13.5s

avg: 18.1s

Output Tokens

89K

avg: 443K

Reasoning Tokens

0

avg: 320K

Average confidence

78.7%

avg: 94.7%

Subject Breakdown

Allergology
Correct
0
Incorrect
3
Unanswered
1
Accuracy
0.0%
Average
86.9%
Anesthesiology and Resuscitation
Correct
4
Incorrect
1
Unanswered
1
Accuracy
66.7%
Average
81.3%
Cardiology
Correct
5
Incorrect
8
Unanswered
9
Accuracy
22.7%
Average
77.4%
Dermatology
Correct
5
Incorrect
8
Unanswered
0
Accuracy
38.5%
Average
62.8%
Endocrinology and Nutrition
Correct
4
Incorrect
8
Unanswered
4
Accuracy
25.0%
Average
82.5%
ENT
Correct
1
Incorrect
5
Unanswered
2
Accuracy
12.5%
Average
73.8%
Epidemiology
Correct
1
Incorrect
5
Unanswered
1
Accuracy
14.3%
Average
67.1%
Gastroenterology
Correct
4
Incorrect
13
Unanswered
4
Accuracy
19.0%
Average
72.9%
Genetics
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
68.2%
Geriatrics
Correct
2
Incorrect
7
Unanswered
2
Accuracy
18.2%
Average
71.2%
Gynecology and Obstetrics
Correct
7
Incorrect
7
Unanswered
5
Accuracy
36.8%
Average
85.9%
Health Planning and Management
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
81.6%
Hematology
Correct
1
Incorrect
9
Unanswered
1
Accuracy
9.1%
Average
81.8%
Immunology
Correct
4
Incorrect
5
Unanswered
0
Accuracy
44.4%
Average
82.5%
Infectious Diseases
Correct
8
Incorrect
16
Unanswered
4
Accuracy
28.6%
Average
71.1%
Legal Medicine and Bioethics
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
67.2%
Medical Oncology
Correct
10
Incorrect
13
Unanswered
2
Accuracy
40.0%
Average
86.3%
Nephrology
Correct
3
Incorrect
8
Unanswered
4
Accuracy
20.0%
Average
78.2%
Neurology
Correct
8
Incorrect
10
Unanswered
2
Accuracy
40.0%
Average
76.2%
Ophthalmology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
72.6%
Palliative Care
Correct
3
Incorrect
1
Unanswered
0
Accuracy
75.0%
Average
77.2%
Pediatrics
Correct
8
Incorrect
10
Unanswered
7
Accuracy
32.0%
Average
72.7%
Pharmacology
Correct
6
Incorrect
11
Unanswered
0
Accuracy
35.3%
Average
73.1%
Psychiatry
Correct
1
Incorrect
5
Unanswered
2
Accuracy
12.5%
Average
82.0%
Pulmonology
Correct
5
Incorrect
7
Unanswered
2
Accuracy
35.7%
Average
73.0%
Radiology-Emergency
Correct
3
Incorrect
7
Unanswered
4
Accuracy
21.4%
Average
67.9%
Rheumatology
Correct
1
Incorrect
9
Unanswered
4
Accuracy
7.1%
Average
74.6%
Statistics
Correct
0
Incorrect
2
Unanswered
1
Accuracy
0.0%
Average
74.9%
Traumatology
Correct
5
Incorrect
9
Unanswered
4
Accuracy
27.8%
Average
78.2%
Urology
Correct
0
Incorrect
5
Unanswered
2
Accuracy
0.0%
Average
79.5%

Question Type Breakdown

Anatomy
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
77.1%
Biostatistics
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
78.4%
Diagnosis
Correct
26
Incorrect
38
Unanswered
25
Accuracy
29.2%
Average
77.9%
Epidemiology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
75.0%
Ethics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
72.0%
Interpretation
Correct
11
Incorrect
23
Unanswered
8
Accuracy
26.2%
Average
69.3%
Legal
Correct
1
Incorrect
3
Unanswered
0
Accuracy
25.0%
Average
63.6%
Pathophysiology
Correct
6
Incorrect
18
Unanswered
3
Accuracy
22.2%
Average
72.6%
Pharmacology
Correct
4
Incorrect
9
Unanswered
0
Accuracy
30.8%
Average
82.4%
Prevention
Correct
2
Incorrect
8
Unanswered
2
Accuracy
16.7%
Average
74.5%
Prognosis
Correct
2
Incorrect
4
Unanswered
0
Accuracy
33.3%
Average
77.8%
Risk
Correct
2
Incorrect
1
Unanswered
2
Accuracy
40.0%
Average
84.3%
Tests
Correct
5
Incorrect
9
Unanswered
12
Accuracy
19.2%
Average
76.3%
Treatment
Correct
23
Incorrect
45
Unanswered
14
Accuracy
28.0%
Average
75.2%
#AnswerCorrectStatus
1BB
2BA
3DC
4DB
5AA
6CC
7DC
8AA
9CA
10D
11DD
12BD
13AB
14DD
15
16DB
17AB
18CA
19DC
20A
21DB
22AD
23CC
24DD
25CC
26Annulled
27AC
28DAnnulled
29D
30DB
31AD
32DA
33DD
34DD
35BB
36CD
37CC
38AC
39BD
40BA
41D
42CC
43AB
44D
45AD
46AA
47AA
48AA
49AD
50BB
51DC
52CB
53CD
54DB
55A
56DAnnulled
57C
58B
59DD
60A
61AA
62D
63AB
64D
65A
66A
67B
68B
69AB
70DA
71DD
72A
73AD
74DC
75AA
76CB
77AB
78BB
79DC
80CC
81CC
82BD
83B
84DD
85AC
86CC
87A
88CD
89BB
90DA
91BB
92BC
93B
94BC
95A
96DC
97BD
98C
99BA
100DC
101B
102DD
103DA
104C
105DA
106DC
107B
108D
109BB
110CC
111DA
112DC
113B
114BD
115AD
116BC
117A
118D
119BC
120DB
121AD
122CC
123CC
124CC
125AD
126D
127BB
128CD
129AA
130BD
131AD
132BA
133BB
134CC
135DB
136C
137DA
138AD
139BD
140BB
141AA
142DA
143AB
144AB
145AD
146BC
147AB
148CA
149DA
150CA
151DA
152CA
153CB
154AB
155AB
156BC
157DA
158CC
159C
160BA
161CA
162B
163DD
164DC
165A
166CB
167C
168DD
169DB
170B
171AC
172DA
173DA
174CB
175CB
176CC
177BC
178BA
179BD
180AA
181DB
182CC
183B
184BB
185BB
186CAnnulled
187AC
188DD
189DD
190AA
191B
192DA
193C
194BA
195DA
196CA
197BB
198CC
199BD
200BC
201B
202A
203D
204C
205CB
206BD
207AA
208C
209AC
210CB