MedicalBenchmark
Noromaid 20B provider

Noromaid 20B

280

#280 of 291 modelsMIR 2024

Net score

38.00 pts

Accuracy

33.5%

Correct / Incorrect

67 / 87

Total Cost

$0.30

Overall Performance

(vs. average)
Accuracy

33.5%

avg: 80.5%

Net score

38.00 pts

avg: 150.85 pts

Correct

67

avg: 161

Incorrect

87

avg: 30

Total Cost

$0.30

avg: $3.32

Average response time

13.9s

avg: 16.4s

Output Tokens

92K

avg: 427K

Reasoning Tokens

0

avg: 310K

Average confidence

75.6%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
90.5%
Anesthesiology and Resuscitation
Correct
1
Incorrect
1
Unanswered
2
Accuracy
25.0%
Average
87.1%
Cardiology
Correct
9
Incorrect
6
Unanswered
6
Accuracy
42.9%
Average
79.7%
Dermatology
Correct
8
Incorrect
3
Unanswered
3
Accuracy
57.1%
Average
80.2%
Endocrinology and Nutrition
Correct
6
Incorrect
10
Unanswered
3
Accuracy
31.6%
Average
84.2%
ENT
Correct
3
Incorrect
2
Unanswered
2
Accuracy
42.9%
Average
74.4%
Epidemiology
Correct
4
Incorrect
4
Unanswered
0
Accuracy
50.0%
Average
89.3%
Gastroenterology
Correct
6
Incorrect
11
Unanswered
5
Accuracy
27.3%
Average
70.5%
Genetics
Correct
4
Incorrect
2
Unanswered
1
Accuracy
57.1%
Average
86.5%
Geriatrics
Correct
2
Incorrect
6
Unanswered
2
Accuracy
20.0%
Average
86.9%
Gynecology and Obstetrics
Correct
4
Incorrect
8
Unanswered
2
Accuracy
28.6%
Average
81.2%
Health Planning and Management
Correct
2
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
73.2%
Hematology
Correct
3
Incorrect
6
Unanswered
4
Accuracy
23.1%
Average
81.5%
Immunology
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
89.1%
Infectious Diseases
Correct
10
Incorrect
6
Unanswered
7
Accuracy
43.5%
Average
81.8%
Legal Medicine and Bioethics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
91.7%
Medical Oncology
Correct
8
Incorrect
7
Unanswered
6
Accuracy
38.1%
Average
80.2%
Nephrology
Correct
3
Incorrect
6
Unanswered
4
Accuracy
23.1%
Average
80.8%
Neurology
Correct
5
Incorrect
11
Unanswered
6
Accuracy
22.7%
Average
83.7%
Ophthalmology
Correct
1
Incorrect
2
Unanswered
2
Accuracy
20.0%
Average
80.0%
Palliative Care
Correct
2
Incorrect
1
Unanswered
1
Accuracy
50.0%
Average
88.2%
Pediatrics
Correct
2
Incorrect
11
Unanswered
4
Accuracy
11.8%
Average
82.0%
Pharmacology
Correct
10
Incorrect
7
Unanswered
6
Accuracy
43.5%
Average
85.4%
Psychiatry
Correct
2
Incorrect
6
Unanswered
2
Accuracy
20.0%
Average
89.5%
Pulmonology
Correct
7
Incorrect
7
Unanswered
5
Accuracy
36.8%
Average
80.6%
Radiology-Emergency
Correct
8
Incorrect
4
Unanswered
2
Accuracy
57.1%
Average
64.9%
Rheumatology
Correct
5
Incorrect
7
Unanswered
2
Accuracy
35.7%
Average
81.4%
Statistics
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
91.1%
Traumatology
Correct
4
Incorrect
7
Unanswered
4
Accuracy
26.7%
Average
74.5%
Urology
Correct
1
Incorrect
2
Unanswered
3
Accuracy
16.7%
Average
78.2%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
3
Unanswered
1
Accuracy
33.3%
Average
79.8%
Biostatistics
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
90.7%
Diagnosis
Correct
21
Incorrect
33
Unanswered
19
Accuracy
28.8%
Average
79.2%
Epidemiology
Correct
6
Incorrect
4
Unanswered
2
Accuracy
50.0%
Average
81.2%
Ethics
Correct
0
Incorrect
1
Unanswered
0
Accuracy
0.0%
Average
94.5%
Interpretation
Correct
14
Incorrect
16
Unanswered
7
Accuracy
37.8%
Average
69.6%
Pathophysiology
Correct
12
Incorrect
16
Unanswered
5
Accuracy
36.4%
Average
85.4%
Pharmacology
Correct
8
Incorrect
9
Unanswered
8
Accuracy
32.0%
Average
84.0%
Prevention
Correct
7
Incorrect
2
Unanswered
3
Accuracy
58.3%
Average
89.8%
Prognosis
Correct
3
Incorrect
3
Unanswered
1
Accuracy
42.9%
Average
83.9%
Risk
Correct
4
Incorrect
6
Unanswered
3
Accuracy
30.8%
Average
83.6%
Tests
Correct
6
Incorrect
12
Unanswered
3
Accuracy
28.6%
Average
73.9%
Treatment
Correct
26
Incorrect
28
Unanswered
17
Accuracy
36.6%
Average
81.3%
#AnswerCorrectStatus
1BB
2DD
3CB
4C
5CC
6BB
7CD
8CC
9AA
10DD
11DD
12AA
13CC
14A
15AB
16DA
17DC
18DA
19BB
20C
21D
22DB
23A
24A
25CC
26B
27CC
28BA
29DB
30BC
31D
32A
33AC
34CB
35DD
36DD
37AA
38BA
39DC
40BB
41CC
42AD
43AA
44DD
45AD
46BB
47BC
48AC
49BB
50BC
51AA
52CD
53C
54CB
55BC
56DD
57AA
58BA
59DA
60A
61AA
62DD
63D
64Annulled
65AD
66DC
67CB
68Annulled
69A
70BB
71AB
72D
73DB
74C
75B
76DA
77AD
78AC
79DB
80AA
81DC
82BC
83CB
84CC
85BA
86A
87CB
88D
89B
90AA
91BD
92BA
93BC
94AB
95DD
96BB
97B
98DB
99BA
100CB
101BA
102D
103BB
104D
105B
106C
107CC
108CB
109CD
110CD
111AB
112CC
113BAnnulled
114DD
115DD
116BA
117DD
118D
119CA
120AC
121A
122B
123CD
124BD
125DB
126DD
127DA
128DB
129DD
130BC
131AC
132D
133BA
134CC
135AA
136CD
137AA
138CC
139AA
140C
141DB
142C
143A
144DD
145AC
146C
147BC
148CA
149DC
150CD
151AA
152DA
153C
154DB
155DD
156CC
157DC
158BD
159D
160CB
161BB
162BB
163BB
164B
165CA
166DC
167AA
168BB
169BC
170A
171D
172BB
173AA
174B
175AA
176BC
177C
178B
179BC
180CAnnulled
181CB
182BD
183C
184AA
185CC
186DD
187A
188AC
189D
190DD
191AB
192BB
193DC
194C
195BC
196B
197CA
198BB
199DD
200BA
201DB
202DD
203B
204DD
205AD
206BAnnulled
207A
208AA
209CB
210DD