MedicalBenchmark
EssentialAI: Rnj 1 Instruct provider

Rnj 1 Instruct

279

#279 of 291 modelsMIR 2024

Net score

38.66 pts

Accuracy

36.0%

Correct / Incorrect

72 / 100

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

36.0%

avg: 80.5%

Net score

38.66 pts

avg: 150.85 pts

Correct

72

avg: 161

Incorrect

100

avg: 30

Total Cost

$0.04

avg: $3.32

Average response time

5.3s

avg: 16.4s

Output Tokens

131K

avg: 427K

Reasoning Tokens

0

avg: 310K

Average confidence

85.2%

avg: 95.4%

Subject Breakdown

Allergology
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
90.5%
Anesthesiology and Resuscitation
Correct
1
Incorrect
3
Unanswered
0
Accuracy
25.0%
Average
87.1%
Cardiology
Correct
6
Incorrect
12
Unanswered
3
Accuracy
28.6%
Average
79.7%
Dermatology
Correct
6
Incorrect
3
Unanswered
5
Accuracy
42.9%
Average
80.2%
Endocrinology and Nutrition
Correct
4
Incorrect
13
Unanswered
2
Accuracy
21.1%
Average
84.2%
ENT
Correct
3
Incorrect
3
Unanswered
1
Accuracy
42.9%
Average
74.4%
Epidemiology
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
89.3%
Gastroenterology
Correct
6
Incorrect
12
Unanswered
4
Accuracy
27.3%
Average
70.5%
Genetics
Correct
1
Incorrect
5
Unanswered
1
Accuracy
14.3%
Average
86.5%
Geriatrics
Correct
4
Incorrect
4
Unanswered
2
Accuracy
40.0%
Average
86.9%
Gynecology and Obstetrics
Correct
6
Incorrect
6
Unanswered
2
Accuracy
42.9%
Average
81.2%
Health Planning and Management
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
73.2%
Hematology
Correct
5
Incorrect
6
Unanswered
2
Accuracy
38.5%
Average
81.5%
Immunology
Correct
4
Incorrect
3
Unanswered
1
Accuracy
50.0%
Average
89.1%
Infectious Diseases
Correct
8
Incorrect
13
Unanswered
2
Accuracy
34.8%
Average
81.8%
Legal Medicine and Bioethics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
91.7%
Medical Oncology
Correct
5
Incorrect
11
Unanswered
5
Accuracy
23.8%
Average
80.2%
Nephrology
Correct
1
Incorrect
12
Unanswered
0
Accuracy
7.7%
Average
80.8%
Neurology
Correct
5
Incorrect
15
Unanswered
2
Accuracy
22.7%
Average
83.7%
Ophthalmology
Correct
2
Incorrect
2
Unanswered
1
Accuracy
40.0%
Average
80.0%
Palliative Care
Correct
0
Incorrect
3
Unanswered
1
Accuracy
0.0%
Average
88.2%
Pediatrics
Correct
5
Incorrect
10
Unanswered
2
Accuracy
29.4%
Average
82.0%
Pharmacology
Correct
10
Incorrect
12
Unanswered
1
Accuracy
43.5%
Average
85.4%
Psychiatry
Correct
6
Incorrect
2
Unanswered
2
Accuracy
60.0%
Average
89.5%
Pulmonology
Correct
6
Incorrect
10
Unanswered
3
Accuracy
31.6%
Average
80.6%
Radiology-Emergency
Correct
3
Incorrect
6
Unanswered
5
Accuracy
21.4%
Average
64.9%
Rheumatology
Correct
7
Incorrect
3
Unanswered
4
Accuracy
50.0%
Average
81.4%
Statistics
Correct
2
Incorrect
0
Unanswered
1
Accuracy
66.7%
Average
91.1%
Traumatology
Correct
8
Incorrect
6
Unanswered
1
Accuracy
53.3%
Average
74.5%
Urology
Correct
0
Incorrect
4
Unanswered
2
Accuracy
0.0%
Average
78.2%

Question Type Breakdown

Anatomy
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
79.8%
Biostatistics
Correct
4
Incorrect
0
Unanswered
1
Accuracy
80.0%
Average
90.7%
Diagnosis
Correct
27
Incorrect
33
Unanswered
13
Accuracy
37.0%
Average
79.2%
Epidemiology
Correct
5
Incorrect
7
Unanswered
0
Accuracy
41.7%
Average
81.2%
Ethics
Correct
0
Incorrect
1
Unanswered
0
Accuracy
0.0%
Average
94.5%
Interpretation
Correct
8
Incorrect
22
Unanswered
7
Accuracy
21.6%
Average
69.6%
Pathophysiology
Correct
7
Incorrect
23
Unanswered
3
Accuracy
21.2%
Average
85.4%
Pharmacology
Correct
9
Incorrect
13
Unanswered
3
Accuracy
36.0%
Average
84.0%
Prevention
Correct
5
Incorrect
6
Unanswered
1
Accuracy
41.7%
Average
89.8%
Prognosis
Correct
1
Incorrect
3
Unanswered
3
Accuracy
14.3%
Average
83.9%
Risk
Correct
3
Incorrect
8
Unanswered
2
Accuracy
23.1%
Average
83.6%
Tests
Correct
6
Incorrect
9
Unanswered
6
Accuracy
28.6%
Average
73.9%
Treatment
Correct
28
Incorrect
36
Unanswered
7
Accuracy
39.4%
Average
81.3%
#AnswerCorrectStatus
1AB
2AD
3B
4BC
5C
6AB
7AD
8CC
9AA
10DD
11BD
12BA
13C
14BA
15B
16DA
17BC
18A
19AB
20DC
21BD
22BB
23AA
24DA
25C
26BB
27AC
28CA
29BB
30AC
31AD
32AA
33AC
34DB
35DD
36BD
37DA
38CA
39CC
40BB
41CC
42AD
43AA
44DD
45D
46BB
47CC
48CC
49BB
50BC
51CA
52CD
53AC
54CB
55CC
56BD
57AA
58DA
59A
60AA
61A
62DD
63DD
64DAnnulled
65DD
66AC
67BB
68CAnnulled
69AA
70BB
71AB
72DD
73DB
74CC
75B
76CA
77DD
78C
79DB
80AA
81DC
82CC
83BB
84CC
85BA
86CA
87CB
88D
89B
90AA
91BD
92AA
93AC
94AB
95BD
96BB
97DB
98DB
99BA
100BB
101AA
102D
103BB
104CD
105BB
106BC
107CC
108B
109AD
110DD
111B
112AC
113DAnnulled
114DD
115DD
116DA
117DD
118DD
119CA
120BC
121AA
122CB
123CD
124DD
125AB
126DD
127BA
128CB
129AD
130DC
131C
132AD
133AA
134DC
135A
136AD
137AA
138CC
139DA
140AC
141AB
142DC
143DA
144BD
145DC
146BC
147C
148BA
149C
150BD
151DA
152AA
153AC
154AB
155BD
156CC
157CC
158DD
159DD
160CB
161DB
162B
163BB
164DB
165A
166AC
167BA
168B
169AC
170AA
171DD
172AB
173BA
174BB
175BA
176DC
177CC
178AB
179CC
180BAnnulled
181DB
182BD
183C
184DA
185BC
186DD
187BA
188CC
189DD
190DD
191BB
192BB
193AC
194DC
195DC
196BB
197A
198BB
199CD
200A
201DB
202D
203AB
204D
205AD
206Annulled
207DA
208A
209BB
210DD