MedicalBenchmark
EssentialAI: Rnj 1 Instruct provider

Rnj 1 Instruct

310

#310 of 319 modelsMIR 2025

Net score

20.66 pts

Accuracy

30.0%

Correct / Incorrect

60 / 118

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

30.0%

avg: 77.9%

Net score

20.66 pts

avg: 143.96 pts

Correct

60

avg: 156

Incorrect

118

avg: 35

Total Cost

$0.04

avg: $3.36

Average response time

5.2s

avg: 19.0s

Output Tokens

131K

avg: 430K

Reasoning Tokens

0

avg: 306K

Average confidence

87.7%

avg: 95.2%

Subject Breakdown

Allergology
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
87.9%
Anesthesiology and Resuscitation
Correct
1
Incorrect
3
Unanswered
2
Accuracy
16.7%
Average
82.3%
Cardiology
Correct
4
Incorrect
15
Unanswered
3
Accuracy
18.2%
Average
78.6%
Dermatology
Correct
4
Incorrect
7
Unanswered
1
Accuracy
33.3%
Average
69.4%
Endocrinology and Nutrition
Correct
5
Incorrect
11
Unanswered
0
Accuracy
31.3%
Average
83.5%
ENT
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
74.8%
Epidemiology
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
69.1%
Gastroenterology
Correct
7
Incorrect
14
Unanswered
0
Accuracy
33.3%
Average
74.1%
Genetics
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
69.5%
Geriatrics
Correct
1
Incorrect
7
Unanswered
3
Accuracy
9.1%
Average
77.5%
Gynecology and Obstetrics
Correct
8
Incorrect
9
Unanswered
2
Accuracy
42.1%
Average
86.7%
Health Planning and Management
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
82.6%
Hematology
Correct
3
Incorrect
8
Unanswered
0
Accuracy
27.3%
Average
82.7%
Immunology
Correct
2
Incorrect
7
Unanswered
0
Accuracy
22.2%
Average
83.3%
Infectious Diseases
Correct
9
Incorrect
14
Unanswered
4
Accuracy
33.3%
Average
74.9%
Legal Medicine and Bioethics
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
68.4%
Medical Oncology
Correct
10
Incorrect
14
Unanswered
1
Accuracy
40.0%
Average
87.2%
Nephrology
Correct
7
Incorrect
5
Unanswered
2
Accuracy
50.0%
Average
84.8%
Neurology
Correct
7
Incorrect
8
Unanswered
5
Accuracy
35.0%
Average
77.3%
Ophthalmology
Correct
1
Incorrect
3
Unanswered
1
Accuracy
20.0%
Average
74.2%
Palliative Care
Correct
0
Incorrect
3
Unanswered
1
Accuracy
0.0%
Average
78.6%
Pediatrics
Correct
10
Incorrect
14
Unanswered
2
Accuracy
38.5%
Average
71.9%
Pharmacology
Correct
1
Incorrect
14
Unanswered
2
Accuracy
5.9%
Average
74.1%
Psychiatry
Correct
1
Incorrect
6
Unanswered
1
Accuracy
12.5%
Average
83.0%
Pulmonology
Correct
1
Incorrect
9
Unanswered
4
Accuracy
7.1%
Average
80.4%
Radiology-Emergency
Correct
3
Incorrect
10
Unanswered
1
Accuracy
21.4%
Average
69.4%
Rheumatology
Correct
4
Incorrect
9
Unanswered
2
Accuracy
26.7%
Average
76.6%
Statistics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
76.6%
Traumatology
Correct
5
Incorrect
11
Unanswered
2
Accuracy
27.8%
Average
79.3%
Urology
Correct
2
Incorrect
4
Unanswered
1
Accuracy
28.6%
Average
80.7%

Question Type Breakdown

Anatomy
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
78.6%
Biostatistics
Correct
1
Incorrect
3
Unanswered
0
Accuracy
25.0%
Average
79.8%
Diagnosis
Correct
27
Incorrect
53
Unanswered
8
Accuracy
30.7%
Average
79.9%
Epidemiology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
76.7%
Ethics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
74.1%
Interpretation
Correct
11
Incorrect
29
Unanswered
2
Accuracy
26.2%
Average
70.7%
Legal
Correct
2
Incorrect
2
Unanswered
0
Accuracy
50.0%
Average
64.6%
Pathophysiology
Correct
6
Incorrect
20
Unanswered
1
Accuracy
22.2%
Average
76.1%
Pharmacology
Correct
0
Incorrect
11
Unanswered
2
Accuracy
0.0%
Average
83.3%
Prevention
Correct
5
Incorrect
4
Unanswered
3
Accuracy
41.7%
Average
75.6%
Prognosis
Correct
3
Incorrect
3
Unanswered
1
Accuracy
42.9%
Average
80.8%
Risk
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
85.2%
Tests
Correct
8
Incorrect
13
Unanswered
6
Accuracy
29.6%
Average
77.9%
Treatment
Correct
25
Incorrect
44
Unanswered
12
Accuracy
30.9%
Average
77.3%
#AnswerCorrectStatus
1BB
2BA
3CC
4AB
5DA
6AC
7AC
8BA
9DA
10AD
11BD
12BD
13AB
14AD
15BAnnulled
16CB
17AB
18BA
19CC
20AA
21CB
22BD
23AC
24BD
25CC
26Annulled
27AC
28CAnnulled
29AD
30DB
31DD
32AA
33DD
34CD
35BB
36CD
37DC
38BC
39DD
40DA
41DD
42BC
43BB
44D
45CD
46BA
47CA
48AA
49DD
50DB
51DC
52B
53CD
54DB
55AA
56CAnnulled
57CC
58BB
59DD
60BA
61DA
62AD
63BB
64BD
65A
66CA
67BB
68BB
69AB
70DA
71AD
72CA
73CD
74DC
75AA
76CB
77B
78BB
79DC
80CC
81CC
82DD
83CB
84D
85C
86DC
87A
88DD
89BB
90A
91DB
92BC
93BB
94CC
95BA
96DC
97DD
98DC
99A
100DC
101AB
102D
103DA
104AC
105AA
106CC
107BB
108AD
109AB
110C
111DA
112AC
113AB
114D
115D
116DC
117DA
118DD
119BC
120AB
121BD
122BC
123CC
124CC
125DD
126CD
127BB
128DD
129CA
130DD
131DD
132AA
133B
134CC
135DB
136C
137AA
138CD
139DD
140DB
141BA
142BA
143CB
144AB
145BD
146BC
147CB
148AA
149DA
150DD
151DA
152DA
153DB
154BB
155BB
156DC
157DA
158AC
159DC
160BA
161DA
162BAnnulled
163CD
164BC
165BA
166DB
167DC
168BD
169BB
170DB
171C
172DA
173BA
174B
175DB
176CC
177DC
178AA
179D
180AA
181DB
182BC
183DB
184DB
185DB
186DAnnulled
187DC
188CD
189CD
190BA
191DB
192DA
193C
194AA
195AA
196AA
197BB
198CC
199D
200AC
201AB
202BA
203DD
204C
205B
206BD
207DA
208BC
209CC
210DB