MedicalBenchmark
EssentialAI: Rnj 1 Instruct provider

Rnj 1 Instruct

283

#283 of 290 modelsMIR 2025

Net score

19.00 pts

Accuracy

29.5%

Correct / Incorrect

59 / 120

Total Cost

$0.04

Overall Performance

(vs. average)
Accuracy

29.5%

avg: 75.9%

Net score

19.00 pts

avg: 138.99 pts

Correct

59

avg: 152

Incorrect

120

avg: 38

Total Cost

$0.04

avg: $3.59

Average response time

5.2s

avg: 18.1s

Output Tokens

131K

avg: 443K

Reasoning Tokens

0

avg: 320K

Average confidence

87.7%

avg: 94.7%

Subject Breakdown

Allergology
Correct
1
Incorrect
2
Unanswered
1
Accuracy
25.0%
Average
86.9%
Anesthesiology and Resuscitation
Correct
1
Incorrect
3
Unanswered
2
Accuracy
16.7%
Average
81.3%
Cardiology
Correct
4
Incorrect
15
Unanswered
3
Accuracy
18.2%
Average
77.4%
Dermatology
Correct
4
Incorrect
8
Unanswered
1
Accuracy
30.8%
Average
62.8%
Endocrinology and Nutrition
Correct
5
Incorrect
11
Unanswered
0
Accuracy
31.3%
Average
82.5%
ENT
Correct
6
Incorrect
2
Unanswered
0
Accuracy
75.0%
Average
73.8%
Epidemiology
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
67.1%
Gastroenterology
Correct
7
Incorrect
14
Unanswered
0
Accuracy
33.3%
Average
72.9%
Genetics
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
68.2%
Geriatrics
Correct
0
Incorrect
8
Unanswered
3
Accuracy
0.0%
Average
71.2%
Gynecology and Obstetrics
Correct
8
Incorrect
9
Unanswered
2
Accuracy
42.1%
Average
85.9%
Health Planning and Management
Correct
0
Incorrect
2
Unanswered
0
Accuracy
0.0%
Average
81.6%
Hematology
Correct
3
Incorrect
8
Unanswered
0
Accuracy
27.3%
Average
81.8%
Immunology
Correct
2
Incorrect
7
Unanswered
0
Accuracy
22.2%
Average
82.5%
Infectious Diseases
Correct
9
Incorrect
15
Unanswered
4
Accuracy
32.1%
Average
71.1%
Legal Medicine and Bioethics
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
67.2%
Medical Oncology
Correct
10
Incorrect
14
Unanswered
1
Accuracy
40.0%
Average
86.3%
Nephrology
Correct
7
Incorrect
6
Unanswered
2
Accuracy
46.7%
Average
78.2%
Neurology
Correct
7
Incorrect
8
Unanswered
5
Accuracy
35.0%
Average
76.2%
Ophthalmology
Correct
1
Incorrect
3
Unanswered
1
Accuracy
20.0%
Average
72.6%
Palliative Care
Correct
0
Incorrect
3
Unanswered
1
Accuracy
0.0%
Average
77.2%
Pediatrics
Correct
10
Incorrect
13
Unanswered
2
Accuracy
40.0%
Average
72.7%
Pharmacology
Correct
1
Incorrect
14
Unanswered
2
Accuracy
5.9%
Average
73.1%
Psychiatry
Correct
1
Incorrect
6
Unanswered
1
Accuracy
12.5%
Average
82.0%
Pulmonology
Correct
1
Incorrect
10
Unanswered
3
Accuracy
7.1%
Average
73.0%
Radiology-Emergency
Correct
3
Incorrect
10
Unanswered
1
Accuracy
21.4%
Average
67.9%
Rheumatology
Correct
4
Incorrect
9
Unanswered
1
Accuracy
28.6%
Average
74.6%
Statistics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
74.9%
Traumatology
Correct
5
Incorrect
11
Unanswered
2
Accuracy
27.8%
Average
78.2%
Urology
Correct
2
Incorrect
4
Unanswered
1
Accuracy
28.6%
Average
79.5%

Question Type Breakdown

Anatomy
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
77.1%
Biostatistics
Correct
1
Incorrect
3
Unanswered
0
Accuracy
25.0%
Average
78.4%
Diagnosis
Correct
27
Incorrect
54
Unanswered
8
Accuracy
30.3%
Average
77.9%
Epidemiology
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
75.0%
Ethics
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
72.0%
Interpretation
Correct
11
Incorrect
29
Unanswered
2
Accuracy
26.2%
Average
69.3%
Legal
Correct
2
Incorrect
2
Unanswered
0
Accuracy
50.0%
Average
63.6%
Pathophysiology
Correct
5
Incorrect
21
Unanswered
1
Accuracy
18.5%
Average
72.6%
Pharmacology
Correct
0
Incorrect
11
Unanswered
2
Accuracy
0.0%
Average
82.4%
Prevention
Correct
5
Incorrect
4
Unanswered
3
Accuracy
41.7%
Average
74.5%
Prognosis
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
77.8%
Risk
Correct
1
Incorrect
4
Unanswered
0
Accuracy
20.0%
Average
84.3%
Tests
Correct
8
Incorrect
13
Unanswered
5
Accuracy
30.8%
Average
76.3%
Treatment
Correct
25
Incorrect
45
Unanswered
12
Accuracy
30.5%
Average
75.2%
#AnswerCorrectStatus
1BB
2BA
3CC
4AB
5DA
6AC
7AC
8BA
9DA
10AD
11BD
12BD
13AB
14AD
15B
16CB
17AB
18BA
19CC
20AA
21CB
22BD
23AC
24BD
25CC
26Annulled
27AC
28CAnnulled
29AD
30DB
31DD
32AA
33DD
34CD
35BB
36CD
37DC
38BC
39DD
40DA
41DD
42BC
43BB
44D
45CD
46BA
47CA
48AA
49DD
50DB
51DC
52B
53CD
54DB
55AA
56CAnnulled
57CC
58BB
59DD
60BA
61DA
62AD
63BB
64BD
65A
66CA
67BB
68BB
69AB
70DA
71AD
72CA
73CD
74DC
75AA
76CB
77B
78BB
79DC
80CC
81CC
82DD
83CB
84D
85C
86DC
87A
88DD
89BB
90A
91DB
92BC
93BB
94CC
95BA
96DC
97DD
98DC
99A
100DC
101AB
102D
103DA
104AC
105AA
106CC
107BB
108AD
109AB
110C
111DA
112AC
113AB
114D
115D
116DC
117DA
118DD
119BC
120AB
121BD
122BC
123CC
124CC
125DD
126CD
127BB
128DD
129CA
130DD
131DD
132AA
133B
134CC
135DB
136C
137AA
138CD
139DD
140DB
141BA
142BA
143CB
144AB
145BD
146BC
147CB
148AA
149DA
150DA
151DA
152DA
153DB
154BB
155BB
156DC
157DA
158AC
159DC
160BA
161DA
162B
163CD
164BC
165BA
166DB
167DC
168BD
169BB
170DB
171C
172DA
173BA
174B
175DB
176CC
177DC
178AA
179D
180AA
181DB
182BC
183DB
184DB
185DB
186DAnnulled
187DC
188CD
189CD
190BA
191DB
192DA
193C
194AA
195AA
196AA
197BB
198CC
199D
200AC
201AB
202BA
203DD
204C
205B
206BD
207DA
208BC
209CC
210DB