MedicalBenchmark
Mistral Tiny provider

Mistral Tiny

268

#268 of 290 modelsMIR 2026

Net score

67.00 pts

Accuracy

48.5%

Correct / Incorrect

97 / 90

Total Cost

$0.05

Overall Performance

(vs. average)
Accuracy

48.5%

avg: 81.6%

Net score

67.00 pts

avg: 154.00 pts

Correct

97

avg: 163

Incorrect

90

avg: 28

Total Cost

$0.05

avg: $3.33

Average response time

2.2s

avg: 16.2s

Output Tokens

64K

avg: 430K

Reasoning Tokens

0

avg: 310K

Average confidence

93.2%

avg: 95.1%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
5
Incorrect
2
Unanswered
0
Accuracy
71.4%
Average
69.6%
Cardiology
Correct
10
Incorrect
13
Unanswered
2
Accuracy
40.0%
Average
77.3%
Dermatology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
72.3%
Endocrinology and Nutrition
Correct
10
Incorrect
5
Unanswered
0
Accuracy
66.7%
Average
84.0%
ENT
Correct
4
Incorrect
3
Unanswered
1
Accuracy
50.0%
Average
84.7%
Epidemiology
Correct
2
Incorrect
5
Unanswered
0
Accuracy
28.6%
Average
80.2%
Gastroenterology
Correct
14
Incorrect
15
Unanswered
1
Accuracy
46.7%
Average
79.3%
Genetics
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
78.7%
Geriatrics
Correct
6
Incorrect
5
Unanswered
2
Accuracy
46.2%
Average
83.0%
Gynecology and Obstetrics
Correct
6
Incorrect
5
Unanswered
1
Accuracy
50.0%
Average
84.3%
Health Planning and Management
Correct
2
Incorrect
6
Unanswered
2
Accuracy
20.0%
Average
78.4%
Hematology
Correct
1
Incorrect
7
Unanswered
1
Accuracy
11.1%
Average
76.6%
Immunology
Correct
3
Incorrect
2
Unanswered
1
Accuracy
50.0%
Average
91.4%
Infectious Diseases
Correct
4
Incorrect
9
Unanswered
1
Accuracy
28.6%
Average
77.9%
Legal Medicine and Bioethics
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
82.9%
Medical Oncology
Correct
12
Incorrect
10
Unanswered
1
Accuracy
52.2%
Average
83.0%
Nephrology
Correct
5
Incorrect
5
Unanswered
0
Accuracy
50.0%
Average
85.1%
Neurology
Correct
8
Incorrect
4
Unanswered
1
Accuracy
61.5%
Average
88.6%
Ophthalmology
Correct
2
Incorrect
3
Unanswered
0
Accuracy
40.0%
Average
83.7%
Palliative Care
Correct
3
Incorrect
3
Unanswered
0
Accuracy
50.0%
Average
80.2%
Pediatrics
Correct
15
Incorrect
6
Unanswered
1
Accuracy
68.2%
Average
87.6%
Pharmacology
Correct
4
Incorrect
7
Unanswered
0
Accuracy
36.4%
Average
78.6%
Psychiatry
Correct
5
Incorrect
3
Unanswered
0
Accuracy
62.5%
Average
87.9%
Pulmonology
Correct
7
Incorrect
8
Unanswered
1
Accuracy
43.8%
Average
82.8%
Radiology-Emergency
Correct
5
Incorrect
8
Unanswered
0
Accuracy
38.5%
Average
67.7%
Rheumatology
Correct
4
Incorrect
7
Unanswered
0
Accuracy
36.4%
Average
88.4%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Traumatology
Correct
6
Incorrect
4
Unanswered
1
Accuracy
54.5%
Average
65.2%
Urology
Correct
4
Incorrect
3
Unanswered
1
Accuracy
50.0%
Average
82.5%

Question Type Breakdown

Anatomy
Correct
2
Incorrect
1
Unanswered
0
Accuracy
66.7%
Average
82.6%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
83.8%
Diagnosis
Correct
32
Incorrect
43
Unanswered
6
Accuracy
39.5%
Average
82.2%
Epidemiology
Correct
4
Incorrect
5
Unanswered
0
Accuracy
44.4%
Average
88.7%
Ethics
Correct
5
Incorrect
1
Unanswered
0
Accuracy
83.3%
Average
92.0%
Interpretation
Correct
11
Incorrect
21
Unanswered
5
Accuracy
29.7%
Average
72.0%
Legal
Correct
4
Incorrect
4
Unanswered
1
Accuracy
44.4%
Average
82.4%
Pathophysiology
Correct
17
Incorrect
9
Unanswered
0
Accuracy
65.4%
Average
84.3%
Pharmacology
Correct
6
Incorrect
8
Unanswered
1
Accuracy
40.0%
Average
82.3%
Prevention
Correct
6
Incorrect
9
Unanswered
1
Accuracy
37.5%
Average
80.6%
Prognosis
Correct
5
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
93.2%
Risk
Correct
8
Incorrect
6
Unanswered
1
Accuracy
53.3%
Average
84.3%
Tests
Correct
14
Incorrect
15
Unanswered
4
Accuracy
42.4%
Average
80.3%
Treatment
Correct
37
Incorrect
32
Unanswered
3
Accuracy
51.4%
Average
80.1%
#AnswerCorrectStatus
1AA
2BB
3AD
4AD
5BB
6DC
7AB
8D
9DD
10AA
11CB
12CA
13AAnnulled
14BC
15A
16CC
17CC
18AD
19DB
20CB
21BB
22BC
23AB
24CA
25CC
26DA
27AB
28D
29AA
30BD
31DC
32CC
33DB
34AB
35DC
36DD
37CD
38BA
39C
40AA
41D
42BA
43BB
44BB
45BB
46BB
47DD
48CC
49CC
50AAnnulled
51DA
52CC
53CC
54BC
55BA
56CA
57A
58BA
59BB
60AB
61CC
62BB
63AB
64CAnnulled
65CC
66DC
67CC
68AA
69BB
70BB
71AB
72BB
73AB
74AA
75CC
76CC
77DA
78CD
79AA
80AD
81BC
82CD
83BB
84A
85DD
86AA
87BB
88AB
89DB
90CC
91A
92BC
93DD
94AC
95CC
96BB
97AB
98AA
99BB
100AC
101CC
102AA
103CC
104CC
105CC
106AB
107AC
108BA
109C
110AC
111AB
112AC
113DC
114DD
115AB
116DD
117AC
118B
119DA
120AA
121BC
122BB
123BB
124AB
125CC
126BB
127C
128BB
129BC
130CC
131BB
132AB
133BC
134BB
135CC
136DB
137AD
138B
139CAnnulled
140BD
141AA
142DAnnulled
143BA
144DD
145DC
146CC
147DB
148AC
149BB
150CB
151B
152CC
153CC
154DD
155BB
156BA
157DD
158BB
159BC
160AA
161CAnnulled
162AA
163AC
164BC
165AA
166AA
167DD
168CC
169BB
170AB
171AA
172BB
173DD
174BC
175BB
176DA
177AD
178BD
179BB
180BC
181BB
182AC
183BD
184AD
185AB
186DD
187DD
188DC
189CC
190AB
191DD
192BD
193CC
194CC
195AD
196DA
197BC
198AA
199CB
200DD
201CC
202BA
203DA
204CC
205BB
206CC
207A
208AAnnulled
209AB
210CC