MedicalBenchmark
LiquidAI: LFM2-24B-A2B provider

LFM2-24B-A2B

266

#266 of 319 modelsMIR 2026

Net score

117.00 pts

Accuracy

68.0%

Correct / Incorrect

136 / 57

Total Cost

$0.02

Overall Performance

(vs. average)
Accuracy

68.0%

avg: 82.4%

Net score

117.00 pts

avg: 156.14 pts

Correct

136

avg: 165

Incorrect

57

avg: 26

Total Cost

$0.02

avg: $3.12

Average response time

3.9s

avg: 17.4s

Output Tokens

125K

avg: 415K

Reasoning Tokens

0

avg: 295K

Average confidence

95.7%

avg: 95.4%

Subject Breakdown

Allergology
Correct
1
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
96.9%
Anesthesiology and Resuscitation
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
71.0%
Cardiology
Correct
14
Incorrect
10
Unanswered
1
Accuracy
56.0%
Average
78.4%
Dermatology
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
73.2%
Endocrinology and Nutrition
Correct
13
Incorrect
2
Unanswered
0
Accuracy
86.7%
Average
84.7%
ENT
Correct
6
Incorrect
1
Unanswered
1
Accuracy
75.0%
Average
85.0%
Epidemiology
Correct
3
Incorrect
4
Unanswered
0
Accuracy
42.9%
Average
81.3%
Gastroenterology
Correct
22
Incorrect
8
Unanswered
0
Accuracy
73.3%
Average
80.2%
Genetics
Correct
6
Incorrect
5
Unanswered
0
Accuracy
54.5%
Average
79.7%
Geriatrics
Correct
10
Incorrect
3
Unanswered
0
Accuracy
76.9%
Average
83.7%
Gynecology and Obstetrics
Correct
9
Incorrect
2
Unanswered
1
Accuracy
75.0%
Average
85.2%
Health Planning and Management
Correct
5
Incorrect
4
Unanswered
1
Accuracy
50.0%
Average
79.4%
Hematology
Correct
6
Incorrect
3
Unanswered
0
Accuracy
66.7%
Average
77.6%
Immunology
Correct
6
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
91.8%
Infectious Diseases
Correct
8
Incorrect
5
Unanswered
1
Accuracy
57.1%
Average
79.0%
Legal Medicine and Bioethics
Correct
7
Incorrect
4
Unanswered
0
Accuracy
63.6%
Average
83.4%
Medical Oncology
Correct
18
Incorrect
4
Unanswered
1
Accuracy
78.3%
Average
83.7%
Nephrology
Correct
8
Incorrect
2
Unanswered
0
Accuracy
80.0%
Average
85.6%
Neurology
Correct
9
Incorrect
2
Unanswered
2
Accuracy
69.2%
Average
89.0%
Ophthalmology
Correct
3
Incorrect
2
Unanswered
0
Accuracy
60.0%
Average
84.5%
Palliative Care
Correct
4
Incorrect
2
Unanswered
0
Accuracy
66.7%
Average
80.8%
Pediatrics
Correct
17
Incorrect
4
Unanswered
1
Accuracy
77.3%
Average
88.1%
Pharmacology
Correct
8
Incorrect
3
Unanswered
0
Accuracy
72.7%
Average
79.6%
Psychiatry
Correct
7
Incorrect
1
Unanswered
0
Accuracy
87.5%
Average
88.4%
Pulmonology
Correct
12
Incorrect
4
Unanswered
0
Accuracy
75.0%
Average
83.6%
Radiology-Emergency
Correct
6
Incorrect
7
Unanswered
0
Accuracy
46.2%
Average
69.4%
Rheumatology
Correct
9
Incorrect
0
Unanswered
2
Accuracy
81.8%
Average
89.0%
Statistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
84.5%
Traumatology
Correct
5
Incorrect
6
Unanswered
0
Accuracy
45.5%
Average
66.6%
Urology
Correct
5
Incorrect
3
Unanswered
0
Accuracy
62.5%
Average
83.1%

Question Type Breakdown

Anatomy
Correct
1
Incorrect
2
Unanswered
0
Accuracy
33.3%
Average
83.4%
Biostatistics
Correct
1
Incorrect
1
Unanswered
0
Accuracy
50.0%
Average
84.5%
Diagnosis
Correct
56
Incorrect
22
Unanswered
3
Accuracy
69.1%
Average
83.0%
Epidemiology
Correct
6
Incorrect
3
Unanswered
0
Accuracy
66.7%
Average
89.1%
Ethics
Correct
6
Incorrect
0
Unanswered
0
Accuracy
100.0%
Average
92.2%
Interpretation
Correct
21
Incorrect
15
Unanswered
1
Accuracy
56.8%
Average
73.2%
Legal
Correct
6
Incorrect
3
Unanswered
0
Accuracy
66.7%
Average
82.9%
Pathophysiology
Correct
18
Incorrect
8
Unanswered
0
Accuracy
69.2%
Average
85.0%
Pharmacology
Correct
12
Incorrect
3
Unanswered
0
Accuracy
80.0%
Average
83.1%
Prevention
Correct
9
Incorrect
5
Unanswered
2
Accuracy
56.3%
Average
81.5%
Prognosis
Correct
3
Incorrect
0
Unanswered
2
Accuracy
60.0%
Average
93.2%
Risk
Correct
7
Incorrect
6
Unanswered
2
Accuracy
46.7%
Average
85.0%
Tests
Correct
22
Incorrect
10
Unanswered
1
Accuracy
66.7%
Average
81.2%
Treatment
Correct
52
Incorrect
19
Unanswered
1
Accuracy
72.2%
Average
80.9%
#AnswerCorrectStatus
1AA
2BB
3AD
4BD
5DB
6BC
7AB
8BD
9AD
10AA
11CB
12CA
13AAnnulled
14BC
15CA
16CC
17CC
18BD
19DB
20CB
21BB
22CC
23BB
24DA
25CC
26A
27DB
28DD
29AA
30BD
31CC
32CC
33DB
34DB
35CC
36DD
37CD
38AA
39BC
40DA
41DD
42A
43BB
44BB
45BB
46BB
47CD
48CC
49CC
50AAnnulled
51AA
52CC
53CC
54CC
55A
56BA
57AA
58AA
59AB
60BB
61CC
62BB
63BB
64CAnnulled
65DC
66DC
67CC
68AA
69BB
70BB
71DB
72BB
73BB
74AA
75CC
76CC
77CA
78DD
79A
80DD
81CC
82CD
83BB
84CA
85DD
86DA
87BB
88BB
89BB
90CC
91AA
92BC
93DD
94BC
95CC
96CB
97BB
98AA
99BB
100CC
101CC
102A
103CC
104CC
105BC
106AB
107CC
108AA
109BC
110CC
111BB
112CC
113CC
114DD
115BB
116AD
117CC
118DB
119DA
120AA
121CC
122BB
123DB
124BB
125CC
126BB
127CC
128CB
129CC
130CC
131BB
132AB
133CC
134BB
135CC
136BB
137CD
138BB
139AAnnulled
140DD
141AA
142BAnnulled
143AA
144DD
145AC
146BC
147BB
148CC
149BB
150BB
151BB
152CC
153CC
154DD
155BB
156BA
157DD
158BB
159BC
160AA
161CAnnulled
162AA
163CC
164C
165AA
166AA
167DD
168CC
169BB
170DB
171AA
172DB
173DD
174CC
175BB
176AA
177DD
178AD
179BB
180CC
181BB
182CC
183D
184DD
185DB
186DD
187DD
188CC
189CC
190BB
191DD
192BD
193CC
194CC
195DD
196AA
197CC
198BA
199AB
200CD
201CC
202AA
203AA
204CC
205BB
206CC
207AA
208DAnnulled
209BB
210CC