MedicalBenchmark
NeverSleep: Lumimaid v0.2 8B provider

Lumimaid v0.2 8B

306

#306 of 319 models in the general ranking

Cumulative performance across 3 MIR exams

Net score

117.66 pts

Accuracy

38.7%

Correct / Incorrect

232 / 343

Total Cost

$0.13

Overall Performance

(vs. average)
Accuracy

38.7%

avg: 80.6%

Net score

117.66 pts

avg: 453.30 pts

Correct

232

avg: 483

Incorrect

343

avg: 90

Total Cost

$0.13

avg: $9.58

Average response time

4.2s

avg: 17.9s

Output Tokens

179K

avg: 1.3M

Reasoning Tokens

0

avg: 898K

Average confidence

94.6%

avg: 95.4%

Breakdown by Exam

MIR 2024
304
Correct
77
Incorrect
111
Accuracy
38.5%
Net score
40.00
MIR 2025
306
Correct
69
Incorrect
125
Accuracy
34.5%
Net score
27.33
MIR 2026
308
Correct
86
Incorrect
107
Accuracy
43.0%
Net score
50.33