Beta version: *Information might not be fully accurate. Please report any discrepancies.

MLE-Bench Lite

mle-bench-liteCodingHigher is better

Lite version of machine learning engineering benchmark measuring medal rate.

Loading chart…

Loading leaderboard…

Benchmark Info

Current SOTA

Best Open Source

Median Score66.6%

DistributionLimited data

Score Distribution

P10

P50

P90

0100%

HumanEval

human-eval

SWE-bench Verified

swe-bench-verified

BigCodeBench

bigcodebench

OJBench (Python)

ojbench-python

Codeforces

codeforces

LiveCodeBench v6

livecodebench-v6