Beta version: *Information might not be fully accurate. Please report any discrepancies.

SciCode

scicodeIntelligenceHigher is better

Scientific programming benchmark for code synthesis and correctness.

Loading chart…

Loading leaderboard…

Benchmark Info

Current SOTA

Best Open Source

Median Score42.8%

DistributionClustered

Score Distribution

P10

P50

P90

0100%

LiveBench

livebench

MMLU-Pro

mmlu-pro

HLE

hle

HLE-Full

hle-full

HLE-Full (w/ tools)

hle-full-tools

CritPt

critpt