Beta version: *Information might not be fully accurate. Please report any discrepancies.

CodeSimpleQA

codesimpleqaAgents & ToolsHigher is better

Short-form coding QA with executable correctness checks.

Loading chart…

Loading leaderboard…

Benchmark Info

Current SOTA

Median Score59.6%

DistributionClustered

Score Distribution

P10

P50

P90

0100%

AgentBench

agentbench

IFEval

ifeval

Inverse IFEval

ifeval-inverse

IFBench

ifbench

Verified AdvancedIF

verified-advancedif

MultiChallenge

multichallenge