Beta version: *Information might not be fully accurate. Please report any discrepancies.

SimpleQA Verified

simpleqa-verifiedKnowledge & CommunicationHigher is better

Verified subset of SimpleQA for parametric knowledge evaluation.

Loading chart…

Loading leaderboard…

Benchmark Info

Current SOTA

Median Score38.0%

DistributionBalanced

Score Distribution

P10

P50

P90

0100%

MMLU (5-shot)

mmlu

LMArena ELO

lmarena-elo

AA Intelligence Index

aa-intelligence-index

MMMLU

mmmlu

Global PIQA

global-piqa