MMLU (5-shot)Knowledge
75*/ 100
Verified
Last Verified: Unknown DateArtificial Analysis (Independent)
Massive Multitask Language Understanding covers 57 subjects across STEM, the humanities, social sciences, and more.
Beta version: *Information might not be fully accurate. Please report any discrepancies.
Latest Data
Unknown
Context Window
4k
tokens
Input Cost
Free
per 1M tokens
Output Cost
Free
per 1M tokens
Parameters
480B MoE (17B active)
model footprint
Performance Analysis // Verified Benchmarks
Massive Multitask Language Understanding covers 57 subjects across STEM, the humanities, social sciences, and more.
Functional correctness of synthesized programs from docstrings.
Chatbot Arena ELO score. Crowd-sourced human preference ranking.