MMLU (5-shot)Knowledge
86.5/ 100
Verified
Last Verified: Unknown DateAI21
Massive Multitask Language Understanding covers 57 subjects across STEM, the humanities, social sciences, and more.
Beta version: *Information might not be fully accurate. Please report any discrepancies.
Latest Data
Unknown
Context Window
256k
tokens
Input Cost
$2.00
per 1M tokens
Output Cost
$8.00
per 1M tokens
Parameters
399B (Hybrid SSM/Transformer)
model footprint
Performance Analysis // Verified Benchmarks
Massive Multitask Language Understanding covers 57 subjects across STEM, the humanities, social sciences, and more.
Grade school math word problems requiring multi-step reasoning.