MMLU (5-shot)Knowledge
84.5/ 100
Verified
Last Verified: Unknown DateByteDance Seed
Massive Multitask Language Understanding covers 57 subjects across STEM, the humanities, social sciences, and more.
Beta version: *Information might not be fully accurate. Please report any discrepancies.
Latest Data
Unknown
Context Window
128k
tokens
Input Cost
$0.10
per 1M tokens
Output Cost
$0.50
per 1M tokens
Parameters
Unknown
model footprint
Performance Analysis // Verified Benchmarks
Massive Multitask Language Understanding covers 57 subjects across STEM, the humanities, social sciences, and more.
Challenging competition mathematics problems (AIME/IMO level).
Multi-discipline Multimodal Understanding and Reasoning.