MMLU81%
Multitask academic knowledge across 57 subjects.
GPQA Diamond60%
Graduate-level science questions, "Google-proof".
MATH78%
High-school competition math problems.
HumanEval84%
Python function synthesis from docstrings.
SWE-bench Verified40%
Real GitHub issues solved end-to-end.
LMArena Elo1290 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources — treat as directional rather than authoritative.