MMLU Leaderboard
Multitask academic knowledge across 57 subjects. · Prices checked November 11, 2026
MMLU tests multiple-choice knowledge across 57 subjects, from elementary mathematics to professional law. It was the standard general-capability benchmark for years and remains a useful breadth check.
Leaderboard
60 of 195 scoredLeaderboardScores as published by each benchmark. Prices checked November 11, 2026.
o3 leads on MMLU at 92.9%. The median across the 195 models we hold a score for is 79%. The cheapest model on this board is Llama 3.3 70B at $0.2810/M blended, scoring 86%.
| # | Model | Provider | Score | Input /1M | Output /1M | Blended 70/30 | Context |
|---|---|---|---|---|---|---|---|
| 1 | o3 | OpenAI | 92.9% | $2.00 | $8.00 | $3.80 | 200,000 |
| 2 | o1 | OpenAI | 91.8% | $15.00 | $60.00 | $28.50 | 200,000 |
| 3 | GPT-5 | OpenAI | 91% | $1.25 | $10.00 | $3.88 | 400,000 |
| 4 | DeepSeek-R1 | DeepSeek | 90.8% | $0.5500 | $2.19 | $1.04 | 64,000 |
| 5 | DeepSeek-R1 (Groq) | Groq | 90.8% | $0.7500 | $0.9900 | $0.8220 | 128,000 |
| 6 | DeepSeek-R1 (Together) | Together AI | 90.8% | $3.00 | $7.00 | $4.20 | 64,000 |
| 7 | DeepSeek-R1 (fw) | Fireworks AI | 90.8% | $3.00 | $8.00 | $4.50 | 64,000 |
| 8 | DeepSeek-R1 (DI) | DeepInfra | 90.8% | $0.5500 | $2.19 | $1.04 | 64,000 |
| 9 | DeepSeek-R1 (Cerebras) | Cerebras | 90.8% | $0.5500 | $0.9900 | $0.6820 | 64,000 |
| 10 | GPT-4.1 | OpenAI | 90.2% | $2.00 | $8.00 | $3.80 | 1,000,000 |
| 11 | o4-mini | OpenAI | 90% | $1.10 | $4.40 | $2.09 | 200,000 |
| 12 | DeepSeek-R1-0528 | DeepSeek | 90% | $0.5500 | $2.19 | $1.04 | 64,000 |
| 13 | Claude Sonnet 3.5 | Anthropic | 89.3% | $3.00 | $15.00 | $6.60 | 200,000 |
| 14 | GPT-4o | OpenAI | 88.7% | $2.50 | $10.00 | $4.75 | 128,000 |
| 15 | Llama 3.1 405B | Meta | 88.6% | $0.8000 | $0.8000 | $0.8000 | 128,000 |
| 16 | Llama 3.1 405B (Groq) | Groq | 88.6% | $2.99 | $2.99 | $2.99 | 128,000 |
| 17 | Llama 3.1 405B (Together) | Together AI | 88.6% | $3.50 | $3.50 | $3.50 | 128,000 |
| 18 | Llama 3.1 405B (fw) | Fireworks AI | 88.6% | $3.00 | $3.00 | $3.00 | 131,000 |
| 19 | Llama 3.1 405B (Rep) | Replicate | 88.6% | $9.50 | $9.50 | $9.50 | 128,000 |
| 20 | Llama 3.1 405B (DI) | DeepInfra | 88.6% | $0.8000 | $0.8000 | $0.8000 | 128,000 |
| 21 | Llama-3.1-405B (Cerebras) | Cerebras | 88.6% | $0.9900 | $0.9900 | $0.9900 | 128,000 |
| 22 | Llama 3.1 405B (Hyp) | Hyperbolic | 88.6% | $4.00 | $4.00 | $4.00 | 128,000 |
| 23 | DeepSeek-V3 | DeepSeek | 88.5% | $0.3200 | $0.8900 | $0.4910 | 64,000 |
| 24 | Claude Opus 4.6 | Anthropic | 88% | $5.00 | $25.00 | $11.00 | 1,000,000 |
| 25 | DeepSeek-V3-0324 | DeepSeek | 88% | $0.2900 | $1.14 | $0.5450 | 128,000 |
| 26 | Nova Premier | Amazon | 88% | $2.50 | $12.50 | $5.50 | 300,000 |
| 27 | Sonar Reasoning Pro | Perplexity | 88% | $2.00 | $8.00 | $3.80 | 127,000 |
| 28 | Llama-3.1-Nemotron-Ultra-253B | Nvidia | 88% | $1.60 | $1.60 | $1.60 | 128,000 |
| 29 | GPT-4.1 mini | OpenAI | 87.5% | $0.4000 | $1.60 | $0.7600 | 1,000,000 |
| 30 | Grok 2 | xAI | 87.5% | $2.00 | $10.00 | $4.40 | 131,000 |
| 31 | Grok 2 Vision | xAI | 87.5% | $2.00 | $10.00 | $4.40 | 32,000 |
| 32 | Kimi k1.5 | Moonshot AI | 87.4% | $2.50 | $10.00 | $4.75 | 128,000 |
| 33 | Claude Opus 4.5 | Anthropic | 87% | $5.00 | $25.00 | $11.00 | 200,000 |
| 34 | Sonar Deep Research | Perplexity | 87% | $2.00 | $8.00 | $3.80 | 127,000 |
| 35 | Qwen2.5-Max | Qwen | 87% | $1.60 | $6.40 | $3.04 | 32,000 |
| 36 | GPT-4 Turbo | OpenAI | 86.7% | $10.00 | $30.00 | $16.00 | 128,000 |
| 37 | Qwen2.5-72B (Groq) | Groq | 86.1% | $0.7900 | $0.7900 | $0.7900 | 128,000 |
| 38 | Qwen2.5-72B (Together) | Together AI | 86.1% | $1.20 | $1.20 | $1.20 | 32,000 |
| 39 | Qwen2.5-72B (fw) | Fireworks AI | 86.1% | $0.9000 | $0.9000 | $0.9000 | 32,000 |
| 40 | Qwen2.5-72B (DI) | DeepInfra | 86.1% | $0.3500 | $0.4000 | $0.3650 | 128,000 |
| 41 | Qwen2.5-72B (Hyp) | Hyperbolic | 86.1% | $0.4000 | $0.4000 | $0.4000 | 128,000 |
| 42 | Qwen2.5-72B-Instruct | Qwen | 86.1% | $0.3600 | $0.4000 | $0.3720 | 128,000 |
| 43 | Claude Sonnet 4.6 | Anthropic | 86% | $3.00 | $15.00 | $6.60 | 1,000,000 |
| 44 | Gemini 1.5 Pro | 86% | $1.25 | $5.00 | $2.38 | 2,000,000 | |
| 45 | Grok 3 | xAI | 86% | $3.00 | $15.00 | $6.60 | 131,000 |
| 46 | Grok 3 Fast | xAI | 86% | $5.00 | $25.00 | $11.00 | 131,000 |
| 47 | Llama 3.3 70B | Meta | 86% | $0.2300 | $0.4000 | $0.2810 | 128,000 |
| 48 | Llama 3.1 70B | Meta | 86% | $0.3500 | $0.4000 | $0.3650 | 128,000 |
| 49 | Llama 3.2 90B Vision | Meta | 86% | $0.8800 | $0.8800 | $0.8800 | 128,000 |
| 50 | Nova Pro | Amazon | 86% | $0.8000 | $3.20 | $1.52 | 300,000 |
| 51 | Sonar Pro | Perplexity | 86% | $3.00 | $15.00 | $6.60 | 200,000 |
| 52 | Llama 3.3 70B (Groq) | Groq | 86% | $0.5900 | $0.7900 | $0.6500 | 128,000 |
| 53 | Llama 3.1 70B (Groq) | Groq | 86% | $0.5900 | $0.7900 | $0.6500 | 128,000 |
| 54 | Llama 3.3 70B (Together) | Together AI | 86% | $0.8800 | $0.8800 | $0.8800 | 128,000 |
| 55 | Llama 3.3 70B (DI) | DeepInfra | 86% | $0.2300 | $0.4000 | $0.2810 | 128,000 |
| 56 | Llama 3.1 70B (DI) | DeepInfra | 86% | $0.3500 | $0.4000 | $0.3650 | 128,000 |
| 57 | Llama-3.3-70B (Cerebras) | Cerebras | 86% | $0.5900 | $0.9900 | $0.7100 | 128,000 |
| 58 | Llama 3.1 70B (Hyp) | Hyperbolic | 86% | $0.4000 | $0.4000 | $0.4000 | 128,000 |
| 59 | Hermes-3-70B (Hyp) | Hyperbolic | 86% | $0.4000 | $0.4000 | $0.4000 | 128,000 |
| 60 | Llama 3.1 70B (Anyscale) | Anyscale | 86% | $1.00 | $1.00 | $1.00 | 128,000 |
43 of the 60 scores shown link to the page they were read on (underlined; hover for publisher, variant and date read). The rest have no recorded source yet and are being worked through.
It is now close to saturated at the top: the strongest models cluster within a few points of each other, so small differences here mean much less than they did when the benchmark was new.
About these scores
- Multitask academic knowledge across 57 subjects.
- Scores are as published by the model’s provider or a public leaderboard. Provider-reported figures are self-reported and are not independently re-run by us.
- Where a hosted variant of an open-weights model has no score of its own, it inherits the base model’s, because the weights are the same.
- Prices beside each score are the provider’s published token rates. How the blended rate is calculated.
Showing the top 60 of 195 models we hold a MMLU score for.
Frequently asked questions
What is a good MMLU score?
Frontier models now sit in the high eighties and above, and the spread between them is only a few points. Because the benchmark is close to saturated at that level, MMLU is better used as a floor check (confirming broad competence) than as a way to separate the leading models from each other.
Is MMLU still a useful benchmark?
For breadth, yes; for ranking frontier models, less so. Its multiple-choice format rewards recall over reasoning, and top scores are bunched. GPQA Diamond and SWE-bench Verified separate the strongest models far more clearly.
Other leaderboards
Rankings that weigh price too
Leaderboards are recomputed on every deploy from the catalogue. Prices checked November 11, 2026.
