Groq
Groq
Frontier

Llama 3.1 405B (Groq)

Fast Large

Largest dense Llama. Used as a quality benchmark for open weights, heavy to run, often hosted via Together / DeepInfra / Cerebras.

Llama 3.1 405B (Groq) is a frontier AI model from Groq. It costs $2.990 per million input tokens and $2.990 per million output tokens (blended $2.990/M), with a 128,000-token context window.

Profile inherited from upstream Llama 3.1 405B ↗ — this is a hosted variant of the same open-weights model.

INPUT
$2.990/M
per million input tokens
OUTPUT
$2.990/M
per million output tokens
BLENDED 70/30
$2.990/M
unchanged since 3 May
CONTEXT
128,000
tokens
What it is good at
  • Top open-weights quality
  • Permissive license
  • Strong reasoning
Typical use cases
  • Open-weights quality ceiling
  • Synthetic data generation
  • Distillation source

Benchmarks

vs. best public score
Scores inherited from Llama 3.1 405B — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU88%
Multitask academic knowledge across 57 subjects.
Graduate-level science questions, "Google-proof".
MATH73%
High-school competition math problems.
Python function synthesis from docstrings.
LMArena Elo1290 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from Groq

See all 11 →

Frequently asked questions

How much does Llama 3.1 405B (Groq) cost?

Llama 3.1 405B (Groq) costs $2.990 per million input tokens and $2.990 per million output tokens, for a blended reference rate of $2.990 per million tokens.

What is Llama 3.1 405B (Groq)'s context window?

Llama 3.1 405B (Groq) supports up to 128,000 tokens of context in a single request.

What is Llama 3.1 405B (Groq) best for?

Llama 3.1 405B (Groq) is well suited to Top open-weights quality, Permissive license and Strong reasoning.

Who makes Llama 3.1 405B (Groq)?

Llama 3.1 405B (Groq) is developed and served by Groq.

Terms used on this page