Replicate
Replicate
Frontier

Llama 3.1 405B (Rep)

Serverless

Largest dense Llama. Used as a quality benchmark for open weights, heavy to run, often hosted via Together / DeepInfra / Cerebras.

Llama 3.1 405B (Rep) is a frontier AI model from Replicate. It costs $9.500 per million input tokens and $9.500 per million output tokens (blended $9.500/M), with a 128,000-token context window.

Profile inherited from upstream Llama 3.1 405B ↗ — this is a hosted variant of the same open-weights model.

INPUT
$9.500/M
per million input tokens
OUTPUT
$9.500/M
per million output tokens
BLENDED 70/30
$9.500/M
unchanged since 3 May
CONTEXT
128,000
tokens
What it is good at
  • Top open-weights quality
  • Permissive license
  • Strong reasoning
Typical use cases
  • Open-weights quality ceiling
  • Synthetic data generation
  • Distillation source

Benchmarks

vs. best public score
Scores inherited from Llama 3.1 405B — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU88%
Multitask academic knowledge across 57 subjects.
Graduate-level science questions, "Google-proof".
MATH73%
High-school competition math problems.
Python function synthesis from docstrings.
LMArena Elo1290 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from Replicate

See all 5 →

Frequently asked questions

How much does Llama 3.1 405B (Rep) cost?

Llama 3.1 405B (Rep) costs $9.500 per million input tokens and $9.500 per million output tokens, for a blended reference rate of $9.500 per million tokens.

What is Llama 3.1 405B (Rep)'s context window?

Llama 3.1 405B (Rep) supports up to 128,000 tokens of context in a single request.

What is Llama 3.1 405B (Rep) best for?

Llama 3.1 405B (Rep) is well suited to Top open-weights quality, Permissive license and Strong reasoning.

Who makes Llama 3.1 405B (Rep)?

Llama 3.1 405B (Rep) is developed and served by Replicate.

Terms used on this page