GroqEfficient

Llama 3.1 70B (Groq)

Name: Llama 3.1 70B (Groq)
Brand: Groq
Price: 0.590000 USD

Fast

The 2024 70B Llama that defined the open-weights chat baseline before Llama 3.3. Still common where hosts haven't upgraded yet.

Llama 3.1 70B (Groq) is a efficient AI model from Groq. It costs $0.590 per million input tokens and $0.790 per million output tokens (blended $0.650/M), with a 128,000-token context window.

Profile inherited from upstream Llama 3.1 70B ↗ — this is a hosted variant of the same open-weights model.

Released Jul 2024Modalities textOfficial model page ↗Provider pricing ↗API docs ↗Compare with another model →Estimate monthly cost →

INPUT

$0.590/M

per million input tokens

OUTPUT

$0.790/M

per million output tokens

BLENDED 70/30

$0.650/M

unchanged since 3 May

default reference rate · how it is calculated →

CONTEXT

128,000

tokens

What it is good at

Open weights
128K context
Wide hosted availability

Typical use cases

Self-hosted chat
Fine-tune base
Cost benchmarking

Benchmarks

vs. best public score

Scores inherited from Llama 3.1 70B — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.

MMLU83%

Multitask academic knowledge across 57 subjects.

GPQA Diamond47%

Graduate-level science questions, "Google-proof".

MATH68%

High-school competition math problems.

HumanEval80%

Python function synthesis from docstrings.

LMArena Elo1248 Elo

Crowd-sourced head-to-head preference Elo rating.

Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from Groq

See all 11 →

Llama 3.3 70B (Groq)

Ultra-Fast · 128,000 ctx

in $0.590/Mout $0.790/M

Llama 3.1 405B (Groq)

Fast Large · 128,000 ctx

in $2.990/Mout $2.990/M

Llama 3.1 8B (Groq)

Fast Nano · 128,000 ctx

in $0.050/Mout $0.080/M

Llama 3.2 11B Vision (Groq)

Fast Vision · 128,000 ctx

in $0.180/Mout $0.180/M

Llama 3.2 3B (Groq)

Fast Micro · 128,000 ctx

in $0.060/Mout $0.060/M

Mixtral 8x7B (Groq)

Fast MoE · 32,000 ctx

in $0.240/Mout $0.240/M

Frequently asked questions

How much does Llama 3.1 70B (Groq) cost?

Llama 3.1 70B (Groq) costs $0.590 per million input tokens and $0.790 per million output tokens, for a blended reference rate of $0.650 per million tokens.

What is Llama 3.1 70B (Groq)'s context window?

Llama 3.1 70B (Groq) supports up to 128,000 tokens of context in a single request.

What is Llama 3.1 70B (Groq) best for?

Llama 3.1 70B (Groq) is well suited to Open weights, 128K context and Wide hosted availability.

Who makes Llama 3.1 70B (Groq)?

Llama 3.1 70B (Groq) is developed and served by Groq. It was released in Jul 2024.

Terms used on this page

Full glossary →

Token Input tokens Output tokens Price per million tokens Context window Prompt caching Batch API Blended cost