Replicate
Replicate
Efficient

Llama 3 8B (Rep)

Compact

Original 8B Llama 3. Used widely as a fine-tune base before 3.1/3.2 arrived.

Llama 3 8B (Rep) is a efficient AI model from Replicate. It costs $0.050 per million input tokens and $0.250 per million output tokens (blended $0.110/M), with a 8,000-token context window.

Profile inherited from upstream Llama 3 8B ↗ — this is a hosted variant of the same open-weights model.

INPUT
$0.050/M
per million input tokens
OUTPUT
$0.250/M
per million output tokens
BLENDED 70/30
$0.110/M
unchanged since 3 May
CONTEXT
8,000
tokens
What it is good at
  • Open weights
  • Single-GPU friendly
  • Fine-tune ecosystem
Typical use cases
  • Fine-tune base
  • Legacy Llama 3 deployments

Benchmarks

vs. best public score
Scores inherited from Llama 3 8B — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU68%
Multitask academic knowledge across 57 subjects.
Graduate-level science questions, "Google-proof".
MATH30%
High-school competition math problems.
Python function synthesis from docstrings.
LMArena Elo1152 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from Replicate

See all 5 →

Frequently asked questions

How much does Llama 3 8B (Rep) cost?

Llama 3 8B (Rep) costs $0.050 per million input tokens and $0.250 per million output tokens, for a blended reference rate of $0.110 per million tokens.

What is Llama 3 8B (Rep)'s context window?

Llama 3 8B (Rep) supports up to 8,000 tokens of context in a single request.

What is Llama 3 8B (Rep) best for?

Llama 3 8B (Rep) is well suited to Open weights, Single-GPU friendly and Fine-tune ecosystem.

Who makes Llama 3 8B (Rep)?

Llama 3 8B (Rep) is developed and served by Replicate. It was released in Apr 2024.

Terms used on this page