Llama 3.1 8B Instruct
Small, fast Llama 3.1. The default cheap open-weights model in 2024–25 across Groq, Cerebras and Together.
Llama 3.1 8B Instruct is a efficient AI model from Meta. It costs $0.050 per million input tokens and $0.080 per million output tokens (blended $0.059/M), with a 131,072-token context window.
Profile inherited from upstream Llama 3.1 8B ↗ — this is a hosted variant of the same open-weights model.
- Cheap
- Fast on LPU/Cerebras
- Open weights
- 128K context
- Bulk classification
- Cheap chat
- Edge inference
Benchmarks
More from Meta
See all 20 →Frequently asked questions
How much does Llama 3.1 8B Instruct cost?
Llama 3.1 8B Instruct costs $0.050 per million input tokens and $0.080 per million output tokens, for a blended reference rate of $0.059 per million tokens.
What is Llama 3.1 8B Instruct's context window?
Llama 3.1 8B Instruct supports up to 131,072 tokens of context in a single request.
What is Llama 3.1 8B Instruct best for?
Llama 3.1 8B Instruct is well suited to Cheap, Fast on LPU/Cerebras and Open weights.
Who makes Llama 3.1 8B Instruct?
Llama 3.1 8B Instruct is developed and served by Meta. It was released in Jul 2024.