Claude Fable 5$22.000/MClaude Opus 4.8$11.000/MClaude Opus 4.7$11.000/MClaude Opus 4.6$11.000/MClaude Opus 4.5$33.000/MClaude Sonnet 3.7$6.600/MClaude Opus 3$33.000/MClaude 2.1$12.800/MClaude 2$12.800/MGPT-5.5$12.500/MGPT-5.2$5.425/MGPT-5.2-Codex$5.425/MGPT-5$3.875/MGPT-4.5$97.500/MGPT-4 Turbo Preview$16.000/MGPT-4$39.000/MGPT-4-32k$78.000/Mo3$19.000/Mo3-mini$2.090/Mo4-mini$2.090/Mo1$28.500/Mo1-mini$5.700/Mo1-preview$28.500/MGemini 3.5 Pro$5.000/MGemini 3.1 Pro$5.000/MGemini 3 Pro$5.000/MGemini 2.5 Pro$3.875/MGemini 1.5 Pro$2.375/MGemini 1.0 Ultra$12.000/MGemini 1.0 Pro$0.800/MClaude Fable 5$22.000/MClaude Opus 4.8$11.000/MClaude Opus 4.7$11.000/MClaude Opus 4.6$11.000/MClaude Opus 4.5$33.000/MClaude Sonnet 3.7$6.600/MClaude Opus 3$33.000/MClaude 2.1$12.800/MClaude 2$12.800/MGPT-5.5$12.500/MGPT-5.2$5.425/MGPT-5.2-Codex$5.425/MGPT-5$3.875/MGPT-4.5$97.500/MGPT-4 Turbo Preview$16.000/MGPT-4$39.000/MGPT-4-32k$78.000/Mo3$19.000/Mo3-mini$2.090/Mo4-mini$2.090/Mo1$28.500/Mo1-mini$5.700/Mo1-preview$28.500/MGemini 3.5 Pro$5.000/MGemini 3.1 Pro$5.000/MGemini 3 Pro$5.000/MGemini 2.5 Pro$3.875/MGemini 1.5 Pro$2.375/MGemini 1.0 Ultra$12.000/MGemini 1.0 Pro$0.800/M
BETA
Subscribe
← Back to Index·All Nvidia models
Nvidia
NvidiaFrontier

Llama-3.1-Nemotron-70B

RLHF-Aligned

NVIDIA's instruction-tuned Llama 3.1 70B. RLHF'd on top of Meta's base; consistently outranks vanilla 3.1 70B on chat benchmarks.

Llama-3.1-Nemotron-70B is a frontier AI model from Nvidia. It costs $0.350 per million input tokens and $0.400 per million output tokens (blended $0.365/M), with a 128K-token context window.

Released Oct 2024Modalities textOfficial model page ↗API docs ↗Compare with another model →Estimate monthly cost →
INPUT
$0.350/M
per million input tokens
OUTPUT
$0.400/M
per million output tokens
BLENDED 70/30
$0.365/M
default reference rate · how it's calculated →
CONTEXT
128K
128,000 tokens
What it's good at
  • Improved over base Llama 3.1 70B
  • NVIDIA NIM endpoints
  • Open weights
Typical use cases
  • Self-hosted chat (Llama-class)
  • NIM-based deployments
  • Fine-tune base
Benchmarks
vs. best public score
MMLU85%
Multitask academic knowledge across 57 subjects.
GPQA Diamond49%
Graduate-level science questions, "Google-proof".
MATH72%
High-school competition math problems.
HumanEval75%
Python function synthesis from docstrings.
LMArena Elo1267 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources — treat as directional rather than authoritative.
More from Nvidia
See all 6 →
Llama-3.1-Nemotron-Ultra-253B
Ultra · 128K ctx
in $1.600/Mout $1.600/M
Nemotron-4-340B
Large · 4K ctx
in $4.200/Mout $4.200/M
Mistral-NeMo-12B (NIM)
Efficient · 128K ctx
in $0.150/Mout $0.150/M
Phi-3-Mini-4K (NIM)
Nano · 4K ctx
in $0.040/Mout $0.040/M
Mistral-Large-2 (NIM)
Enterprise · 128K ctx
in $2.000/Mout $6.000/M
Frequently asked questions

How much does Llama-3.1-Nemotron-70B cost?

Llama-3.1-Nemotron-70B costs $0.350 per million input tokens and $0.400 per million output tokens, for a blended reference rate of $0.365 per million tokens.

What is Llama-3.1-Nemotron-70B's context window?

Llama-3.1-Nemotron-70B supports up to 128K tokens of context (128,000 tokens).

What is Llama-3.1-Nemotron-70B best for?

Llama-3.1-Nemotron-70B is well suited to Improved over base Llama 3.1 70B, NVIDIA NIM endpoints and Open weights.

Who makes Llama-3.1-Nemotron-70B?

Llama-3.1-Nemotron-70B is developed and served by Nvidia. It was released in Oct 2024.