Claude Fable 5$22.000/MClaude Opus 4.8$11.000/MClaude Opus 4.7$11.000/MClaude Opus 4.6$11.000/MClaude Opus 4.5$33.000/MClaude Sonnet 3.7$6.600/MClaude Opus 3$33.000/MClaude 2.1$12.800/MClaude 2$12.800/MGPT-5.5$12.500/MGPT-5.2$5.425/MGPT-5.2-Codex$5.425/MGPT-5$3.875/MGPT-4.5$97.500/MGPT-4 Turbo Preview$16.000/MGPT-4$39.000/MGPT-4-32k$78.000/Mo3$19.000/Mo3-mini$2.090/Mo4-mini$2.090/Mo1$28.500/Mo1-mini$5.700/Mo1-preview$28.500/MGemini 3.5 Pro$5.000/MGemini 3.1 Pro$5.000/MGemini 3 Pro$5.000/MGemini 2.5 Pro$3.875/MGemini 1.5 Pro$2.375/MGemini 1.0 Ultra$12.000/MGemini 1.0 Pro$0.800/MClaude Fable 5$22.000/MClaude Opus 4.8$11.000/MClaude Opus 4.7$11.000/MClaude Opus 4.6$11.000/MClaude Opus 4.5$33.000/MClaude Sonnet 3.7$6.600/MClaude Opus 3$33.000/MClaude 2.1$12.800/MClaude 2$12.800/MGPT-5.5$12.500/MGPT-5.2$5.425/MGPT-5.2-Codex$5.425/MGPT-5$3.875/MGPT-4.5$97.500/MGPT-4 Turbo Preview$16.000/MGPT-4$39.000/MGPT-4-32k$78.000/Mo3$19.000/Mo3-mini$2.090/Mo4-mini$2.090/Mo1$28.500/Mo1-mini$5.700/Mo1-preview$28.500/MGemini 3.5 Pro$5.000/MGemini 3.1 Pro$5.000/MGemini 3 Pro$5.000/MGemini 2.5 Pro$3.875/MGemini 1.5 Pro$2.375/MGemini 1.0 Ultra$12.000/MGemini 1.0 Pro$0.800/M
BETA
Subscribe
← Back to Index·All Nvidia models
Nvidia
NvidiaFrontier

Nemotron-4-340B

Large

Nemotron-4 340B — NVIDIA's 2024 dense flagship. Designed primarily as a synthetic data generator for downstream training.

Nemotron-4-340B is a frontier AI model from Nvidia. It costs $4.200 per million input tokens and $4.200 per million output tokens (blended $4.200/M), with a 4K-token context window.

Released Jun 2024Modalities textOfficial model page ↗API docs ↗Compare with another model →Estimate monthly cost →
INPUT
$4.200/M
per million input tokens
OUTPUT
$4.200/M
per million output tokens
BLENDED 70/30
$4.200/M
default reference rate · how it's calculated →
CONTEXT
4K
4,000 tokens
What it's good at
  • 340B dense parameters
  • Synthetic data generation focus
  • Open weights
Typical use cases
  • Synthetic data pipelines
  • Distillation source
  • Quality-ceiling research
Benchmarks
vs. best public score
MMLU79%
Multitask academic knowledge across 57 subjects.
HumanEval73%
Python function synthesis from docstrings.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources — treat as directional rather than authoritative.
More from Nvidia
See all 6 →
Llama-3.1-Nemotron-70B
RLHF-Aligned · 128K ctx
in $0.350/Mout $0.400/M
Llama-3.1-Nemotron-Ultra-253B
Ultra · 128K ctx
in $1.600/Mout $1.600/M
Mistral-NeMo-12B (NIM)
Efficient · 128K ctx
in $0.150/Mout $0.150/M
Phi-3-Mini-4K (NIM)
Nano · 4K ctx
in $0.040/Mout $0.040/M
Mistral-Large-2 (NIM)
Enterprise · 128K ctx
in $2.000/Mout $6.000/M
Frequently asked questions

How much does Nemotron-4-340B cost?

Nemotron-4-340B costs $4.200 per million input tokens and $4.200 per million output tokens, for a blended reference rate of $4.200 per million tokens.

What is Nemotron-4-340B's context window?

Nemotron-4-340B supports up to 4K tokens of context (4,000 tokens).

What is Nemotron-4-340B best for?

Nemotron-4-340B is well suited to 340B dense parameters, Synthetic data generation focus and Open weights.

Who makes Nemotron-4-340B?

Nemotron-4-340B is developed and served by Nvidia. It was released in Jun 2024.