Tokenando
BETA
Subscribe
← Back to prices·All DeepInfra models
DeepInfra
DeepInfraEfficient

Gemma 2 9B (DI)

Compact

Mid-size Gemma 2, popular open model in the 9B class for on-prem chat and fine-tuning.

Gemma 2 9B (DI) is a efficient AI model from DeepInfra. It costs $0.060 per million input tokens and $0.060 per million output tokens (blended $0.060/M), with a 8,000-token context window.

Profile inherited from upstream Gemma 2 9B ↗ — this is a hosted variant of the same open-weights model.

Released Jun 2024Modalities textOfficial model page ↗Provider pricing ↗API docs ↗Compare with another model →Estimate monthly cost →
INPUT
$0.060/M
per million input tokens
OUTPUT
$0.060/M
per million output tokens
BLENDED 70/30
$0.060/M
unchanged since 3 May
default reference rate · how it is calculated →
CONTEXT
8,000
tokens
What it is good at
  • Single-GPU friendly
  • Open weights
  • Wide ecosystem
Typical use cases
  • On-prem chat
  • Fine-tune base

Benchmarks

vs. best public score
Scores inherited from Gemma 2 9B — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU71%
Multitask academic knowledge across 57 subjects.
GPQA Diamond31%
Graduate-level science questions, "Google-proof".
MATH45%
High-school competition math problems.
HumanEval40%
Python function synthesis from docstrings.
LMArena Elo1192 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from DeepInfra

See all 11 →
Llama 3.3 70B (DI)
Serverless · 128,000 ctx
in $0.230/Mout $0.400/M
Llama 3.1 405B (DI)
Serverless · 128,000 ctx
in $0.800/Mout $0.800/M
Llama 3.1 70B (DI)
Balanced · 128,000 ctx
in $0.350/Mout $0.400/M
Mistral 7B (DI)
Nano · 32,000 ctx
in $0.070/Mout $0.070/M
Mixtral 8x7B (DI)
MoE · 32,000 ctx
in $0.240/Mout $0.240/M
DeepSeek-R1 (DI)
Reasoning · 64,000 ctx
in $0.550/Mout $2.190/M

Frequently asked questions

How much does Gemma 2 9B (DI) cost?

Gemma 2 9B (DI) costs $0.060 per million input tokens and $0.060 per million output tokens, for a blended reference rate of $0.060 per million tokens.

What is Gemma 2 9B (DI)'s context window?

Gemma 2 9B (DI) supports up to 8,000 tokens of context in a single request.

What is Gemma 2 9B (DI) best for?

Gemma 2 9B (DI) is well suited to Single-GPU friendly, Open weights and Wide ecosystem.

Who makes Gemma 2 9B (DI)?

Gemma 2 9B (DI) is developed and served by DeepInfra. It was released in Jun 2024.

Terms used on this page

Full glossary →
TokenInput tokensOutput tokensPrice per million tokensContext windowPrompt cachingBatch APIBlended cost