Tokenando
BETA
Subscribe
← Back to prices·All Together AI models
Together AI
Together AIFrontier

WizardLM-2 8x22B

Fine-tuned

WizardLM-2 8x22B, Microsoft Research's instruction-tuned Mixtral 8x22B variant. Briefly released and pulled in 2024, but widely re-hosted by Together / DeepInfra.

WizardLM-2 8x22B is a frontier AI model from Together AI. It costs $1.200 per million input tokens and $1.200 per million output tokens (blended $1.200/M), with a 64,000-token context window.

Released Apr 2024Modalities textOfficial model page ↗Provider pricing ↗API docs ↗Compare with another model →Estimate monthly cost →
INPUT
$1.200/M
per million input tokens
OUTPUT
$1.200/M
per million output tokens
BLENDED 70/30
$1.200/M
unchanged since 3 May
default reference rate · how it is calculated →
CONTEXT
64,000
tokens
What it is good at
  • Open-weights MoE
  • Strong instruction following
  • Widely hosted
Typical use cases
  • Self-hosted instruction-tuned MoE
  • Cheap quality alternative to closed frontier

Benchmarks

vs. best public score
Scores inherited from Mixtral 8x22B (WizardLM-2 base) — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU78%
Multitask academic knowledge across 57 subjects.
GPQA Diamond36%
Graduate-level science questions, "Google-proof".
MATH42%
High-school competition math problems.
HumanEval76%
Python function synthesis from docstrings.
LMArena Elo1198 Elo
Crowd-sourced head-to-head preference Elo rating.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from Together AI

See all 10 →
Llama 3.3 70B (Together)
Managed · 128,000 ctx
in $0.880/Mout $0.880/M
Llama 3.1 405B (Together)
Managed Large · 128,000 ctx
in $3.500/Mout $3.500/M
Qwen2.5-72B (Together)
Managed · 32,000 ctx
in $1.200/Mout $1.200/M
DeepSeek-R1 (Together)
Reasoning · 64,000 ctx
in $3.000/Mout $7.000/M
DBRX Instruct (Together)
Enterprise · 32,000 ctx
in $1.200/Mout $1.200/M
Mixtral 8x22B (Together)
Large MoE · 64,000 ctx
in $1.200/Mout $1.200/M

Frequently asked questions

How much does WizardLM-2 8x22B cost?

WizardLM-2 8x22B costs $1.200 per million input tokens and $1.200 per million output tokens, for a blended reference rate of $1.200 per million tokens.

What is WizardLM-2 8x22B's context window?

WizardLM-2 8x22B supports up to 64,000 tokens of context in a single request.

What is WizardLM-2 8x22B best for?

WizardLM-2 8x22B is well suited to Open-weights MoE, Strong instruction following and Widely hosted.

Who makes WizardLM-2 8x22B?

WizardLM-2 8x22B is developed and served by Together AI. It was released in Apr 2024.

Terms used on this page

Full glossary →
TokenInput tokensOutput tokensPrice per million tokensContext windowPrompt cachingBatch APIBlended cost