IBM
IBM
Efficient

Granite 3.1 8B Instruct

Compact

IBM's open-weights Granite 3.1 8B. Apache-2.0 model with full IP indemnification when run on watsonx, the option built for enterprise contract requirements.

Granite 3.1 8B Instruct is a efficient AI model from IBM. It costs $0.050 per million input tokens and $0.250 per million output tokens (blended $0.110/M), with a 128,000-token context window.

INPUT
$0.050/M
per million input tokens
OUTPUT
$0.250/M
per million output tokens
BLENDED 70/30
$0.110/M
unchanged since 3 May
CONTEXT
128,000
tokens
What it is good at
  • Apache 2.0 + IBM indemnity on watsonx
  • Long context (128K)
  • Single-GPU
Typical use cases
  • Enterprise on-prem chat
  • Regulated-industry RAG
  • Self-hosted production chat

Benchmarks

vs. best public score
MMLU65%
Multitask academic knowledge across 57 subjects.
Python function synthesis from docstrings.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources, treat as directional rather than authoritative.

More from IBM

See all 5 →

Frequently asked questions

How much does Granite 3.1 8B Instruct cost?

Granite 3.1 8B Instruct costs $0.050 per million input tokens and $0.250 per million output tokens, for a blended reference rate of $0.110 per million tokens.

What is Granite 3.1 8B Instruct's context window?

Granite 3.1 8B Instruct supports up to 128,000 tokens of context in a single request.

What is Granite 3.1 8B Instruct best for?

Granite 3.1 8B Instruct is well suited to Apache 2.0 + IBM indemnity on watsonx, Long context (128K) and Single-GPU.

Who makes Granite 3.1 8B Instruct?

Granite 3.1 8B Instruct is developed and served by IBM. It was released in Dec 2024.

Terms used on this page