Scores inherited from Llama 3.2 1B — this is a hosted variant of the same open-weights model, so the underlying benchmark scores are identical.
MMLU49%
Multitask academic knowledge across 57 subjects.
GPQA Diamond25%
Graduate-level science questions, "Google-proof".
MATH30%
High-school competition math problems.
HumanEval38%
Python function synthesis from docstrings.
Hand-curated from each provider's published reports and public leaderboards. Methodology varies across sources — treat as directional rather than authoritative.