MoE variant of Phi-3.5 — 16x3.8B experts (~6.6B active). Better quality at similar cost to dense Phi-3.5 mini.
Phi-3.5 MoE is a efficient AI model from Microsoft. It costs $0.160 per million input tokens and $0.640 per million output tokens (blended $0.304/M), with a 128K-token context window.
Phi-3.5 MoE costs $0.160 per million input tokens and $0.640 per million output tokens, for a blended reference rate of $0.304 per million tokens.
Phi-3.5 MoE supports up to 128K tokens of context (128,000 tokens).
Phi-3.5 MoE is well suited to MoE efficiency, Open weights and 128K context.
Phi-3.5 MoE is developed and served by Microsoft. It was released in Aug 2024.