Mixtral 8X22B Q5
Popular Ollama model family: Mixtral. Caveat: Estimated values are placeholders unless marked measured..
Hardware Snapshot
| Family | Mixtral |
|---|---|
| Scenario | chat |
| License scope | open-source |
| Quantization | Q5 |
| VRAM minimum | 140GB |
| VRAM optimal | 150GB |
| Best local GPU | Cloud-first (no practical single-GPU local) |
| Cloud fallback | H100/H200 class |
| Updated | 2026-02-24 |
| Data status | Estimated baseline (pending measurement) |
| Ollama source | Library reference (verified: 2026-02-24) |
| Ollama tag | mixtral:8x22b |
| Category | chat |
Benchmark Anchors
| Hardware | Expected tok/s |
|---|---|
| RTX 3090 24GB | 1.7 |
| RTX 4090 24GB | 2.3 |
| A100 80GB | 4.1 |
Real Hardware Benchmark (RTX 3090)
Real benchmark data not available yet for this tag. Estimated anchors are shown above.
Performance Curve
Reference anchors are baseline estimates. Measured RTX 3090 data is overlaid when available.
Best Hardware for Mixtral 8X22B Q5
- Local run: RTX 3090 (24GB) (Check latest deal) for around 1.7 tok/s on this profile.
- Cloud run: RunPod H100/H200 class , about 2.4x the local 3090 speed anchor.
- Alternative cloud: Vast.ai options for flexible spot pricing.
Local vs Cloud Cost Hint
| Mode | 40h / month | 120h / month |
|---|---|---|
| Local power only (3090 baseline) | $2.24 | $6.72 |
| H100/H200 class | $196 | $588 |
ollama run mixtral:8x22b More chat models More 100b-250b models Benchmark changelog Submit your test result Run on RunPod Try Vast.ai We may earn a commission if you click links on this page.
This page currently uses estimated benchmark baselines. Measured data will replace it after validation.