16GB VRAM Models for Ollama
Comfort zone for 13B/14B and selected 32B Q4 setups.
Recommended models
| Model | Fit | Expected tok/s |
|---|---|---|
| Qwen3 14B Q5 | good | 14-24 |
| DeepSeek-R1 Distill 32B Q4 | conditional | 8-12 |
Comfort zone for 13B/14B and selected 32B Q4 setups.
| Model | Fit | Expected tok/s |
|---|---|---|
| Qwen3 14B Q5 | good | 14-24 |
| DeepSeek-R1 Distill 32B Q4 | conditional | 8-12 |