Llama 2 7B Q8
Popular Ollama model family: Llama 2. Caveat: Estimated values are placeholders unless marked measured..
Hardware Snapshot
| Family | Llama 2 |
|---|---|
| Scenario | chat |
| License scope | closed-weight |
| Quantization | Q8 |
| VRAM minimum | 12GB |
| VRAM optimal | 22GB |
| Best local GPU | RTX 3090 24GB |
| Cloud fallback | A6000 48GB |
| Updated | 2026-02-24 |
| Data status | Estimated baseline (pending measurement) |
| Ollama source | Library reference (verified: 2026-02-24) |
| Ollama tag | llama2:7b |
| Category | chat |
Benchmark Anchors
| Hardware | Expected tok/s |
|---|---|
| RTX 3090 24GB | 21.6 |
| RTX 4090 24GB | 29.2 |
| A100 80GB | 51.8 |
Real Hardware Benchmark (RTX 3090)
Real benchmark data not available yet for this tag. Estimated anchors are shown above.
Performance Curve
Reference anchors are baseline estimates. Measured RTX 3090 data is overlaid when available.
Best Hardware for Llama 2 7B Q8
- Local run: RTX 3090 (24GB) (Check latest deal) for around 21.6 tok/s on this profile.
- Cloud run: RunPod A6000 48GB , about 2.4x the local 3090 speed anchor.
- Alternative cloud: Vast.ai options for flexible spot pricing.
Local vs Cloud Cost Hint
| Mode | 40h / month | 120h / month |
|---|---|---|
| Local power only (3090 baseline) | $2.24 | $6.72 |
| A6000 48GB | $30.4 | $91.2 |
ollama run llama2:7b More chat models More 7b-8b models Benchmark changelog Submit your test result Check local GPU upgrade We may earn a commission if you click links on this page.
This page currently uses estimated benchmark baselines. Measured data will replace it after validation.