qwen3.5:9b: memory needed and real speed (benchmark)
qwen3.5:9b measured on a home PC: about 6.0GB of memory, about 96 tokens/sec on GPU and 11.2 tokens/sec on CPU only. Which PCs can run it, by VRAM and RAM.
Summary
- Memory used: about 6.0GB (measured 2026-10-04)
- GPU (16GB VRAM): about 96.4 tokens/sec Instant
- CPU only: about 11.2 tokens/sec Short wait
Speed by setup
| Setup | Tokens/sec | Feel |
|---|---|---|
| GPU, 16GB VRAM (RTX 4080) | 96.4 | Instant |
| 12GB VRAM (simulated) | 96.4 | Instant |
| 8GB VRAM (simulated) | 96.4 | Instant |
| CPU only (no GPU) | 11.2 | Short wait |
Which PCs can run it?
- 8GB VRAM GPUFits in VRAM · about 96.4 tokens/secInstant
- 12GB VRAM GPUFits in VRAM · about 96.4 tokens/secInstant
- 16GB VRAM GPUFits in VRAM · about 96.4 tokens/secInstant
- 8GB RAM, no GPUNot enough memory
- 16GB RAM, no GPURuns on CPU · about 11.2 tokens/secShort wait
- 32GB RAM, no GPURuns on CPU · about 11.2 tokens/secShort wait
We assume about 4GB of RAM for the OS and 1GB of VRAM headroom.
Compared with other models
FAQ
How much memory does qwen3.5:9b need?
In our test it used about 6.0GB when loaded. For fast GPU inference, plan on 8GB of VRAM or more; without a GPU, 16GB of system RAM or more.
Can qwen3.5:9b run without a GPU?
Yes. On CPU only it generated about 11.2 tokens/sec (short wait).
Measured on the site owner's PC (Ryzen 7 9800X3D / 31GB RAM / RTX 4080 (16GB VRAM)). "8GB / 12GB VRAM" values were measured on the RTX 4080 with the usable VRAM limited to that amount; real 8GB or 12GB cards are slower GPUs, so actual speeds may be lower. How we measure