gemma3:4b: memory needed and real speed (benchmark)

gemma3:4b measured on a home PC: about 2.8GB of memory, about 142 tokens/sec on GPU and 21.5 tokens/sec on CPU only. Which PCs can run it, by VRAM and RAM.

Summary
  • Memory used: about 2.8GB (measured 2026-10-04)
  • GPU (16GB VRAM): about 142.0 tokens/sec Instant
  • CPU only: about 21.5 tokens/sec Comfortable

Speed by setup

SetupTokens/secFeel
GPU, 16GB VRAM (RTX 4080)142.0Instant
12GB VRAM (simulated)142.0Instant
8GB VRAM (simulated)142.0Instant
CPU only (no GPU)21.5Comfortable

Which PCs can run it?

We assume about 4GB of RAM for the OS and 1GB of VRAM headroom.

Compared with other models

Tokens/secGPU (RTX 4080)CPU only★ gemma3:4b2.8GB142.021.5qwen3.5:9b6.0GB96.411.2
Measured on Ryzen 7 9800X3D / 31GB RAM / RTX 4080 (16GB VRAM).

FAQ

How much memory does gemma3:4b need?

In our test it used about 2.8GB when loaded. For fast GPU inference, plan on 8GB of VRAM or more; without a GPU, 8GB of system RAM or more.

Can gemma3:4b run without a GPU?

Yes. On CPU only it generated about 21.5 tokens/sec (comfortable).

Measured on the site owner's PC (Ryzen 7 9800X3D / 31GB RAM / RTX 4080 (16GB VRAM)). "8GB / 12GB VRAM" values were measured on the RTX 4080 with the usable VRAM limited to that amount; real 8GB or 12GB cards are slower GPUs, so actual speeds may be lower. How we measure