can-i-run-this-llm

Rig report

NVIDIA RTX 4060 Ti (16GB)

16.0 GB memory · 288 GB/s · 12 of 18 tracked models fit

Best model it can run

Gemma 4 26B-A4B (MoE)Tight / slow

Q3_K_M · 10.9 GB · 52–78 tok/s · capability 79/100

Fastest that fits: Qwen3 30B-A3B (MoE) at 109–163 tok/s

Also runs

Open the full calculator →Check another machine

Have a NVIDIA RTX 4060 Ti (16GB)? Add your real benchmark → to sharpen these numbers for everyone.

Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.