can-i-run-this-llm

Rig report

NVIDIA RTX 4070 (12GB)

12.0 GB memory · 504 GB/s · 19 of 48 tracked models fit

Best model it can run

Devstral Small 2 24BTight / slow

Q2_K · 8.9 GB · 35–53 tok/s · capability 72/100

Fastest that fits: LFM2.5 1.2B at 109–164 tok/s

Also runs

Open the full calculator →Check another machine

Compare against

vs NVIDIA RTX 5060 Ti (16GB) →vs AMD RX 9070 (16GB) →vs NVIDIA RTX 5070 (12GB) →vs NVIDIA RTX 4060 Ti (16GB) →vs AMD RX 9070 XT (16GB) →vs NVIDIA RTX 3060 (12GB) →vs Intel Arc B580 (12GB) →vs NVIDIA RTX 5070 Ti (16GB) →all comparisons →

Have a NVIDIA RTX 4070 (12GB)? Add your real benchmark → to sharpen these numbers for everyone.

Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.