Rig report
NVIDIA RTX 3070 (8GB)
8.0 GB memory · 448 GB/s · 22 of 64 tracked models fit
Best model it can run
Gemma 4 12BRuns great
Q2_K · 4.7 GB · 55–83 tok/s · capability 68/100
Fastest that fits: LFM2.5 8B-A1B (MoE) at 177–266 tok/s
Have a NVIDIA RTX 3070 (8GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.