Rig report
NVIDIA RTX 6000 Ada (48GB)
48.0 GB memory · 960 GB/s · 16 of 18 tracked models fit
Best model it can run
Gemma 4 31BRuns great
Q6_K · 25.3 GB · 21–31 tok/s · capability 82/100
Fastest that fits: Kimi Linear 48B-A3B (MoE) at 171–257 tok/s
Also runs
Have a NVIDIA RTX 6000 Ada (48GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.