can-i-run-this-llm

Rig report

NVIDIA RTX Pro 6000 Blackwell (96GB)

96.0 GB memory · 1792 GB/s · 41 of 48 tracked models fit

Best model it can run

Gemma 4 31BRuns great

FP16 · 61.4 GB · 20–30 tok/s · capability 84/100

Fastest that fits: LFM2.5 1.2B at 221–331 tok/s

Also runs

Open the full calculator →Check another machine

Compare against

vs NVIDIA RTX 6000 Ada (48GB) →vs Mac Studio M3 Ultra (96GB) →vs MacBook Pro M5 Max (128GB) →vs MacBook Pro M4 Max (128GB) →vs NVIDIA DGX Spark (GB10, 128GB) →vs NVIDIA RTX 5090 (32GB) →vs MacBook Pro M5 Max (36GB) →vs MacBook Pro M5 Pro (64GB) →all comparisons →

Have a NVIDIA RTX Pro 6000 Blackwell (96GB)? Add your real benchmark → to sharpen these numbers for everyone.

Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.