Rig report
NVIDIA GH200 Grace Hopper (144GB HBM + 480GB)
624.0 GB unified memory · 4900 GB/s · 47 of 48 tracked models fit
Best model it can run
Kimi K2.7 (MoE)Runs great
Q3_K_M · 463.6 GB · 24–37 tok/s · capability 92/100
Fastest that fits: LFM2.5 1.2B at 295–443 tok/s
Have a NVIDIA GH200 Grace Hopper (144GB HBM + 480GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.