Rig report
NVIDIA H200 (141GB)
141.0 GB memory · 4800 GB/s · 20 of 22 tracked models fit
Best model it can run
Hunyuan Hy3 (MoE)Runs great
Q2_K · 97.1 GB · 199–298 tok/s · capability 88/100
Fastest that fits: Llama 3.2 1B at 289–433 tok/s
Have a NVIDIA H200 (141GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.