Rig report
NVIDIA H100 (80GB)
80.0 GB memory · 3352 GB/s · 16 of 18 tracked models fit
Best model it can run
Gemma 4 31BRuns great
Q8_0 · 32.6 GB · 53–80 tok/s · capability 82/100
Fastest that fits: Llama 3.2 1B at 264–397 tok/s
Also runs
Have a NVIDIA H100 (80GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.