can-i-run-this-llm

Rig report

NVIDIA H100 SXM (80GB)

80.0 GB memory · 3352 GB/s · 41 of 48 tracked models fit

Best model it can run

Gemma 4 31BRuns great

FP16 · 61.4 GB · 36–54 tok/s · capability 84/100

Fastest that fits: LFM2.5 1.2B at 271–406 tok/s

Also runs

Open the full calculator →Check another machine

Have a NVIDIA H100 SXM (80GB)? Add your real benchmark → to sharpen these numbers for everyone.

Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.