Rig report
NVIDIA A100 (80GB)
80.0 GB memory · 2039 GB/s · 16 of 18 tracked models fit
Best model it can run
Gemma 4 31BRuns great
Q8_0 · 32.6 GB · 34–52 tok/s · capability 82/100
Fastest that fits: Llama 3.2 1B at 224–336 tok/s
Also runs
Have a NVIDIA A100 (80GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.