Rig report
NVIDIA L40S (48GB)
48.0 GB memory · 864 GB/s · 16 of 18 tracked models fit
Best model it can run
Gemma 4 31BRuns great
Q6_K · 25.3 GB · 19–28 tok/s · capability 82/100
Fastest that fits: Kimi Linear 48B-A3B (MoE) at 162–243 tok/s
Also runs
Have a NVIDIA L40S (48GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.