Rig report
NVIDIA GH200 Grace Hopper (144GB HBM + 480GB)
624.0 GB unified memory · 4900 GB/s · 68 of 69 tracked models fit
Highest Arena reference that fits
Q8_0 · 317.7 GB weights · 319.8 GB total · 19–28 tok/s · Arena reference 1,454
Arena is a published configuration reference. Selected Q8_0 is untested by this reference.
Arena reference details
Arena Text Overall · style-controlled
1,454Q8_0 untestedhy3 · published configuration reference · Q8_0 not tested
Arena Text Overall (style-controlled), exact published entry hy3, 2026-10-08: reference rating 1,454.2. Published confidence bounds 1,447.9–1,460.5. 11,284 votes. Published hy3 configuration reference. Reasoning mode is not disclosed by the Arena dataset. Tested precision, runtime and sampling settings are not disclosed in this dataset. Selected Q8_0 has not been measured by this Arena entry. No quantization quality adjustment is applied.
Snapshot published 2026-10-08 · snapshot imported 2026-10-11 UTC · validated last-good data · manual refresh
Arena leaderboard dataset · Arena / lmarena-ai, Arena Leaderboard Dataset (CC BY 4.0). Selected Text Overall style-controlled rows; field names adapted, ratings unchanged. · dataset CC BY 4.0 · revision e16f90232986
Fastest that fits: LFM2.5 1.2B at 295–443 tok/s
Have a NVIDIA GH200 Grace Hopper (144GB HBM + 480GB)? Add your real benchmark → to sharpen these numbers for everyone.
Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.