can-i-run-this-llm

Rig report

AMD Instinct MI300X (192GB)

192.0 GB memory · 5300 GB/s · 20 of 22 tracked models fit

Best model it can run

Hunyuan Hy3 (MoE)Runs great

Q3_K_M · 128.9 GB · 186–278 tok/s · capability 88/100

Fastest that fits: Llama 3.2 1B at 295–442 tok/s

Also runs

Open the full calculator →Check another machine

Have a AMD Instinct MI300X (192GB)? Add your real benchmark → to sharpen these numbers for everyone.

Estimates from device specs and model architectures, refined by community benchmarks. See the methodology.