Can I run this LLM?
Can a NVIDIA RTX 5090 (32GB) run Llama 4 Scout (MoE)?
Llama · See model card · estimated for a 32.0 GB machine at 4K context.
No — too big for this machine.
Llama 4 Scout (MoE) needs more memory than the 32.0 GB on a NVIDIA RTX 5090 (32GB), even at its smallest quantization.
Arena Text Overall · style-controlled
1,322Local pack untestedllama-4-scout-17b-16e-instruct · published configuration reference · local quantizations not tested
Arena Text Overall (style-controlled), exact published entry llama-4-scout-17b-16e-instruct, 2026-10-08: reference rating 1,321.5. Published confidence bounds 1,316.8–1,326.3. 29,836 votes. Published llama-4-scout-17b-16e-instruct configuration reference. Reasoning mode is not disclosed by the Arena dataset. Tested precision, runtime and sampling settings are not disclosed in this dataset. Your selected local quantization has not been measured by this Arena entry. No quantization quality adjustment is applied.
Snapshot published 2026-10-08 · snapshot imported 2026-10-11 UTC · validated last-good data · manual refresh
Arena leaderboard dataset · Arena / lmarena-ai, Arena Leaderboard Dataset (CC BY 4.0). Selected Text Overall style-controlled rows; field names adapted, ratings unchanged. · dataset CC BY 4.0 · revision e16f90232986
Too big for your machine — run it in the cloud
Needs 1–2× 80 GB GPU (A100 / H100) · about $1.50–4/hr
- RunPod — Per-second GPU pods — bring your own GGUF, spin up on demand.
- Vast.ai — Cheap GPU marketplace — rent by the hour, bring your own GGUF.
- Vultr — Cloud GPU VMs by the hour — full root access, run any stack.
Affiliate links — we may earn a commission if you sign up, at no cost to you. Prices are indicative and vary by provider and region.
Ran Llama 4 Scout (MoE) on a NVIDIA RTX 5090 (32GB)? Add your real numbers →