Can I run this LLM?
Can a NVIDIA RTX 3090 (24GB) run GLM-5.2 (MoE)?
GLM · MIT · estimated for a 24.0 GB machine at 4K context.
No — too big for this machine.
GLM-5.2 (MoE) needs more memory than the 24.0 GB on a NVIDIA RTX 3090 (24GB), even at its smallest quantization.
Too big for your machine — run it in the cloud
Needs multi-GPU 80 GB+ (H100 / H200) · about $8–24/hr
- RunPod — Per-second GPU pods — bring your own GGUF, spin up on demand.
- Vast.ai — Cheap GPU marketplace — rent by the hour, bring your own GGUF.
- Vultr — Cloud GPU VMs by the hour — full root access, run any stack.
Affiliate links — we may earn a commission if you sign up, at no cost to you. Prices are indicative and vary by provider and region.
Open the full calculator →Everything a NVIDIA RTX 3090 (24GB) runsGLM-5.2 (MoE) on other machinesWhat to buy to run it →
Ran GLM-5.2 (MoE) on a NVIDIA RTX 3090 (24GB)? Add your real numbers →