Can I run this LLM?

Can a Mac Studio M2 Ultra (64GB) run GLM-4.5 Air (MoE)?

GLM · MIT · estimated for a 64.0 GB machine at 4K context.

Yes — it runs great.

Best fit: GLM-4.5 Air (MoE) at Q2_K · 35.9 GB · 69–103 tok/s on a Mac Studio M2 Ultra (64GB).

Every quantization on this machine

Quant	Size	Speed	Fit
Q2_K	35.9 GB	69–103 tok/s	Runs great
Q3_K_M	47.6 GB	59–89 tok/s	Won't fit
Q4_K_M	67.0 GB	48–72 tok/s	Won't fit
Q5_K_M	78.7 GB	43–65 tok/s	Won't fit
Q6_K	91.1 GB	39–59 tok/s	Won't fit
Q8_0	117.4 GB	32–49 tok/s	Won't fit
FP16	220.9 GB	19–29 tok/s	Won't fit

Ran GLM-4.5 Air (MoE) on a Mac Studio M2 Ultra (64GB)? Add your real numbers →