Can I run this LLM?

Can a MacBook Pro M1 Max (64GB) run GLM-4.5 Air (MoE)?

GLM · MIT · estimated for a 64.0 GB machine at 4K context.

Yes — it runs great.

Best fit: GLM-4.5 Air (MoE) at Q2_K · 35.9 GB · 43–65 tok/s on a MacBook Pro M1 Max (64GB).

Every quantization on this machine

Quant	Size	Speed	Fit
Q2_K	35.9 GB	43–65 tok/s	Runs great
Q3_K_M	47.6 GB	36–54 tok/s	Won't fit
Q4_K_M	67.0 GB	28–42 tok/s	Won't fit
Q5_K_M	78.7 GB	25–37 tok/s	Won't fit
Q6_K	91.1 GB	22–33 tok/s	Won't fit
Q8_0	117.4 GB	18–27 tok/s	Won't fit
FP16	220.9 GB	10–15 tok/s	Won't fit

Ran GLM-4.5 Air (MoE) on a MacBook Pro M1 Max (64GB)? Add your real numbers →