Can I run this LLM?

Can a MacBook Air M2 (24GB) run GLM-4.7 Flash (MoE)?

GLM · MIT · estimated for a 24.0 GB machine at 4K context.

Yes — it runs great.

Best fit: GLM-4.7 Flash (MoE) at Q3_K_M · 12.9 GB · 32–47 tok/s on a MacBook Air M2 (24GB).

Every quantization on this machine

Quant	Size	Speed	Fit
Q2_K	9.7 GB	37–56 tok/s	Runs great
Q3_K_M	12.9 GB	32–47 tok/s	Runs great
Q4_K_M	18.2 GB	25–38 tok/s	Won't fit
Q5_K_M	21.3 GB	23–34 tok/s	Won't fit
Q6_K	24.7 GB	20–31 tok/s	Won't fit
Q8_0	31.8 GB	17–25 tok/s	Won't fit
FP16	59.9 GB	10–15 tok/s	Won't fit

Ran GLM-4.7 Flash (MoE) on a MacBook Air M2 (24GB)? Add your real numbers →