Can I run this LLM?

Can a MacBook Air/Pro M2 (16GB) run GLM-4.7 Flash (MoE)?

GLM · MIT · estimated for a 16.0 GB machine at 4K context.

Yes, but it's tight.

Best fit: GLM-4.7 Flash (MoE) at Q2_K · 9.7 GB · 37–56 tok/s on a MacBook Air/Pro M2 (16GB).

Every quantization on this machine

Quant	Size	Speed	Fit
Q2_K	9.7 GB	37–56 tok/s	Tight / slow
Q3_K_M	12.9 GB	32–47 tok/s	Won't fit
Q4_K_M	18.2 GB	25–38 tok/s	Won't fit
Q5_K_M	21.3 GB	23–34 tok/s	Won't fit
Q6_K	24.7 GB	20–31 tok/s	Won't fit
Q8_0	31.8 GB	17–25 tok/s	Won't fit
FP16	59.9 GB	10–15 tok/s	Won't fit

Ran GLM-4.7 Flash (MoE) on a MacBook Air/Pro M2 (16GB)? Add your real numbers →