can-i-run-this-llm

Can I run this LLM?

Can a MacBook Air M3 (8GB) run Qwen3 8B?

Qwen · Apache 2.0 · estimated for a 8.0 GB machine at 4K context.

Yes — it runs great.

Best fit: Qwen3 8B at Q2_K · 3.3 GB · 16–24 tok/s on a MacBook Air M3 (8GB).

Every quantization on this machine

QuantSizeSpeedFit
Q2_K3.3 GB16–24 tok/sRuns great
Q3_K_M4.1 GB13–20 tok/sTight / slow
Q4_K_M5.0 GB11–17 tok/sWon't fit
Q5_K_M5.9 GB10–15 tok/sWon't fit
Q6_K6.7 GB9–13 tok/sWon't fit
Q8_08.7 GB7–10 tok/sWon't fit
FP1616.4 GB4–6 tok/sWon't fit

Ran Qwen3 8B on a MacBook Air M3 (8GB)? Add your real numbers →