Skip to content
can-i-run-this-llm

Can I run this LLM?

Can a Mac Studio M3 Ultra (96GB) run Llama 4 Scout (MoE)?

Llama · See model card · estimated for a 96.0 GB machine at 4K context.

Yes — it runs great.

Runs great

Best fit: Llama 4 Scout (MoE) at Q3_K_M · 51.8 GB weights · 45–68 tok/s on a Mac Studio M3 Ultra (96GB).

Arena Text Overall · style-controlled

1,322Q3_K_M untested

llama-4-scout-17b-16e-instruct · published configuration reference · Q3_K_M not tested

Arena Text Overall (style-controlled), exact published entry llama-4-scout-17b-16e-instruct, 2026-10-08: reference rating 1,321.5. Published confidence bounds 1,316.8–1,326.3. 29,836 votes. Published llama-4-scout-17b-16e-instruct configuration reference. Reasoning mode is not disclosed by the Arena dataset. Tested precision, runtime and sampling settings are not disclosed in this dataset. Selected Q3_K_M has not been measured by this Arena entry. No quantization quality adjustment is applied.

Snapshot published 2026-10-08 · snapshot imported 2026-10-11 UTC · validated last-good data · manual refresh

Arena leaderboard dataset · Arena / lmarena-ai, Arena Leaderboard Dataset (CC BY 4.0). Selected Text Overall style-controlled rows; field names adapted, ratings unchanged. · dataset CC BY 4.0 · revision e16f90232986

Total memory at 4K context
53.4 GB
Weights + KV cache + runtime overhead
Estimated generation
45–68 tok/s
Estimated first token
~7.5s

Every quantization on this machine

On small screens, each quant lists every metric below its name. On wider screens, scroll sideways for total memory, speed and fit. Keyboard: focus the table, then use the arrow keys. Quant names stay visible.

Llama 4 Scout (MoE) quantizations on Mac Studio M3 Ultra (96GB), estimated at 4K context. Weights and total memory are shown separately.
QuantWeightsTotal memorySpeedFit
Q2_K39.6 GB41.2 GB54–81 tok/sRuns great
Q3_K_M51.8 GB53.4 GB45–68 tok/sRuns great
Q4_K_M65.4 GB67.0 GB39–58 tok/sTight / slow
Q5_K_M76.6 GB78.2 GB— not residentWon't fit
Q6_K88.4 GB90.0 GB— not residentWon't fit
Q8_0114.5 GB116.1 GB— not residentWon't fit
FP16215.6 GB217.2 GB— not residentWon't fit

Ran Llama 4 Scout (MoE) on a Mac Studio M3 Ultra (96GB)? Add your real numbers →