Question 1

Can a AMD Ryzen AI Max+ 395 “Strix Halo” (128GB) run Step 3.7 Flash (MoE)?

Accepted Answer

Yes — Step 3.7 Flash (MoE) runs at Q2_K (71.2 GB) at about 33–50 tok/s on a AMD Ryzen AI Max+ 395 “Strix Halo” (128GB).

Question 2

How much memory does Step 3.7 Flash (MoE) need?

Accepted Answer

Step 3.7 Flash (MoE) needs about 72.3 GB at 4K context at its smallest quantization. A AMD Ryzen AI Max+ 395 “Strix Halo” (128GB) has 128.0 GB.

Quant	Size	Speed	Fit
Q2_K	71.2 GB	33–50 tok/s	Runs great
Q3_K_M	91.8 GB	27–41 tok/s	Won't fit
Q4_K_M	121.6 GB	22–32 tok/s	Won't fit
Q5_K_M	142.0 GB	19–28 tok/s	Won't fit
Q6_K	171.8 GB	16–24 tok/s	Won't fit
Q8_0	212.0 GB	13–20 tok/s	Won't fit