Question 1

Can a AMD RX 7900 XTX (24GB) run Qwen3 32B?

Accepted Answer

Yes — Qwen3 32B runs at Q3_K_M (16.0 GB) at about 37–56 tok/s on a AMD RX 7900 XTX (24GB).

Question 2

How much memory does Qwen3 32B need?

Accepted Answer

Qwen3 32B needs about 14.2 GB at 4K context at its smallest quantization. A AMD RX 7900 XTX (24GB) has 24.0 GB.

Quant	Size	Speed	Fit
Q2_K	12.3 GB	46–69 tok/s	Runs great
Q3_K_M	16.0 GB	37–56 tok/s	Runs great
Q4_K_M	19.8 GB	31–47 tok/s	Won't fit
Q5_K_M	23.2 GB	27–41 tok/s	Won't fit
Q6_K	26.9 GB	24–36 tok/s	Won't fit
Q8_0	34.8 GB	19–28 tok/s	Won't fit
FP16	65.5 GB	10–16 tok/s	Won't fit