Question 1

Can a NVIDIA RTX 4080 (16GB) run Qwen3.8 27B?

Accepted Answer

Yes — Qwen3.8 27B runs at Q2_K (10.8 GB) at about 42–63 tok/s on a NVIDIA RTX 4080 (16GB).

Question 2

How much memory does Qwen3.8 27B need?

Accepted Answer

Qwen3.8 27B needs about 11.9 GB at 4K context at its smallest quantization. A NVIDIA RTX 4080 (16GB) has 16.0 GB.

Quant	Size	Speed	Fit
Q2_K	10.8 GB	42–63 tok/s	Runs great
Q3_K_M	13.4 GB	35–52 tok/s	Won't fit
Q4_K_M	17.4 GB	28–41 tok/s	Won't fit
Q5_K_M	20.9 GB	23–35 tok/s	Won't fit
Q6_K	23.9 GB	21–31 tok/s	Won't fit
Q8_0	29.1 GB	17–26 tok/s	Won't fit
FP16	54.7 GB	9–14 tok/s	Won't fit