can-i-run-this-llm

Can I run this LLM?

Can a NVIDIA RTX 6000 Ada (48GB) run Llama 3.2 3B?

Llama · Llama 3.2 Community · estimated for a 48.0 GB machine at 4K context.

Yes — it runs great.

Best fit: Llama 3.2 3B at FP16 · 6.4 GB · 80–121 tok/s on a NVIDIA RTX 6000 Ada (48GB).

Every quantization on this machine

QuantSizeSpeedFit
Q4_K_M1.9 GB163–245 tok/sRuns great
Q5_K_M2.3 GB151–227 tok/sRuns great
Q6_K2.6 GB140–211 tok/sRuns great
Q8_03.4 GB122–183 tok/sRuns great
FP166.4 GB80–121 tok/sRuns great

Ran Llama 3.2 3B on a NVIDIA RTX 6000 Ada (48GB)? Add your real numbers →