can-i-run-this-llm

GPU comparison

MacBook Pro M5 Pro (64GB) vs NVIDIA RTX 6000 Ada (48GB) for local LLMs

How the two stack up for running open-source LLMs locally — memory, bandwidth, price, and how many of the 34 tracked models each one can run.

MacBook Pro M5 Pro (64GB)NVIDIA RTX 6000 Ada (48GB)
Memory64.0 GB48.0 GB
Bandwidth307 GB/s960 GB/s
Price (approx)$3,399$6,800
LLMs it runs26 of 3426 of 34
Best model it runsGemma 4 31B · 12–18 tok/sGemma 4 31B · 20–30 tok/s

Both run the same number of models, but the MacBook Pro M5 Pro (64GB) has more memory (64.0 GB), so it can hold larger models at higher quality. The NVIDIA RTX 6000 Ada (48GB) has more memory bandwidth (960 GB/s), so it generates tokens faster at the same model and quant.

What the MacBook Pro M5 Pro (64GB) runs →What the NVIDIA RTX 6000 Ada (48GB) runs →Open the calculator →