RTX PRO 5000 Tower (72 GB, 256 GB RAM)
A 72 GB GPU for large models at full speed.
- Puppy One fit: Pro
- Memory for models: 72 GB GPU
- Chip / GPU: RTX PRO 5000 Blackwell 72 GB
- OS: Windows / Linux
- Validation: Needs testing: Linux / Windows x64
- Availability: Available
Full-size desktop workstation built around a single NVIDIA RTX PRO 5000 Blackwell with 72 GB of GDDR7 ECC memory delivering up to 2,900 AI TOPS at FP4, paired with an AMD Threadripper PRO or Intel Xeon W processor, up to 256 GB of DDR5 ECC memory, PCIe Gen5 NVMe storage, and a 1,000 W or larger power supply.
Designed for local inference and fine-tuning on models that exceed consumer VRAM at a lower cost than the 96 GB card, with Windows 11 Pro or Ubuntu, NVIDIA AI Enterprise, CUDA, PyTorch, and Triton support, and ISV certifications for engineering and media workflows.
Floor-standing on a standard outlet at roughly 600 W under sustained load, ECC memory throughout, and the ability to run a 70-billion-parameter model at 8-bit or a 120-billion-parameter model at 4-bit entirely in GPU memory.
From ~$10,000. The card alone lists at $9,310–9,999 (SHI, Scan); built systems from Puget, Lambda, Dell, HP, and Lenovo run $10,000–15,000.