GLM5.2 on 5x Pro 6000s and a 5090, an expensive journey

A user details their extensive hardware upgrade process to run the GLM 5.2 model locally, culminating in a setup of five AMD Radeon Pro W6800 GPUs and one NVIDIA RTX 5090.

• The author started with two RTX 5090s but found VRAM insufficient for complex tasks.
• Upgrades included Threadripper Pro 9975WX, WRX90 Sage SE motherboard, and multiple AMD Radeon Pro W6800 cards.
• Thermal issues forced the abandonment of side-by-side GPU configurations in favor of open-case designs.
• The final 5x Pro 6000 + 5090 configuration achieved 98–99% task completion rates with ample context.
• GPUs reached 70–75°C under full load, requiring a second PSU and extensive cooling solutions.

The author concludes that while the setup meets all functional needs for running GLM 5.2 and Kimi models, it is financially unviable, estimating over 10 years to break even.