Found a way to cool the DGX
Summary
A user reports successfully using tap water to cool a DGX server while running the Qwen3.5-122b model at high GPU utilization, maintaining safe temperatures.
Similar Articles
Hot or not?
The author is adding active cooling to their DGX stack to manage heat under extended load and plans to share results related to comphy and DeepSeek flash.
Hotter Than a Hot Tub: The 45°C Breakthrough to Cool AI’s Biggest Machines
NVIDIA's Rubin generation AI servers achieve 100% liquid cooling with a 45°C coolant temperature, drastically reducing energy and water consumption in data centers.
Finally got Qwen 3.8 Next running on my v100 6gpu setup (TP2 PP3)
A user details the process of running the Qwen 3.8 Next model on a multi-GPU V100 setup, sharing troubleshooting experiences, performance benchmarks, and thermal test results.
Extened garlic to run Qwen3.5 35B A3B float8 at 55 tok/s on RTX 5060 Ti
A technique called 'Extened Garlic' enables running Qwen3.5 35B A3B model at 55 tok/s using float8 precision on an RTX 5060 Ti.
Stop wasting electricity
The author demonstrates how to reduce RTX 4090 power consumption by up to 40% while running quantized Qwen models via llama.cpp, without sacrificing inference speed. By capping GPU power limits through nvidia-smi and adjusting llama-server parameters, users can significantly lower heat, noise, and extend hardware lifespan.