At most my Strix Halo uses $0.48 a day

Reddit r/LocalLLaMA News

Summary

This article compares the energy cost of running AI models on Strix Halo (max $0.48/day) versus Nvidia A6000, highlighting power efficiency and versatility.

This is something that never gets mentioned when people complain that it's slow and new users are told to avoid them. This 48 cent figure is worst case scenario, running multiple models/compiling hitting CPU, GPU, and NPU at the same time for 24 hours a day. I can handle only 50tps on Q8_XL Qwen 3.6 35B when it's silent, sipping power, and is the size of a small router. I know your Nvidia card is significantly faster, but if you even consider using more than just raw GPU memory speed/compute or you are concerned with size/noise/energy, I don't see how there is much of a competition. An A6000 is 300W for the card alone , which is double what the Strix Halo devices total power budget is. Even with the current inflated prices, I think these things have insane value. They provide significantly more than just the GPU/RAM. Anything that isn't used for inference is open for hosting any services you want, it's such a versatile package. Same goes for the Macs,
Original Article

Similar Articles

Scrambling to max StrixHalo (+NVLink dual eGPU 3090 mod)

Reddit r/LocalLLaMA

A user details their modding and benchmarking of an AMD Strix Halo system with dual RTX 3090 eGPUs and NVLink, finding improvements in LLM inference speed for dense models, especially with vLLM, and discusses power efficiency trade-offs.

Big News for AMD / Strix Halo+ Owners

Reddit r/LocalLLaMA

The NPU on AMD Strix Halo devices is now usable for AI inference, enabling hybrid mode that combines NPU and iGPU for faster prompt processing. Tools like Lemonade and AMD's ROCm software make this possible.