At most my Strix Halo uses $0.48 a day
Summary
This article compares the energy cost of running AI models on Strix Halo (max $0.48/day) versus Nvidia A6000, highlighting power efficiency and versatility.
Similar Articles
Strix Halo desktop trying to compete against DGX Spark
AMD launches the Ryzen AI Halo Developer Platform, a $3,999 mini PC with 128GB unified memory and Windows 11 support, competing with Nvidia's DGX Spark for local AI workloads.
Scrambling to max StrixHalo (+NVLink dual eGPU 3090 mod)
A user details their modding and benchmarking of an AMD Strix Halo system with dual RTX 3090 eGPUs and NVLink, finding improvements in LLM inference speed for dense models, especially with vLLM, and discusses power efficiency trade-offs.
Big News for AMD / Strix Halo+ Owners
The NPU on AMD Strix Halo devices is now usable for AI inference, enabling hybrid mode that combines NPU and iGPU for faster prompt processing. Tools like Lemonade and AMD's ROCm software make this possible.
DGX Spark, Strix Halo prices increased (doubled)??
Noticing price increases for DGX Spark and Strix Halo hardware, suggesting rising demand for local AI computing.
Ran the same models across Strix Halo, RTX 3090, and RTX 5070 because I wanted my own numbers
The author ran 55 inference benchmark runs across Strix Halo, RTX 3090, and RTX 5070 with multiple backends, revealing that memory bandwidth dominates decode speed, the RTX 5070 beats the 3090 on small models, and reasoning models appear ~5x slower due to hidden reasoning content.