Tag
hipEngine is a new open-source ROCm-native LLM inference engine for AMD RDNA3 GPUs, offering competitive prefill and decode performance for Qwen 3.6 models compared to llama.cpp.
AMD's Vivado 2026.1 introduces a tiered licensing model with a free BASIC tier that does not support Linux, which may disappoint FPGA developers relying on the open-source platform.
AMD's Vivado 2026.1 will drop Linux support for the free tier, raising concerns among the developer community.
An in-depth evaluation of the new SPEC CPU2026 benchmark suite, which replaces SPEC CPU2017 with 52 workloads and a slower reference system (Ampere eMAG 8180), showing performance comparisons between modern CPUs.
This repository provides practical testing profiles and benchmarks for running local LLMs on 16GB AMD Radeon GPUs using llama.cpp with ROCm/HIP, focusing on real-world performance metrics like context length and KV cache settings.
A user successfully set up a dual-GPU llama-cpp server with 48GB VRAM using an AMD Radeon PRO and 7800 XT via Vulkan in Docker on Kubuntu 24.04.
Clement Delangue, CEO of Hugging Face, expresses excitement about AMD's Ryzen AI Halo, advocating for more local hardware for AI builders and hinting at the possibility of Hugging Face creating its own hardware.
AMD announces the Ryzen AI Halo developer platform for local AI development, capable of running models up to 200B parameters, and the Ryzen AI Max PRO 400 Series processors for commercial AI PCs, enabling agentic AI workloads locally.
A developer reverse-engineers AMD BC-250 boards (salvaged PS5 APUs) to enable all 40 compute units, achieving significant performance gains in LLM inference with custom HIP kernels. The project shows potential for low-cost AI compute.
AMD reportedly plans to re-release the Ryzen 5800X3D as a 10th Anniversary Edition to help budget-conscious users upgrade without buying a new motherboard or DDR5 RAM, with pricing possibly around $310.
AMD announces pricing for its Ryzen AI Halo PC at $3999, featuring 128GB of memory.
Custom binary workaround enables flash attention on AMD RDNA2 GPUs for llama.cpp, doubling inference speed (70-80 tok/s vs stock crash). Only confirmed working with Qwen3.6 35B/27B.
MTP (Multi-Token Prediction) can accelerate LLM inference by 2x, especially for coding agents. This video demonstrates performance improvements with Qwen 3.6 on AMD Strix Halo and Dual Radeon 9700.
Lisa Su, CEO of AMD, announces a compact AI development PC that can locally run models with up to 200 billion parameters.
AMD's Ryzen AI Max platform with 128GB unified memory enables local inference of large models up to 200 billion parameters, aiming to shift AI workloads from cloud to compact personal hardware.
An amusing anecdote about AMD CEO Lisa Su being mistaken for a random passerby during an F1 event, where she humorously replied that she works at AMD and sponsors the Ferrari team.
A novel software-based attack misconfigures the Infinity Fabric to break AMD SEV-SNP security guarantees, allowing a malicious hypervisor arbitrary read/write access to confidential virtual machines.
AMD's ROCm 7.13 tech preview adds optimizations for Strix Halo (Ryzen AI Max 300) and open-sources the ROCprof Trace Decoder.
Benchmarks of MTP (Multi-Token Prediction) in llama.cpp on Strix Halo show significant speedups for 27B Qwen models in long-context chat, but mixed results for 35B models.
New course 'Transformers in Practice' from deeplearning.ai and AMD teaches practical understanding of transformer-based LLMs, covering text generation, attention mechanisms, and inference optimization techniques like quantization and KV caching.