If you're using Windows, disable memory compression to stop bottlenecks!
Summary
A user shares a fix for performance bottlenecks when running AI models on AMD GPUs in Windows 11 by disabling memory compression via the command 'Disable-mmagent -mc'.
Similar Articles
16 GB VRAM purgatory discussion thread
A discussion thread sharing configurations and tips for running AI models like Qwen3.8-27B on 16 GB VRAM Windows systems, focusing on memory optimization techniques.
FIXED 7900 xtx + headless Linux crashes (Low RAM OOM) amdgpu.runpm=0
The user fixed crashes when running large AI models on an AMD GPU in headless Linux by disabling runtime power management, preventing model weights from being dumped into limited RAM and causing OOM errors.
Now the bottleneck is compression / memory (and a little on input filtering)
The author argues that the bottleneck in AI lies in memory and compression, comparing LLMs to human memory efficiency and suggesting improved tool integration for better performance.
Memory Bandwidth for Local AI Hardware (2026 Edition)
The article breaks down memory bandwidth as the critical metric for local AI hardware performance, comparing current GPUs and unified memory systems from NVIDIA, Apple, AMD, Intel, and others across different performance tiers.
Drastically improve prompt processing speed for --n-cpu-moe partially offloaded models
The article shares a performance optimization trick for llama.cpp, showing that increasing the micro-batch size (`-ub`) combined with partial CPU offloading (`--n-cpu-moe`) can drastically improve prompt processing speed for large models like gpt-oss-120b on consumer GPUs.