dma-throughput

Tag

Cards List
#dma-throughput

Getting 50 GB/S Back from the Apple Neural Engine

Hacker News Top ↗ · 2026-09-10 Cached

A performance throttle in the Apple M3 Neural Engine was discovered when weight sizes are multiples of 1 MiB, causing throughput drops. By avoiding the problematic DMA path, token throughput for models like Llama 3.2 and Qwen3-8B was significantly improved.

0 favorites 0 likes
← Back to home

Submit Feedback