battlemage

Tag

Cards List
#battlemage

llama.cpp PR reports up to 169% faster quantized-KV decode at 118K context on Intel Battlemage from one SYCL kernel switch

Reddit r/LocalLLaMA · yesterday

A llama.cpp PR proposes switching quantized-KV decode from the VEC to TILE SYCL kernel on Intel Battlemage, reportedly delivering up to ~169% faster decode at 118K context. The PR is open with caveats and limited independent verification.

0 favorites 0 likes
← Back to home

Submit Feedback