multi-socket

Tag

Cards List
#multi-socket

I forked ik_llama.cpp and added a "--numa mirror" mode to maximize performance on multi-socket CPU systems. Just sharing and looking for testers!

Reddit r/LocalLLaMA · 2026-06-21

A developer forked ik_llama.cpp and added a '--numa mirror' mode that duplicates model weights and KV cache across NUMA nodes to maximize multi-socket CPU inference performance, sharing benchmarks and seeking testers.

0 favorites 0 likes
← Back to home

Submit Feedback