quantized-kv-cache

Tag

Cards List
#quantized-kv-cache

I merged fixes for quantized KV cache into my DeepSeek V4 branch

Reddit r/LocalLLaMA · 2026-07-04

Merged fixes for quantized KV cache into the DeepSeek V4 branch of llama.cpp, with benchmark perplexity results for f16, q8_0, and q4_0 cache types.

0 favorites 0 likes
← Back to home

Submit Feedback