Tag
DFlash support has been merged into llama.cpp, improving inference performance for compatible models.
This pull request by ggerganov optimizes kv-cache in llama.cpp to avoid unnecessary copies of kv cells, improving inference performance. It is a contribution to the open-source LLM inference library llama.cpp.
Llama.cpp announces a new website and unified 'llama' binary for simpler LLM inference, along with updates like Hugging Face cache migration and multimodal support.
This pull request adds support for continuing generation on reasoning models within the llama.cpp server and WebUI.