c-cpp

llama.cpp now supports MTP (Multi-Token Prediction) for GLM-Air models, enhancing inference capabilities for large language models in C/C++.

Llama.cpp v0.1.0 is a C/C++ implementation for efficient LLM and VLM inference, supporting a wide range of hardware with minimal setup and high performance.

DFlash support has been merged into llama.cpp, improving inference performance for compatible models.

This pull request by ggerganov optimizes kv-cache in llama.cpp to avoid unnecessary copies of kv cells, improving inference performance. It is a contribution to the open-source LLM inference library llama.cpp.

Llama.cpp announces a new website and unified 'llama' binary for simpler LLM inference, along with updates like Hugging Face cache migration and multimodal support.

This pull request adds support for continuing generation on reasoning models within the llama.cpp server and WebUI.