Tag
llama.cpp 新增对 Cohere 系列模型的支持,继续扩展其 C/C++ 本地 LLM 推理框架的模型兼容性。
llama.cpp 项目介绍:一个以 C/C++ 实现的轻量级 LLM/VLM 推理引擎,支持多种硬件后端,可在从服务器到树莓派等各类设备上运行,并提供命令行工具与 OpenAI 兼容的 API 服务。
build2 的 Boris Kolpackov 撰文分析 autoconf/CMake 式编译探测配置的四大问题(浪费、脆弱、缓慢、缺乏变更追踪),并提出基于期望(expectation-based configuration)的替代方案。
A GitHub repository offers a complete, byte-identical decompilation of Resident Evil 4 for the Nintendo GameCube to C/C++, with build tools and verification methods to reproduce the original binaries.
llama.cpp releases version b11003, a C/C++ tool for efficient large language model inference with minimal setup on a wide range of hardware.
llama.cpp now supports MTP (Multi-Token Prediction) for GLM-Air models, enhancing inference capabilities for large language models in C/C++.
Llama.cpp v0.1.0 is a C/C++ implementation for efficient LLM and VLM inference, supporting a wide range of hardware with minimal setup and high performance.
DFlash support has been merged into llama.cpp, improving inference performance for compatible models.
This pull request by ggerganov optimizes kv-cache in llama.cpp to avoid unnecessary copies of kv cells, improving inference performance. It is a contribution to the open-source LLM inference library llama.cpp.
Llama.cpp announces a new website and unified 'llama' binary for simpler LLM inference, along with updates like Hugging Face cache migration and multimodal support.
This pull request adds support for continuing generation on reasoning models within the llama.cpp server and WebUI.
A lightweight C/C++ inference engine for diffusion models, supporting a wide range of image and video generation models with active development and day-0 support for new releases.