Llama.cpp now has full MCP support!

Reddit r/LocalLLaMA Tools
llama-cpp mcp open-source agentic local-ai coding tools

Summary

llama.cpp now fully supports the Model Context Protocol (MCP) for all protocols, enabling agentic chat and tool integration directly in its WebUI without external dependencies.

After a long and grueling effort spearheaded by ngxson, llama.cpp now fully supports MCP for all protocols. Over-the-web HTTP servers were already supported in the client (since they don't require any sort of plumbing), but stdio servers required real integration. After we modified the `llama-cli` terminal client to use the server instead of a separate model serving route, we could add MCP support to the already-existing native tools server. After the merging of https://github.com/ggml-org/llama.cpp/pull/26062, you can now use llama.cpp's WebUI as a full-fledged agentic chat. Configuration for the MCP servers can be provided either in a standard-JSON format config file or completely inline on the command-line for on-demand MCP configurations. Plugging in a dedicated coding MCP server like Serena lets you have a local-model-powered agentic coder without using any other external dependencies.
Original Article

Similar Articles

llm-mcp-client 0.1a0

Simon Willison's Blog

Simon Willison announces the initial alpha release of llm-mcp-client, a Python client for the Model Context Protocol.

llama.cpp

Hacker News Top

The article presents the official home for llama.cpp, an open-source local LLM inference engine, highlighting integration with the Pi coding agent via the pi-llama plugin and broad hardware optimization.