Why doesn't any OSS tool treat llama.cpp as a first class citizen?

Reddit r/LocalLLaMA News
llama-cpp open-source local-llm developer-tools ollama ai-tooling

Summary

A developer argues that llama.cpp deserves first-class support in OSS AI coding tools, criticizing the ecosystem's preference for Ollama and calling for more flexible, endpoint-agnostic integrations.

Be it opencode, VS code copilot extension or whatever "open source" AI tool, I rarely see llama.cpp treated as a first class provider? Every single one of them has ollama and sometimes LMStudio. Engineering wise there's literally 0 effort to have llama.cpp be listed the same as ollama. Or better yet, simply make it a label agnostic openai API compatible endpoint and let me fill in the port number/enpoint.. This is especially annoying as ollama is the scummy turncoat stealing from llama.cpp that still has the mindshare despite it being clear as day that they are not good members of the OSS ecosystem. llama.cpp is now very usable for the average dev (majority of userbase currently) and reasonably so for the average joe. I'm high key hoping that this post will reach devs who are making these tools..
Original Article

Similar Articles

llama.cpp is the linux of llm

Reddit r/LocalLLaMA

The article draws a parallel between llama.cpp and Linux, positioning the open-source library as foundational infrastructure for running large language models.

Automated AI researcher running locally with llama.cpp

Reddit r/LocalLLaMA

ml-intern is a harness for AI agents that integrates with Hugging Face's libraries and now supports running local models via llama.cpp or ollama, enabling an automated AI researcher to run 24/7 on a laptop.

ggml-org/llama.cpp

GitHub Trending (daily)

llama.cpp is an open-source C/C++ library for efficient LLM inference on local hardware, supporting various quantization methods and multiple backends (CPU, GPU, etc.).