Why doesn't any OSS tool treat llama.cpp as a first class citizen?

Reddit r/LocalLLaMA News
llama-cpp open-source local-llm developer-tools ollama ai-tooling

Summary

A developer argues that llama.cpp deserves first-class support in OSS AI coding tools, criticizing the ecosystem's preference for Ollama and calling for more flexible, endpoint-agnostic integrations.

Be it opencode, VS code copilot extension or whatever "open source" AI tool, I rarely see llama.cpp treated as a first class provider? Every single one of them has ollama and sometimes LMStudio. Engineering wise there's literally 0 effort to have llama.cpp be listed the same as ollama. Or better yet, simply make it a label agnostic openai API compatible endpoint and let me fill in the port number/enpoint.. This is especially annoying as ollama is the scummy turncoat stealing from llama.cpp that still has the mindshare despite it being clear as day that they are not good members of the OSS ecosystem. llama.cpp is now very usable for the average dev (majority of userbase currently) and reasonably so for the average joe. I'm high key hoping that this post will reach devs who are making these tools..
Original Article

Similar Articles

Stop using Ollama

Reddit r/LocalLLaMA

Ollama faces criticism for failing to properly credit the llama.cpp project it depends on, violating MIT license requirements, and taking venture capital funding while drifting from its local-first mission.

llama.cpp is the linux of llm

Reddit r/LocalLLaMA

The article draws a parallel between llama.cpp and Linux, positioning the open-source library as foundational infrastructure for running large language models.

llama.cpp

Hacker News Top

The article presents the official home for llama.cpp, an open-source local LLM inference engine, highlighting integration with the Pi coding agent via the pi-llama plugin and broad hardware optimization.