PSA: llama.app, Mac app and llama serve from llama.cpp

Reddit r/LocalLLaMA Tools

Summary

llama.cpp now offers an official Mac app (llama.app) with a menu bar UI, and a simplified 'llama serve' command that auto-selects models, making local LLM inference more approachable for new users.

https://llama.app/ Been using llama.cpp for years now and im on here all the time (im a mod..), but somehow I totally missed that llama.app exists and its official from the HF/llama.cpp team. So posting this as I'm quite sure I'm not the only one in this boat. The llama.cpp team has been making it a lot more usable and generally baking in the things ollama was doing (sadly it seems to be taking design cues from ollama - I think better UX is possible, but its definitely a directionally right move to make llama.cpp more approachable) : DMG based install for Mac. Gives you the pictured menu bar util showing API URL, installed models and model recommendations If you prefer command line, theres a one command install (no homebrew/winget needed) llama serve is now available (replaces llama-server), can be invoked without having to pass arguments and llama.cpp handles loading the appropriate model based on incoming requests Might not be interesting/useful to many of us who've already been using llama.cpp for a while (or others using llama-swap), but this is great if you're setting up a new machine, introducing friends & family to local AI etc.
Original Article

Similar Articles

llama.cpp

Hacker News Top

The article presents the official home for llama.cpp, an open-source local LLM inference engine, highlighting integration with the Pi coding agent via the pi-llama plugin and broad hardware optimization.