Tag
A developer built llmux, an open-source tool to simplify managing model profiles across different engines like vLLM and llama.cpp, allowing one-click switching with Docker and NVIDIA GPU support.
Ketch is a search tool designed for finding and managing local AI models.
llama.cpp now supports model management including downloading and lifecycle management via its API, allowing full deployment without external tools.
EchoBird is an open-source desktop client that integrates AI tool installation, local large model running, and application management, supporting one-click configuration and unified API management.
oMLX v0.4.0 ships a native Swift macOS app with redesigned onboarding, settings UI, Hugging Face cache discovery, and improved model management for running local AI on Macs.
A practical guide to organizing local LLM experiments by using a layered wrapper system and a consistent directory structure to avoid model location drift, flag amnesia, and harness coupling.