Harbor v0.4.19 - vllm/sglang/llama.cpp launch codex/claude/pi/opencode

Reddit r/LocalLLaMA Tools
harbor local-inference agentic-tools cli llm-gateway open-source

Summary

Harbor v0.4.19 adds the ability to launch local agentic coding tools with local inference backends, integrating vllm, sglang, and llama.cpp, and includes a built-in LLM gateway for tool injection like web search.

I'm usually not posting about Harbor releases out of the respect for the community here, but I think v0.4.19 might save a lot of people some time. Harbor can now launch your local agentic coding tools with local inference backends. For example, to run pi + vllm: # model downloaded and configured harbor up vllm # Harbor knows that vllm is running and will use it harbor launch pi Additionally, `launch` can proxy requests through built-in optimising LLM gateway which automatically injects and resolves tools, such as web search, so you can add web search to an agent by just appending `--web` to the command and Harbor will pre-wire everything: harbor launch --web --model qwen3.5:4b --backend ik_llamacpp mi -p 'Find recent releases of agentic tools and write a two sentence overview' You can find many more details in the wiki here: [https://github.com/av/harbor/wiki/3.-Harbor-CLI-Reference#harbor-launch-launch-options---service-servicetool-args](https://github.com/av/harbor/wiki/3.-Harbor-CLI-Reference#harbor-launch-launch-options---service-servicetool-args) Thank you!
Original Article

Similar Articles

Harbor

Product Hunt

Harbor is a CLI and companion tool for spinning up complete local LLM stacks.

ggml-org/llama.cpp

GitHub Trending (daily)

llama.cpp is an open-source C/C++ library for efficient LLM inference on local hardware, supporting various quantization methods and multiple backends (CPU, GPU, etc.).