Tag
The author looked into Magpie, praising it as incredibly powerful — essentially the ultimate local model relay station that can route tokens pieced together from all over into any harness.
The user recommends OmniRouter as a centralized model proxy that can access multiple model sources, deployed on a VPS and with maintenance simplified via hermes.
A thread sharing a structured install order for agentic projects: using direnv with a secrets manager for credential safety, litellm or portkey as a model proxy for cost and fallback management, uv+git commits on passing evals for reproducibility, and mitmproxy for full observability of LLM calls. Highlights common failure modes and security gaps.