Tag
The user recommends OmniRouter as a centralized model proxy that can access multiple model sources, deployed on a VPS and with maintenance simplified via hermes.
A thread sharing a structured install order for agentic projects: using direnv with a secrets manager for credential safety, litellm or portkey as a model proxy for cost and fallback management, uv+git commits on passing evals for reproducibility, and mitmproxy for full observability of LLM calls. Highlights common failure modes and security gaps.