We have sub-agents at home
Summary
A developer shares a forked sub-agent repository for pi coding agent that works with a single local LLM slot and limited VRAM, using llama.cpp server and quantized models. The post also discusses performance with the Apex Qwen variant using MTP.
Similar Articles
Running local LLM's as agents in Claude Code
This article presents a custom MCP setup that enables offloading coding tasks from Anthropic's Claude models to local Qwen3.8-27B models within the same session, using tools like llama.cpp.
Help optimizing llama.cpp + Qwen 27B on RTX PRO 6000 Blackwell for coding agents
A user details their setup running Qwen 27B with llama.cpp on an RTX PRO 6000 Blackwell for local coding agents, compares performance to Claude models, and asks for help resolving frequent crashes and malformed response issues.
@dangerm00se: The main thing I had fable doing was routing moa and rlm experiments spanning local api and cerebras. Get your agent to…
The author shares findings from Hermes Mixture-of-Agents experiments, including voter upgrades, GPU topology, and caching economics, showing that local prefix caching can make long agent sessions nearly free and that two independent GPU instances outperform a single partitioned one.
An agent that plans with a frontier model but runs most of tokens locally (built it for my own dual-3090 rig)
The author built a personal AI agent that uses a frontier model (Codex) for high-level planning while running most token processing locally on a dual RTX 3090 system, enabling long-duration tasks with deterministic validation. The agent supports three swappable tiers: planner, local, and senior, and is available as an open-source repository.
@TheAhmadOsman: You can run local models at home and use any agent harness like Codex or Claude Code with them
Ahmad built a simple tool that makes Claude Code work with any local LLM, demonstrated using vLLM serving GLM-4.5 Air on 4x RTX 3090s.