A minimal 2-step LLM chain (not a full agent framework) solving one specific problem: fitting a planner + coder pipeline on a single GPU
Summary
A minimal 2-step LLM chain that implements a planner + coder pipeline, designed to fit on a single GPU without requiring a full agent framework.
Similar Articles
Local LLM autocomplete + agentic coding on a single 16GB GPU + 64GB RAM
A technical guide on setting up local LLM autocomplete (Qwen2.5-Coder-7B) and agentic coding (Qwen3.6-35B-A3B) on a single 16GB GPU with 64GB+ RAM using llama.cpp, including commands and performance benchmarks.
Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation
This paper introduces CUDAnalyst, a tool for analyzing how individual feedback signals influence planning decisions in self-evolving LLM agents for CUDA kernel generation, using trajectory freezing and selective feedback injection to enable controlled attribution.
An agent that plans with a frontier model but runs most of tokens locally (built it for my own dual-3090 rig)
The author built a personal AI agent that uses a frontier model (Codex) for high-level planning while running most token processing locally on a dual RTX 3090 system, enabling long-duration tasks with deterministic validation. The agent supports three swappable tiers: planner, local, and senior, and is available as an open-source repository.
From Human Guidance to Autonomy: Agent Skill System for End-to-End LLM Deployment on Spatial NPUs
This paper presents a two-stage methodology for end-to-end LLM deployment on spatial NPUs, progressing from human-guided development to an autonomous agent skill system. The system achieves speedups of 2.2x on prefill and 4.0x on decode for a reference model, and autonomously deploys eight additional LLMs on AMD XDNA 2 NPU with minimal human guidance.
built an agent where the LLM is structurally forbidden from writing the final output. looking for feedback + people willing to break it
The author describes an AI agent designed to reproduce production Python crashes using LangGraph, featuring a unique architecture where the LLM plans actions but deterministic Python functions generate the final test code to ensure reliability.