@DailyDoseOfDS_: A harnessed LLM agent, clearly explained! Most people picture this as a model with tools bolted on. The real architectu…
Summary
Explains the inverted architecture of a harnessed LLM agent, where intelligence is externalized into memory, skills, and protocols around a thin model core, with mediators governing interactions.
View Cached Full Text
Cached at: 07/02/26, 10:20 AM
A harnessed LLM agent, clearly explained!
Most people picture this as a model with tools bolted on. The real architecture inverts that relationship.
The model itself is deliberately thin. Intelligence gets pushed outward, and the harness composes it at runtime.
Three dimensions orbit the harness core:
-
𝗠𝗲𝗺𝗼𝗿𝘆 holds the state a model shouldn’t carry in weights or context. Working context, semantic knowledge, episodic experience, and personalized memory each have their own lifecycle.
-
𝗦𝗸𝗶𝗹𝗹𝘀 hold procedural knowledge. This can cover operational procedures, decision heuristics, and normative constraints that specialize the general model per task.
-
𝗣𝗿𝗼𝘁𝗼𝗰𝗼𝗹𝘀 hold the interaction contracts. Agent-to-user, agent-to-agent, and agent-to-tools are three distinct surfaces with their own failure modes.
Between the core and these modules sit the mediators, like sandboxing, observability, compression, evaluation, approval loops, and sub-agent orchestration.
They govern how the harness reaches out and how state flows back in.
The useful question this framing unlocks is: for any new capability, where should it live?
- Stable knowledge goes to memory
- Learned playbooks go to skills
- Communication contracts go to protocols
- Loop governance goes to the mediators
Harness design becomes a question of what to externalize, and how to mediate it.
We wrote an article about the anatomy of Agent Harness, covering the orchestration loop, tools, memory, context management, and everything else that transforms a stateless LLM into a capable agent.
Read it below.
Similar Articles
@cwolferesearch: What is an agent? The definition can be pretty simple: it’s just an LLM that runs within an agentic loop. To make this …
A clear definition of an AI agent as an LLM within an agentic loop, covering components like LLM backbone, instructions, tools, environment, and additional details like context management and memory.
@j_golebiowski: The next agent stack: a frontier LLM as orchestrator, fine-tuned SLMs as skills. For PII redaction, the orchestrator ne…
Describes an agent stack design where a frontier LLM orchestrates fine-tuned small language models for PII redaction, ensuring privacy by keeping raw text local.
best of the best agentic harnesses do this…
The author shares insights on building effective agent harnesses: the best ones minimize LLM reliance for trivial tasks and reserve LLMs for complex reasoning, distinguishing genuine harnesses from simple wrappers.
@janehu07: https://x.com/janehu07/status/2058359677843599494
This learning note introduces the concept of an agent harness as the infrastructure layer around an LLM, proposing the ETCLOVG taxonomy (Execution, Tooling, Context, Lifecycle, Observability, Verification, Governance) and demonstrating its application through a coding agent case study.
@gneubig: We've found this sort of "sidekick" architecture to be very effective at cutting LLM spend because it allows you to do …
Graham Neubig shares a sidekick architecture for reducing LLM costs by delegating simple tasks to a smaller agent, with a 200-line example using the OpenHands SDK. This approach is also used in Cognition's Devin Fusion hybrid-model harness.