@AdamRLucek: Do agents listen to you… or themselves? While evaling subagent behavior in deep agent systems, we noticed an interestin…
Summary
A researcher shares an observation in evaluating subagent behavior within deep agent systems, noting an interesting quirk in how agents align with hand-written system prompts versus instructions from the orchestrator.
View Cached Full Text
Cached at: 05/21/26, 07:37 PM
Do agents listen to you… or themselves? While evaling subagent behavior in deep agent systems, we noticed an interesting quirk in our agents’ alignment with hand-written system prompts vs. the instructions given by the orchestrator 1/4
On a ‘needle in a haystack’ style classification eval, where a main agent relies on multiple subagents to parse through many large (million+ token) datapoints and cluster them into related groups, we saw varying performance and behavior changes depending on the length and specificity of additional instructions sent to the subagent by the orchestrator 2/4
While our subagent system prompt was generally directional and open-ended, some models provided detailed rubrics and guidelines that resulted in wayyyy too strict behavior and limited the subagent’s creative execution, hurting end performance. These larger briefs from the agent often directionally overrode the looser behavior we wanted to encourage from our prompting 3/4
The takeaway? It’s important to consider and measure not just how you are prompting a subagent, but how your primary agent is prompting it too. The relationship an agent has with its subagent delegations can make or break the overall system’s success 4/4
On the money! Directional over exact
Maybe we’ve hit AGI already…
Any tips?
Similar Articles
@no_stp_on_snek: if you build multi-agent or mixture-of-agents systems, read @dangerm00se's writeup. the finding that stuck with me: eve…
A user highlights a finding from Hugh Madden's writeup on multi-agent systems: even a strong arbiter (GPT-5.5) can be biased by seeing weaker agents' outputs first, collapsing from ~98% solo accuracy to 7/9.
The longer an agent runs, the less I care about the prompt
The author reflects on how long-running AI agents encounter failures unrelated to the initial prompt, arguing that environment design (tools, docs, validation, architecture rules) matters more. They discuss concepts like harness engineering, keeping AGENTS.md small, using linters, and evaluator agents, while noting the cost trade-offs.
been experimenting with custom agents, and the interesting part isn't task completion — it's what changes when they have memory
The author reflects on experimenting with custom AI agents, noting that long-term memory and continuity transform them from simple task runners into persistent collaborators with 'stable dispositions'. This raises questions about the value of agent 'personality' versus the need for control, reliability, and auditability in workflows.
Anyone else feel like AI agents are amazing right up until things get complicated?
A reflection on the gap between impressive AI agent demos and dependable real-world execution, arguing that current agents excel at structured tasks but fail under unpredictable conditions, suggesting near-term AI roles will focus on narrow automation with human oversight.
Build AI Agent for Company
The author shares lessons from building an agentic system at work, describing failures with a giant prompt, excessive tools, and dynamic sub-agents, and ultimately finding success with a fixed orchestrator and specialized child agents for each domain.