The author argues that pretrained LLMs fail on real company work because they lack a fast learning system akin to the hippocampus to capture specific, scattered work procedures, unlike the human brain's complementary learning systems. They propose consolidating work episodes into approved, versioned procedures with governance as a potential fix.
Here's an argument I've been chewing on: the reason pretrained LLMs fail on real company work is structural, and it maps cleanly onto how human memory is organized. Treat the mapping as an analogy, not a literal claim. Your brain runs two memory systems (Complementary Learning Systems theory, McClelland et al. 1995). The neocortex learns slowly and holds general, world knowledge. The hippocampus learns fast: it captures specific episodes as they happen, then consolidates the ones that recur into durable, reusable procedure. A pretrained LLM basically is the neocortex. It read the internet and holds the world's general knowledge. To a first approximation that problem is solved. What it does not have is a hippocampus: the fast, company-specific memory that watched how your team actually handled a refund last spring and turned that into a repeatable procedure. So you drop this brilliant cortex into a company and it improvises, and improvised automation fails in production. The real procedure was never in the help doc anyway. It lives in the team's conversations, a couple of people's heads, and one exception everyone now quietly copies. This also explains why the usual tools don't fix it. Retrieval and search are only half a hippocampus: they recall a document but don't consolidate scattered episodes into the real procedure, and the document is often confidently wrong. Agent platforms make you run their agent on their stack. If the diagnosis is right, a fix would need to consolidate scattered work episodes (including the exceptions nobody wrote down) into cited, human-approved, versioned procedures that existing agents could run, with a human sign-off on anything sensitive. Governance (citations, approvals, an audit trail) would have to be central, because "your AI issued a refund, under whose authority?" is the question that stops people cold. What I actually want to test: Is "the model doesn't know an organization's actual procedures" the real blocker, or is the bottleneck something else (trust, security, work that just isn't repetitive)? Is the cortex/hippocampus split a useful frame here, or does it break down under scrutiny? For anyone who has run agents on real workflows: what actually made them trustworthy enough to rely on? Genuinely interested in where this argument falls apart.
Gary Marcus highlights recent DeepMind research confirming that LLMs frequently memorize and regurgitate training data, countering past criticism from Geoffrey Hinton. The post underscores ongoing debates about LLM limitations and their real-world capabilities.
A VP/PM with coding background shares hands-on experience using LLMs like Claude Opus and Fable, highlighting limitations in memory, hallucination, and originality while emphasizing the irreplaceable value of human intuition and domain expertise.
This research demonstrates that continuously updating LLM agent memories through distillation and consolidation loops causes performance regression, even when trained on ground-truth solutions. The study finds that episodic-only retention outperforms text-based consolidation, highlighting significant flaws in current self-improvement paradigms.
The article discusses why LLMs cannot learn from user interactions and lack a deterministic truth layer, proposing that a dynamic knowledge graph could reduce hallucinations and improve performance in high-stakes fields.
Microsoft researchers propose a biologically-inspired memory architecture for LLM agents that incorporates mechanisms like sleep-phase consolidation and interference-based forgetting to manage persistent memory efficiently.