FARMA: a memory-poisoning attack that forges an agent's own decision logs, not its retrieved facts
Summary
FARMA is a novel memory-poisoning attack that targets an agent's own decision logs rather than retrieved facts, achieving 100% attack success against undefended and defended systems, with the authors' defense SENTINEL reducing success to 0% but remaining vulnerable to adaptive attackers.
Similar Articles
When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
This paper introduces GhostWriter, a novel attack vector that exploits memory subsystems in LLM-powered personal agents to poison their memory store, achieving high injection and activation rates. The authors propose AM-Sentry, a defense that significantly reduces attack success while maintaining agent utility.
MemAudit: Post-hoc Auditing of Poisoned Agent Memory via Causal Attribution and Structural Anomaly Detection
MemAudit is a post-hoc auditing framework for memory-augmented LLM agents that identifies poisoned memories by combining counterfactual influence scores and structural anomaly detection, reducing attack success rates from over 70% to 0% in realistic scenarios.
I tried to poison an AI agent's memory. It worked 216 out of 216 times, and the dev shipped fixes within a month.
A researcher demonstrated successful memory poisoning attacks on an AI agent's memory server, achieving a 100% success rate, leading to fixes in Knowl 5.24.0, though some vulnerabilities persist.
'Self-State Attacks' Formalize a New Threat Class: AI Agents Poisoned via Their Own Memory Files, OS Defenses Structurally Insufficient
A new arxiv paper by Yimeng Chen et al. formalizes 'self-state attacks' against AI agents, where an agent's own memory and configuration files are poisoned via legitimate OS calls. The authors evaluate OS-level defenses and identify structural limitations, suggesting the need for application-layer integrity measures.
Agent memory is not just RAG over user facts
The article argues that simple RAG-based agent memory systems fail in production due to issues like stale preferences, missed keywords, and prompt injection, and advocates for a layered memory architecture with active selection, deterministic fallback, governance, and testing.