'Self-State Attacks' Formalize a New Threat Class: AI Agents Poisoned via Their Own Memory Files, OS Defenses Structurally Insufficient
Summary
A new arxiv paper by Yimeng Chen et al. formalizes 'self-state attacks' against AI agents, where an agent's own memory and configuration files are poisoned via legitimate OS calls. The authors evaluate OS-level defenses and identify structural limitations, suggesting the need for application-layer integrity measures.
Similar Articles
Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?
This paper investigates OS resilience against self-state attacks on self-hosted AI agents, characterizing an attack space and evaluating layered defense strategies. It finds that while a layered defense stack is effective, a small residual attack surface remains structurally indistinguishable at the OS level.
When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
This paper introduces GhostWriter, a novel attack vector that exploits memory subsystems in LLM-powered personal agents to poison their memory store, achieving high injection and activation rates. The authors propose AM-Sentry, a defense that significantly reduces attack success while maintaining agent utility.
The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systems
This paper identifies a structural failure in multi-agent AI pipelines where memory-layer attacks can be misattributed as model misalignment, formalizing Semantic Norm Drift (SND) and proposing Counterfactual Composition Testing and Memory-Persistent Information-Flow Control as defenses.
Data poisoning and RAG manipulation
A discussion of how data poisoning and RAG manipulation pose a silent, dangerous threat to AI systems, arguing that security must extend beyond input filtering to memory, data pipelines, and multi-agent logic.
State Contamination in Memory-Augmented LLM Agents
This paper identifies and studies 'memory laundering' in LLM agents, where toxic or adversarial context compressed into memory summaries evades standard toxicity detectors while still influencing future generations. It introduces the sub-threshold propagation gap (SPG) to measure hidden downstream influence and shows that sanitizing toxic state before summarization is more effective than post-hoc cleaning.