Giving LLMs exec() power is a security nightmare. I built a open-source AST-based guardrail to stop malicious agent execution.
Summary
Introduces ast-guard, an open-source AST-based security tool that prevents malicious code execution from LLM-generated Python strings by parsing them into an abstract syntax tree and applying node-level whitelisting and context-aware safety checks.
Similar Articles
built an agent where the LLM is structurally forbidden from writing the final output. looking for feedback + people willing to break it
The author describes an AI agent designed to reproduce production Python crashes using LangGraph, featuring a unique architecture where the LLM plans actions but deterministic Python functions generate the final test code to ensure reliability.
@GoogleCloudTech: An LLM's job is reasoning, not security. Relying solely on built-in model guardrails leaves you open to advanced attack…
Google Cloud Tech session on securing multi-agent LLM systems using defense-in-depth strategies, including Sensitive Data Protection and Model Armor to prevent prompt injections and data leaks.
Is it ever possible to have a malicious LLM with a backdoor
Discusses the possibility of LLMs containing backdoors triggered by secret sentences or conditions, and the relative risks of closed vs open-source models.
PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediation
PropGuard is a propagation-aware framework for safeguarding LLM-based multi-agent systems (LLM-MAS) from malicious instructions that propagate across agents and rounds. It constructs a dual-view spatio-temporal graph and uses a GE-GRPO trained inspector to detect and remediate suspicious propagation subgraphs.
@amitiitbhu: How do LLM guardrails work? Read here:
A practical guide explaining how LLM guardrails work, why they are needed, where they sit on input and output, how to implement them with code, and best practices.