Prompt injection, RAG poisoning, and embedding attacks: AMA with OWASP LLM Top 10 co-lead Arshi Chadha (Thursday, Aug 20 at 5 PM)
Summary
Join an AMA with Arshi Chadha, co-lead of OWASP LLM Top 10, discussing prompt injection, RAG poisoning, and embedding attacks in AI systems.
Similar Articles
@OpenHandsDev: AI agents are a new attack surface. Join @OpenHandsDev and @GraySwanAI for a sharp discussion on prompt injection, agen…
OpenHands and Gray Swan are hosting an event to discuss AI agent security risks, including prompt injection and agent-specific threats, and how to build secure agents.
How are you all handling prompt injection for agents that read external content?
A discussion about handling prompt injection attacks in AI agents that read external content like emails and webpages, exploring production-level defenses and the subtle threats beyond obvious patterns.
Understanding prompt injections: a frontier security challenge
OpenAI publishes guidance on prompt injection attacks, a social engineering vulnerability where malicious instructions hidden in web content or documents can trick AI models into unintended actions. The company outlines its multi-layered defense strategy including instruction hierarchy research, automated red-teaming, and AI-powered monitoring systems.
Prompt Injection Through Tool Output (8 minute read)
The article explains how untrusted tool output in AI systems can be exploited for prompt injection attacks, emphasizing the need to treat certain fields as untrusted even within internal systems.
Insights on Indirect Prompt Injection (12 minute read)
Zico Kolter and Matt Fredrikson, leaders at Gray Swan and experts in AI security, discuss the state of AI red-teaming and indirect prompt injection, a critical vulnerability for AI agents. They explain why AI security requires a different mindset, how automated red-teaming can beat humans, and introduce tools like Shade for adversarial testing.