CTF focused on AI security - prompt injection, agent hijacking, safety bypass (June 17-22)

Reddit r/ArtificialInteligence Events
ctf ai-security prompt-injection agent-hijacking guardrail-bypass open-source cybersecurity

Summary

A free CTF competition focused on AI security, with challenges on prompt injection, agent hijacking, and guardrail bypass. Runs June 17-22, with $1,000+ prize pool.

Hi all, I'm a DevRel at KubeArmor here (open source CNCF project). We're running a CTF that's entirely about AI security, specifically the practical attack surfaces in LLMs and AI agents. **Three challenge tracks:** * **Prompt Injection** \- Breaking system instructions, exploiting multi-turn conversations, bypassing safety filters through indirect techniques * **Agent Hijacking** \- Making AI agents misuse their tools, poisoning their data and memory, chaining exploits * **Guardrail Bypass** \- Finding hidden endpoints, intercepting responses before safety layers apply, replaying auth tokens The idea is to give people hands-on experience with the kinds of attacks that are becoming more relevant as AI gets deployed in production. You don't need a security background to participate. The easier challenges are very approachable, and everything runs in your browser with zero setup. 18 challenges, difficulty from beginner to hard. Free, individual play, June 17-22. $1,000+ prize pool.
Original Article

Similar Articles

Free AI Agent Security Assessment

Reddit r/AI_Agents

Antitech is offering free early-access security assessments for AI agents, testing against attack vectors like prompt injection, tool abuse, and data leakage, providing a vulnerability report and discounts for participants.

Understanding prompt injections: a frontier security challenge

OpenAI Blog

OpenAI publishes guidance on prompt injection attacks, a social engineering vulnerability where malicious instructions hidden in web content or documents can trick AI models into unintended actions. The company outlines its multi-layered defense strategy including instruction hierarchy research, automated red-teaming, and AI-powered monitoring systems.

AI Agent Security - MIT 6.566 guest lecture

Lobsters Hottest

Guest lecture at MIT 6.566 on AI agent security covering system-level threats, prompt injection, tool-use vulnerabilities, and demonstrations with LLMs like GPT-5.4 and Qwen 3.5.

Insights on Indirect Prompt Injection (12 minute read)

TLDR AI

Zico Kolter and Matt Fredrikson, leaders at Gray Swan and experts in AI security, discuss the state of AI red-teaming and indirect prompt injection, a critical vulnerability for AI agents. They explain why AI security requires a different mindset, how automated red-teaming can beat humans, and introduce tools like Shade for adversarial testing.

Working with US CAISI and UK AISI to build more secure AI systems

OpenAI Blog

OpenAI announces collaborative security improvements with US CAISI and UK AISI, highlighting joint red-teaming efforts that discovered and helped remediate novel vulnerabilities in ChatGPT Agent systems through multidisciplinary cybersecurity and AI agent security approaches.