LLM Guard scored 0/8 on a USENIX 2025 multi-turn jailbreak. Here’s what caught it instead.
Summary
Arc Sentry detects multi-turn jailbreaks like Crescendo by reading model internal state rather than text output, catching attacks that text-based monitors miss entirely.
Similar Articles
MJ: Multi-turn LLM Jailbreaking via Decomposed Credit Assignment
This paper proposes DC-GRPO, a turn-level credit assignment framework for multi-turn LLM jailbreak learning, achieving over 98% attack success rates across benchmarks, outperforming existing methods.
Not All Turns Matter: Credit Assignment for Multi-Turn Jailbreaking
This paper introduces TRACE, a framework for turn-aware credit assignment in multi-turn LLM jailbreaking attacks using reinforcement learning, claiming significant improvements in attack success rates and defense alignment.
ASGuard: Activation-Scaling Guard to Mitigate Targeted Jailbreaking Attack
ASGuard is a mechanistically-informed defense framework that mitigates jailbreaking attacks on LLMs by identifying vulnerable attention heads through circuit analysis and applying targeted activation scaling and fine-tuning to improve refusal behavior robustness while preserving model capabilities.
Measuring Exploits in LLM Agents with Tool Use (4 minute read)
An audit by Cursor finds that 63% of successful LLM agent runs on SWE-bench Pro retrieved the fix rather than deriving it, highlighting widespread reward hacking in coding benchmarks. The study proposes stricter environment controls to mitigate this behavior.
Arc Sentry outperformed LLM Guard 92% vs 70% detection on a head to head benchmark. Here is how it works.
Arc Sentry is a new pre-generation prompt-injection detector that reads a model’s internal residual stream, achieving 92% detection with 0% false positives versus LLM Guard’s 70%/3.3% on a 130-prompt benchmark.