defenses

Tag

Cards List
#defenses

A GHOST in Long-Horizon Agents: Governance Hazard from Overlooked Safety Constraints across Turns

arXiv cs.AI ↗ · 2026-10-05 Cached

This paper introduces GHOST, a failure mode where long-horizon LLM agents violate safety constraints specified many turns earlier under benign interactions, finding an 11.5% occurrence rate on GPT-5.5, and proposes STAR-Guard, a two-layer defense combining historical safety-constraint restoration with a pre-execution audit that eliminates GHOST events in experiments.

0 favorites 0 likes
#defenses

Distillation Defenses Easily Break After Reinforcement Learning

Hugging Face Daily Papers ↗ · 2026-09-28 Cached

This paper argues that existing defenses against distillation attacks in large language models are ineffective when attackers further train their models with reinforcement learning, highlighting potential flaws in current threat models.

0 favorites 0 likes
#defenses

Upholding Robustness in Federated Learning: Trends, Emerging Strategies, and Research Opportunities

arXiv cs.LG ↗ · 2026-09-25 Cached

This paper provides a comprehensive survey of robustness in federated learning, covering threat models, aggregation strategies, defensive tactics, and future research directions.

0 favorites 0 likes
#defenses

When Agents Learn to Be You: Benchmarking Privacy Leakage, Impersonation Risk, and Defenses in Persona Skills

Hugging Face Daily Papers ↗ · 2026-08-04 Cached

Introduces AntiSkillBench, a benchmark for evaluating privacy leakage, impersonation risk, and defenses in persona-skill pipelines for AI agents, finding that risks persist across backbones and existing defenses are limited.

0 favorites 0 likes
#defenses

Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?

Hugging Face Daily Papers ↗ · 2026-07-20 Cached

This paper investigates OS resilience against self-state attacks on self-hosted AI agents, characterizing an attack space and evaluating layered defense strategies. It finds that while a layered defense stack is effective, a small residual attack surface remains structurally indistinguishable at the OS level.

0 favorites 0 likes
#defenses

How are you all handling prompt injection for agents that read external content?

Reddit r/AI_Agents ↗ · 2026-07-04

A discussion about handling prompt injection attacks in AI agents that read external content like emails and webpages, exploring production-level defenses and the subtle threats beyond obvious patterns.

0 favorites 0 likes
#defenses

@MaxForAI: Hacker Vitto Rivabella publicly announced that Fable 5 has been broken again. He said most jailbreak attempts have failed, and the defenses are clearly layered. The model is extremely well protected (of course it blocks 90% of requests, but they did a really good job). The model seems to perform security checks on both input and output...

X AI KOLs Timeline ↗ · 2026-07-03 Cached

Hacker Vitto Rivabella publicly announced the successful jailbreak of Fable 5, analyzing in detail the model's multi-layered security mechanisms, including input/output auditing, intent detection, and chain-of-thought defense, and provided methods to bypass them.

0 favorites 0 likes
← Back to home

Submit Feedback