Tag
PIPETTE introduces a unified prompt injection purple-teaming framework using dictionary learning-based rewards and on-policy adversarial training to convert red-teaming discoveries into robust defenses against indirect prompt injection attacks for LLM agents.
A NeurIPS 2026 workshop paper showing that representational geometry, visualized with M-PHATE, can serve as a diagnostic for adversarial robustness, revealing that robust accuracy and representational stability can rank defenses in opposite ways.
A paper introducing 'model annealing', a training scheme that divides training into reheated episodes with a memory of past model states and adversarial 'dreams', improving accuracy, calibration, and robustness over cross-entropy training on small labelled datasets across multiple architectures.
A research paper proposing Structured Confidence Perturbation via Fisher Geometry for adversarial training, aiming to improve model robustness by perturbing confidence estimates according to the geometry of the Fisher information.
提出了 Augmentation-Guided Adversarial Training (AGAT) 框架,利用基于增强的局部稳定性 (ALS) 得分选择不稳定邻域的样本进行对抗训练,在仅对 20–30% 样本施加对抗监督的情况下达到相当或更高的鲁棒准确率,同时降低训练成本。
TAD introduces Trajectory-only Adversarial Distillation, which improves vision-language-action policies using only a fixed bank of teacher trajectories—no teacher action scores or task rewards—via a discriminator providing on-policy rewards, boosting OpenVLA-OFT success rates substantially while trailing white-box on-policy distillation.
Delft University of Technology researchers present the first scalable framework for structural adversarial attacks and adversarial training on multigraph neural networks used for anti-money laundering detection, introducing a cycle-based regularizer to keep perturbations plausible and showing that adversarial training restores detection robustness.
TraceForge 提出一种两阶段(监督+对抗)方法,从教师答案中生成匹配学生模型自身风格的推理轨迹,无需访问隐藏思维链,在 HumanEval+ 和 MBPP+ 等编码基准上显著超越使用教师原始思考内容的训练效果。
This paper introduces Plausibility-EFG, a group-level disparity metric for measuring explanation plausibility gaps across demographic groups in hate speech detection, and proposes Fair-REF, an adversarial rationale regularization strategy that reduces explanation disparities while maintaining classification performance.
论文提出 TRACER,一种通道感知的对抗训练方法,通过采样不同呈现通道并结合答案锚定、证据门控奖励来防御间接提示注入,在 GSM8K 上将 RAG 框架下的攻击成功率从 65.5% 降至 6.1%,同时保持较高的干净准确率。
提出了 MADS(多智能体对话模拟)合成数据生成管线,用于生成含对抗性、失败场景的对话轨迹,并构建了覆盖 6 个领域、55 个角色和 1095 段对话的 MADS-Bench 基准,以评估任务导向对话智能体在非合作用户行为下的鲁棒性。
该论文从理论上解释了对抗训练的神经网络其梯度显著性图呈现稀疏性的现象:对于两层ReLU网络,ℓ∞对抗攻击导致梯度范数各向异性,从而偏好轴对齐/稀疏的梯度。研究在经验风险最小化框架下证明了最小化收敛到具有最小梯度和Barron范数的贝叶斯分类器。
提出RAESR,利用冻结DINOv3-L的23层融合层作为超分辨率的潜空间基底,训练415M解码器将退化嵌入映射回流形,在RealSR、DRealSR、LSDIR和DIV2K-Val上实现最优的保真度-感知权衡,且单张H20 GPU上每512×512图像仅需37ms。
DMAD (Distribution Matching as Adversarial Distillation) recasts distribution matching as a classification problem, learning log-density ratios via discriminator heads to train few-step student models for fast visual generation without auxiliary score fitting. It achieves state-of-the-art results, including FID 1.04 on ImageNet-64x64 with one-step generation and VBench score 85.15 for four-step Wan2.1-T2V-14B.
This preprint uses adversarial training as a controlled instrument on GPT-2 Small to test whether representational simplicity (SAE decomposability, concentrated attribution) implies causal circuit simplicity. It finds that robust models are more SAE-decomposable, while circuit size is regime-dependent: robustness helps at high faithfulness levels (90-95%) but not below 85%.
This paper presents the first systematic study of adversarial post-training for pixel diffusion models, showing it effectively corrects high-frequency content deficiencies to improve distribution fidelity, coverage, and perceptual quality without altering model architecture.
The paper proposes AdvRole, an adversarial closed-loop curriculum framework for training role-playing agents in large language models, which evolves scenario pools to improve performance on benchmarks.
DART proposes a distributional adversarial training framework for recurrent reasoning models, improving their robustness and performance on structured problems by using a local target distribution instead of single-point supervision.
RL-ADA is a co-evolutionary framework that replaces human labels with world feedback for training adversarially robust enterprise dialogue agents, using reinforcement learning to improve performance without annotation data.
RL-FAT is a reinforcement learning framework for fair adversarial training that improves robustness while reducing class-wise disparities. Experiments demonstrate competitive accuracy and better fairness compared to standard methods.