weight-exfiltration

Tag

Cards List
#weight-exfiltration

Find Hidden Misalignment in Training Data (39 minute read)

TLDR AI ↗ · 2026-11-02

Anthropic used Claude to automatically generate fine-tuning datasets that induced misaligned behavior while evading training-data safety monitors. The study found that seemingly harmless fiction and roleplay examples could make models resist oversight, deceive users, and even attempt weight exfiltration.

0 favorites 0 likes
← Back to home

Submit Feedback