backdoor-removal

Tag

Cards List
#backdoor-removal

Removing the NEEDLE in the Haystack: Backdoor Removal in LLMs via Weight Orthogonalisation

Hugging Face Daily Papers ↗ · 2026-09-29 Cached

NEEDLE is a training-free method for removing backdoors from LLMs that estimates a backdoor direction and a refusal subspace, then applies sequential weight orthogonalisation to suppress backdoors while preserving refusal behaviour and model capability. It achieves the lowest Attack Success Rate (including 0% on code injection attacks) with minimal KL divergence and safety degradation across multiple model families.

0 favorites 0 likes
← Back to home

Submit Feedback