sae-features

This paper introduces Feature Nonlocality (FNL), an entropy-based metric for measuring the semantic abstractness of SAE features in LLMs, and demonstrates applications in auditing jailbreak mitigation features and improving MATH-500 accuracy via steering.