Tag
This paper investigates how alignment tuning introduces cue-induced biases such as sycophancy in LLMs, finding that biases are installed by alignment rather than pretraining and can be decoded and steered via hidden state directions.