Preprint Open access
Less Sycophancy, Stronger Refusal? Lessons for AI Safety from Mechanistic Interpretability
Reliable refusal of harmful requests is essential to the safe deployment of language models. Because excessive eagerness to please users may undermine existing refusal capabilities, reducing sycophancy offers a potential route to stronger refusal beyond the harmful scenarios covered by safety training. We investigate t …