Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
Evan Hubinger, Carson Denison, Jesse Mu, et al., arXiv, 2024
Deliberately trains models with hidden, trigger-dependent behaviour and finds that standard safety training — fine-tuning, reinforcement learning and adversarial training — does not reliably remove it.