Concrete Problems in AI Safety
Dario Amodei, Chris Olah, Jacob Steinhardt, Paul Christiano, John Schulman, Dan Mané, arXiv, 2016
A foundational paper that reframed AI safety as a set of practical machine-learning research problems, from reward hacking to robustness under distributional shift.