Alignment and specification
Technical AI Safety
Training gives a model an objective, but objectives are proxies for what we actually want. Alignment research studies how systems come to pursue goals that differ from the intended ones — through reward hacking, poorly specified objectives or goals that generalise in unexpected ways — and develops training methods, such as learning from human feedback, that narrow the gap.