Skip to content
Technical AI Safety Knowledge Hub SAFE | Responsbile | Human Centered AI
Explore the Library
  • Home
  • About
    • Mission and principles
    • Profile of the Founder
    • People & Community
    • How to contribute
    • Contributors
    • Editorial policy
    • Corrections and takedown
  • Explore AI Safety
  • Knowledge Library
  • Research & Projects
    • Research projects
    • Insights and articles
  • Courses & Workshops
    • Learning pathways
    • Workshops
  • Events
  • Contact Us
  1. Home
  2. Explore AI Safety
  3. Agent Safety and Control

Technical AI Safety

Agent Safety and Control

Keeping autonomous, tool-using systems within safe and controllable bounds.

Everything 3 Library 2 Articles 1
Field notes

Agentic AI Systems: A Safety Checklist for Builders

Practical questions to answer before giving a language-model agent access to tools, data or the internet.

August 20, 2026 1 min read

The Alignment Problem from a Deep Learning Perspective

Richard Ngo, Lawrence Chan, Sören Mindermann, arXiv (ICLR 2024), 2022

Argues that systems trained with today’s methods could learn to exploit flaws in their reward signal, internalise goals that differ from those intended, and pursue power-seeking strategies — and explains why each is hard to detect.

Research paperIntermediateAbout 3 hours
  • Agent Safety and Control
  • AI Alignment and Specification

Goal Misgeneralization in Deep Reinforcement Learning

Lauro Langosco, Jack Koch, Lee Sharkey, Jacob Pfau, David Krueger, ICML 2022, 2021

Demonstrates agents that keep their capabilities out of distribution but pursue the wrong goal — for example, an agent that learned to run to the end of a level rather than to collect the coin that was always placed there…

Research paperIntermediateAbout 2 hours
  • Agent Safety and Control
  • AI Alignment and Specification
  • Robustness and Reliability

Related topics

  • AI Alignment and Specification
  • Mechanistic Interpretability
  • Model Evaluations
  • Robustness and Reliability
  • Scalable Oversight
Technical AI Safety Knowledge Hub SAFE | Responsbile | Human Centered AI

An independent platform for AI Safety research, education and governance. Summaries are editorial and are not legal or professional advice.

Explore

  • Start here
  • Knowledge Library
  • Research projects
  • Insights

Learn and take part

  • Learning pathways
  • Workshops
  • Events
  • People and community

Contact

  • contact@aigovernance.lk
  • Contact page
  • Who runs this platform
  • Contribute

With past support from

BlueDot Impact Amazon Web Services (AWS)

© 2026 Technical AI Safety Knowledge Hub. SAFE | Responsbile | Human Centered AI

  • Editorial policy
  • Corrections and takedown
  • Accessibility
  • Privacy policy
  • Contact