Skip to content
Technical AI Safety Knowledge Hub SAFE | Responsbile | Human Centered AI
Explore the Library
  • Home
  • About
    • Mission and principles
    • Profile of the Founder
    • People & Community
    • How to contribute
    • Contributors
    • Editorial policy
    • Corrections and takedown
  • Explore AI Safety
  • Knowledge Library
  • Research & Projects
    • Research projects
    • Insights and articles
  • Courses & Workshops
    • Learning pathways
    • Workshops
  • Events
  • Contact Us
  1. Home
  2. Explore AI Safety
  3. AI Security and Misuse

Security and misuse

AI Security and Misuse

Attacks on AI systems and the use of AI to cause harm.

Everything 5 Library 4 Articles 1

Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training

Evan Hubinger, Carson Denison, Jesse Mu, et al., arXiv, 2024

Deliberately trains models with hidden, trigger-dependent behaviour and finds that standard safety training — fine-tuning, reinforcement learning and adversarial training — does not reliably remove it.

Research paperAdvancedAbout 3 hours
  • AI Alignment and Specification
  • AI Security and Misuse
  • Model Evaluations

Universal and Transferable Adversarial Attacks on Aligned Language Models

Andy Zou, Zifan Wang, J. Zico Kolter, Matt Fredrikson, arXiv, 2023

Shows that automatically optimised text suffixes can make safety-trained language models comply with harmful requests, and that such suffixes often transfer between models.

Research paperAdvancedAbout 2 hours
  • AI Security and Misuse
  • Robustness and Reliability

OWASP Top 10 for Large Language Model Applications

OWASP Foundation, OWASP, 2023

A community-maintained list of the most important security risks in applications built on language models, such as prompt injection and insecure handling of model output, with mitigations for each.

Technical guideIntroductoryAbout 1 hour
  • AI Security and Misuse
  • Threat Modelling

MITRE ATLAS: Adversarial Threat Landscape for AI Systems

MITRE, 2021

A knowledge base of adversary tactics and techniques against AI-enabled systems, modelled on MITRE ATT&CK and illustrated with case studies.

Standard or frameworkIntermediateReference — browse as needed
  • AI Security and Misuse
  • Threat Modelling

Related topics

  • Threat Modelling
Technical AI Safety Knowledge Hub SAFE | Responsbile | Human Centered AI

An independent platform for AI Safety research, education and governance. Summaries are editorial and are not legal or professional advice.

Explore

  • Start here
  • Knowledge Library
  • Research projects
  • Insights

Learn and take part

  • Learning pathways
  • Workshops
  • Events
  • People and community

Contact

  • contact@aigovernance.lk
  • Contact page
  • Who runs this platform
  • Contribute

With past support from

BlueDot Impact Amazon Web Services (AWS)

© 2026 Technical AI Safety Knowledge Hub. SAFE | Responsbile | Human Centered AI

  • Editorial policy
  • Corrections and takedown
  • Accessibility
  • Privacy policy
  • Contact