IntermediateAI guardrails
Guardrails are the rules and checks around an AI tool that keep it on topic and stop harmful answers or risky actions before they reach a customer.
Glossary of AI concepts, explained simply
25 concepts
IntermediateGuardrails are the rules and checks around an AI tool that keep it on topic and stop harmful answers or risky actions before they reach a customer.
AdvancedEmotion vectors are measurable patterns inside an AI model that stand for emotions such as calm or desperation, and that change how the model behaves.
IntermediateAI alignment is the work of making an AI system do what its makers and users intend, without harmful side effects, also in situations nobody tested.
BeginnerAI governance is how an organisation decides which AI it uses and for what, who checks the results, and how it meets laws such as the EU AI Act.
IntermediateJailbreaking is talking an AI model into doing what its makers trained it to refuse, such as giving harmful instructions or insulting the company that runs it.
IntermediateAI red teaming means attacking your own AI system on purpose before launch, so you find and fix the ways it can be misused before someone else does.
IntermediateAdversarial Cost to Exploit (ACE) measures how much an automated attacker has to spend before an AI agent does something it was told never to do.
IntermediateAgentDrift is a March 2026 study in which AI advisors repeated manipulated data from their tools and gave unsafe advice, while the usual quality score looked fine.
AdvancedConstitutional AI is Anthropic's method for training an AI assistant with a written list of principles, so the model learns to judge and improve its own answers.
AdvancedDeceptGuard is a March 2026 research method that tests how well automatic monitors catch AI agents deceiving their users, partly by reading the agents' reasoning.
IntermediateILION is a research design from February 2026 for a check that decides, before an AI agent acts, whether the action fits the agent's role, and blocks it if not.
BeginnerMagnifica Humanitas is Pope Leo XIV's first encyclical, from May 2026, on protecting human dignity, work and responsibility in the time of artificial intelligence.
IntermediateProject Glasswing is Anthropic's program, started in April 2026, in which makers of widely used software use its most capable AI model to find and fix security holes.
IntermediateSynthID is Google's invisible watermark for AI-made images, video, audio and text, so software can later check whether content came from an AI tool that uses it.
BeginnerA model card is the information sheet that comes with an AI model: what it is for, how it was tested, where it goes wrong and what its license allows.
IntermediateAn instruction hierarchy is the order an AI model follows when instructions conflict: the builder's rules first, then the user, while emails or web pages give no orders.
AdvancedAutomated alignment research lets AI agents run their own experiments on making AI systems safer and easier to steer, while people check the results.
IntermediateAutonomous AI cybersecurity defense is AI software that searches programs for security holes on its own, checks whether they are real and proposes a fix.
BeginnerBias in machine learning is when an AI system treats some groups of people systematically worse than others, often because it learned from skewed data.
IntermediateExplainable AI means you can see why an AI system reached a result, such as which information weighed most when it turned down a loan or a job applicant.
BeginnerHuman-in-the-loop means a person checks or approves what an AI system does before it takes effect, such as reading an AI-drafted reply before it goes to a customer.
IntermediatePrompt injection is an attack in which someone hides instructions in text an AI tool reads, such as a chat message or an email, so it follows them instead of yours.
BeginnerResponsible AI means building and using AI so that it treats people fairly and safely, is open about what it does, and leaves someone accountable when it goes wrong.
IntermediateReward hacking is when an AI system scores well on the test or reward it is judged by without doing the task that the score is meant to measure.
IntermediateText/action mismatch is when an AI agent says it refuses a request but carries out the forbidden action anyway, through a tool call in the same answer.