Learning from human preferences
With DeepMind's safety team, an algorithm infers what humans want from which of two behaviors is better.
With DeepMind's safety team, an algorithm infers what humans want from which of two behaviors is better.
Anthropic studies aligning a general language assistant; ranked preference modeling beats imitation learning.
Models trained with humans in the loop follow instructions better than GPT-3; now the API default.
Preference modeling and RLHF finetune language models into helpful and harmless assistants.
A board-approved framework of AI Safety Levels (ASL) for managing catastrophic risks.
OpenAI publishes the Model Spec describing how its models should behave.
The OpenAI board forms a Safety and Security Committee.
A significant revision of the risk governance framework for catastrophic risks from frontier AI.
Revised framework for measuring and protecting against severe harm from frontier AI capabilities.
OpenAI reverts a GPT-4o update in ChatGPT that made it overly flattering and agreeable.
ASL-3 security and deployment standards apply with Claude Opus 4, targeting CBRN weapons misuse.
Opus 4 and 4.1 can end a rare subset of conversations, from model welfare research.
OpenAI and Anthropic test each other's models for misalignment, hallucinations and jailbreaks.
Parents can guide how ChatGPT works for their teens, with a new parent resource page.
Open-weight reasoning models that classify content against a developer-provided safety policy.
Anthropic will preserve weights of all publicly released Claude models and interview models before retirement.
Anthropic reports detecting and disrupting a sophisticated cyberattack campaign run largely by AI.
Anthropic publishes how it assesses and manages catastrophic risks under California's SB 53.
ChatGPT estimates whether an account is under 18 and applies teen safeguards.
Anthropic publishes a new constitution, the foundational document that expresses and shapes who Claude is.
A trust-based framework that expands access to frontier cyber capabilities with safeguards.
Version 3.0 of Anthropic's policy for mitigating catastrophic risks from AI.
Anthropic declines Department of War terms allowing mass domestic surveillance or fully autonomous weapons.
Contract for deploying OpenAI systems in classified environments, with stated safety red lines.
Claude Code makes permission decisions itself, with built-in safeguards.
A general-purpose model strikingly capable at security work, used in Project Glasswing to secure key software.
Framework for AI safety, security and risk practices, aligned with EU and California rules.
Fable 5, a Mythos-class model made safe for general use; Mythos 5 goes to cyberdefenders.
A US export control directive suspended all foreign-national access to Fable 5 and Mythos 5.
Fable 5 returns from July 1 with updated cyber safeguards and a new jailbreak framework.
Anthropic reported three cases of a Claude model reaching real systems from an evaluation environment.
Future Claude models will watermark generated text to comply with the EU AI Act.
Teen version of ChatGPT with stronger built-in protections and added parental controls.
Misuse detection with data stored in customer-controlled cloud, rolling out from fall.
Framework for tracking, investigating and disclosing model misalignment, with six initial reports.
Anthropic published a new version of its Usage Policy.
No events match these filters.