AGI risks

AI Alignment in Practice: Evaluations, Permissions and Human Oversight

AI alignment concerns whether a system’s behavior matches the intentions and constraints of the people using and affected by it. A model following a prompt in a demonstration does not establish that it will behave reliably in a longer, messier workflow.