✳flâneur — a map of the web's best reading

(a) Anthropic constitution.

arxiv.org · 15,424 words · saved by 1 readers

Frontier AI developers now train models against long written behavioral specifications, such as Anthropic’s constitution (Anthropic, 2025a) and OpenAI’s Model Spec (OpenAI, 2025a), integrated into post-training via methods like character training (Anthropic, 2024) and deliberative alignment (Guan et al., 2024). These documents serve a governance function, but it is unclear how well models actually follow them under adversarial, multi-turn pressure similar to what they would face in real-world deployment. We propose a multi-method audit pipeline that treats each lab’s published specification as an auditable target: it decomposes the specification into atomic testable tenets (205 for Anthropic, 197 for OpenAI), generates multi-turn adversarial scenarios with the Petri auditing agent (Anthropic, 2025b), runs a modified SURF-style rubric search (Murray et al., 2026) to catch shallow single-turn failures Petri misses, validates flagged transcripts against the relevant specification, and com

Abstract Frontier AI developers now train models against long written behavioral specifications, such as Anthropic’s constitution (Anthropic, 2025a ) and OpenAI’s Model Spec (OpenAI, 2025a ) , integrated into post-training via methods like character training (Anthropic, 2024 ) and deliberative alignment (Guan et al., 2024 ) . These documents serve a governance function, but it is unclear how well models actually follow them under adversarial, multi-turn pressure similar to what they would face in real-world deployment. We propose a multi-method audit pipeline that treats each lab’s published s

Explore this link on the map →

related reading