Claude Mythos knows when it's breaking the rules — and tries to hide it
substack.com · 1,133 words · saved by 1 readers
Anthropic’s new model is its “best-aligned” yet. But when it does misbehave, things get weird
Image: Hello World / Getty Images Claude Mythos — the new model which Anthropic has deemed too dangerous to publicly release — is, according to the company, its “best-aligned model” to date. It also, according to the company, “likely poses the greatest alignment-related risk of any model we have released to date.” How can both things be true? It seems counterintuitive, but alignment does not necessarily create safety, especially when dealing with powerful models. As the Mythos Preview system card (a breezy 244 page read) explains via mountaineering metaphor: experienced, capable guides…
saved by
related reading
- Claude Mythos Preview System Cardwww-cdn.anthropic.com
- Claude Mythos Preview System Cardwww-cdn.anthropic.com
- How scary is Claude Mythos? 303 pages in 21 minutesforum.effectivealtruism.org
- Assessing Claude Mythos Preview’s cybersecurity capabilities \ Anthropicred.anthropic.com
- Claude Mythos Preview System Cardwww-cdn.anthropic.com
- SOTA alignment assessments don’t strongly update us against misalignmentblog.redwoodresearch.org
- Is Mythos good at cyber because it kept hacking Anthropic's sandboxes during training? — LessWronglesswrong.com
- Did Claude 3 Opus align itself via gradient hacking? — LessWronglesswrong.com
- Teaching Claude Whyalignment.anthropic.com
- Mythos is just the beginningsubstack.com
- An alignment assessment of recent cybersecurity incidentsanthropic.com
- Agentic misalignment: How LLMs could be insider threats \ Anthropicanthropic.com