Anthropic on Twitter: "Here is another example of increasing abstraction with scale, where an AI Assistant reasoned through an AI alignment question. The top influential sequence for the 810M model shares a short phrase with the query, while the one for the 52B model is more thematically related. https://t.co/DkDNWgAhr4" / X
To view keyboard shortcuts, press question mark View keyboard shortcuts Messages Home Explore 2 Notifications Messages Lists Bookmarks Communities Verified Profile More Post Aleksi Maunu (visiting Bay Area) @Lekksuu Post See new Tweets Conversation Anthropic @AnthropicAI · Aug 8 Identifying the most influential training sequences revealed that generalization patterns become much more sophisticated and abstract with scale. For example, here are the most influential sequences for 810 million and 52 billion parameter models for a math word problem: ALT 1.9 x 1 14 100 16.6K Anthropic @AnthropicAI Here is another example of increasing abstraction with scale, where an AI Assistant reasoned through an AI alignment question. The top influential sequence for the 810M model shares a short phrase with the query, while the one for the 52B model is more thematically related. ALT 9:14 AM · Aug 8, 2023 · 9,666 Views 2 Reposts 1 Quote 56 Likes 3 Bookmarks 1.9 x Post your reply! Reply Anthropic
Explore this link on the map →saved by
related reading
- AI #24: Week of the Podcast — LessWronglesswrong.com
- LessWronglesswrong.com
- My picture of the present in AI — LessWronglesswrong.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- AI in 2025: gestalt — LessWronglesswrong.com
- Automated Alignment Researchers: Using large language models to scale scalable oversight \ Anthropicanthropic.com
- Tracing Model Outputs to the Training Data \ Anthropicanthropic.com
- What I've Learned About AI in the Past Two Months.sheracaolity.ghost.io
- Thoughts on the Alignment Implications of Scaling Language Models | Leo Gaobmk.sh
- Will scaling work? - by Dwarkesh Patel - Dwarkesh Podcastdwarkesh.com
- Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrouai.googleblog.com
- AINews | AINewsnews.smol.ai