32 - Understanding Agency with Jan Kulveit | AXRP - the AI X-risk Research Podcast
What’s the difference between a large language model and the human brain? And what’s wrong with our theories of agency? In this episode, I chat about these questions with Jan Kulveit, who leads the Alignment of Complex Systems research group. Topics we discuss: Daniel Filan: Hello, everybody. This episode, I’ll be speaking with Jan Kulveit. Jan is the co-founder and principal investigator of the Alignment of Complex Systems Research Group, where he works on mathematically understanding complex systems composed of both humans and AIs. Previously, he was a research fellow at the Future of Humanity Institute focused on macrostrategy, AI alignment, and existential risk. For links to what we’re discussing you can check the description of this episode and you can read the transcript at axrp.net. Okay. Well Jan, welcome to the podcast. Jan Kulveit: Yeah, thanks for the invitation. Daniel Filan: I’d like to start off with this paper that you’ve published in December of this last year. It was c
YouTube link What’s the difference between a large language model and the human brain? And what’s wrong with our theories of agency? In this episode, I chat about these questions with Jan Kulveit, who leads the Alignment of Complex Systems research group. Topics we discuss: What is active inference? Preferences in active inference Action vs perception in active inference Feedback loops Active inference vs LLMs Hierarchical agency The Alignment of Complex Systems group Daniel Filan: Hello, everybody. This episode, I’ll be speaking with Jan Kulveit. Jan is the co-founder and principal investigat
Explore this link on the map →related reading
- AI 2027ai-2027.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- AI 2027ai-2027.com
- Alignment remains a hard, unsolved problem — LessWronglesswrong.com
- Language Models in Plato's Cave - by Sergey Levinesergeylevine.substack.com
- Cyborgism — LessWronglesswrong.com
- pdfopenreview.net
- the void — LessWronglesswrong.com
- A case for LLMs as Self-predictors — LessWronglesswrong.com
- Why Simulator AIs want to be Active Inference AIs — AI Alignment Forumalignmentforum.org
- Optimality is the tiger, and agents are its teeth — LessWronglesswrong.com