Disagreeable Me: A Multi-Level view of LLM Intentionality
Prompted by Keith Frankish's recent streamed discussion of LLM intentionality on YouTube, there's a particular idea I wanted to share which I'm not sure is widely enough appreciated but which I think gives a valuable perspective from which to think about LLMs and what kinds of intentions they may have. This is not an original idea of my own -- at least some of my thinking on this was sparked by reading about the Waluigi problem on LessWrong. In this post, I'm going to be making the case that LLMs might have intentionality much like ours, but please understand that I'm making a point in principle and not so much arguing for the capabilities of current LLMs, which are probably not there yet. I'm going to be talking about what scope there is to give the benefit of the doubt to arbitrarily competent future LLMs, albeit ones that follow more or less the same paradigms as those of today. I'm going to try to undermine some proposed reasons for skepticism about the intentions or understanding
Disagreeable Me: A Multi-Level view of LLM Intentionality Tuesday, 9 May 2023 A Multi-Level view of LLM Intentionality Prompted by Keith Frankish's recent streamed discussion of LLM intentionality on YouTube , there's a particular idea I wanted to share which I'm not sure is widely enough appreciated but which I think gives a valuable perspective from which to think about LLMs and what kinds of intentions they may have. This is not an original idea of my own -- at least some of my thinking on this was sparked by reading about the Waluigi problem on LessWrong. In this post, I'm going to be maki
saved by
related reading
- Please don't throw your mind away — LessWronglesswrong.com
- Taking LLMs Seriously (As Language Models) — LessWronglesswrong.com
- A Workaphile’s Apologymoalquraishi.wordpress.com
- Do large language models understand us? | by Blaise Aguera y Arcas | Mediummedium.com
- The Unintelligibility is Ours: Notes on Chain of Thought1a3orn.com
- Deep Deceptiveness — LessWronglesswrong.com
- A Three-Layer Model of LLM Psychology — LessWronglesswrong.com
- A Mechanistic Explanation of Prompt Injection (and why you should study roles) — LessWronglesswrong.com
- The Universe from an Intentional Stancecasparoesterheld.com
- On the functional self of LLMs — LessWronglesswrong.com
- Alignment will happen by default. What’s next? — LessWronglesswrong.com
- We May be Surprised Again: Why I take LLMs seriously.inference.vc