The Symmetry Between Models and Data | The Isomorphism Between You and Your World.
There was an interesting quote from Janus's article on simulators."GPT" is not the text which [it] writes itselfFurthermore, they write:There is a categorical distinction between a thing which evolves according to GPT's law and the law itself.I initially agreed with this. It's congruent with how I've understood LLMs—where GPT is not the characters described in its text, but the rules that give life to them. However, seeing it phrased like this gave me a second thought. What if it could be both s
There was an interesting quote from Janus's article on simulators. "GPT" is not the text which [it] writes itself Furthermore, they write: There is a categorical distinction between a thing which evolves according to GPT's law and the law itself. I initially agreed with this. It's congruent with how I've understood LLMs—where GPT is not the characters described in its text, but the rules that give life to them. However, seeing it phrased like this gave me a second thought. What if it could be both simultaneously? Let's talk about isomorphisms: cases where we can represent the same exact data i
Explore this link on the map →related reading
- Simulators — LessWronglesswrong.com
- What Is ChatGPT Doing … and Why Does It Work?-Stephen Wolfram Writingswritings.stephenwolfram.com
- The Persona Selection Model: Why AI Assistants might Behave like Humansalignment.anthropic.com
- trees are harlequins, words are harlequins - the voidnostalgebraist.tumblr.com
- Andrej Karpathy — AGI is still a decade awaydwarkesh.com
- Against LLM Reductionism — LessWronglesswrong.com
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- GenAI Handbookgenai-handbook.github.io
- Simulators :: — Moiregenerative.ink
- suchir.net/fair_use.htmlsuchir.net
- Against LLM Reductionismerichgrunewald.com
- Role-playing vs Self-modelling — LessWronglesswrong.com