[2603.05414] Dissociating Direct Access from Inference in AI Introspection

Abstract:Introspection is a foundational cognitive ability, but its mechanism is not well understood. Recent work has shown that AI models can introspect. We study the mechanism of this introspection. We first extensively replicate Lindsey (2025)'s thought injection detection paradigm in large open-source models. We show that introspection in these models is content-agnostic: models can detect that an anomaly occurred even when they cannot reliably identify its content. The models confabulate injected concepts that are high-frequency and concrete (e.g., "apple"). They also require fewer tokens to detect an injection than to guess the correct concept (with wrong guesses coming earlier). We argue that a content-agnostic introspective mechanism is consistent with leading theories in philosophy and psychology.

View PDF HTML (experimental) Abstract:Introspection is a foundational cognitive ability, but its mechanism is not well understood. Recent work has shown that AI models can introspect. We study the mechanism of this introspection. We first extensively replicate Lindsey (2025)'s thought injection detection paradigm in large open-source models. We show that introspection in these models is content-agnostic: models can detect that an anomaly occurred even when they cannot reliably identify its content. The models confabulate injected concepts that are high-frequency and concrete (e.g.,…

saved by

• Lydia Nottingham
• Eva L

related reading

• Can LLMs Introspect? A Reality Checkarxiv.org
• Emergent introspective awareness in large language models \ Anthropicanthropic.com
• [2508.14802] Privileged Self-Access Matters for Introspection in AIarxiv.org
• [2604.16812] Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• [2607.14111] Introspection Fine-Tuning (IFT): Training Small LLMs to Introspectarxiv.org
• Introspection Adapters: Training LLMs to Report Their Learned Behaviorsarxiv.org
• Consciousness in Artificial Intelligencearxiv.org
• Verbalizable Representations Form a Global Workspace in Language Modelstransformer-circuits.pub
• Training Language Models to Explain Their Own Computationsarxiv.org
• Emergent Introspective Awareness in Large Language Modelstransformer-circuits.pub
• [2511.08579] Training Language Models to Explain Their Own Computationsarxiv.org
• Emergent Introspective Awareness in Large Language Modelstransformer-circuits.pub