[2301.00234] A Survey on In-context Learning

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2301.00234] A Survey on In-context Learning Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Computation and Language arXiv:2301.00234 (cs) [Submitted on 31 Dec 2022 ( v1 ), last revised 5 Oct 2024 (this version, v6)] Title: A Survey on In-context Learning Authors: Qingxiu Dong , Lei Li , Damai Dai , Ce Zheng , Jingyuan Ma , Rui Li , Heming Xia , Jingjing Xu , Zhiyong Wu , Tianyu Liu , Baobao Chang , Xu Sun , Lei Li , Zhifang Sui View a PDF of the paper titled A Survey on In-contex

related reading

• How does in-context learning work? A framework for understanding the differences from traditional supervised learning | SAIL Blogai.stanford.edu
• In-context Learning and Induction Headstransformer-circuits.pub
• [2311.06668] In-context Vectors: Making In Context Learning More Effective and Controllable Through Latent Space Steeringarxiv.org
• [2309.01809] Are Emergent Abilities in Large Language Models just In-Context Learning?arxiv.org
• Recursive Language Models | Alex L. Zhangalexzhang13.github.io
• Why We Need Continual Learning | Andreessen Horowitza16z.com
• GenAI Handbookgenai-handbook.github.io
• Are Emergent Abilities in Large Language Models just In-Context Learning?arxiv.org
• [2506.06266] Cartridges: Lightweight and general-purpose long context representations via self-studyarxiv.org
• [2212.07677] Transformers learn in-context by gradient descentarxiv.org
• Effective context engineering for AI agents \ Anthropicanthropic.com
• Graph Enabled Llama Index - siwei.iosiwei.io