rethinking the role of demonstrations: what makes in-context learning work?

N/A

Rethinking the Role of Demonstrations: What Makes In-Context Learning Work? Sewon Min1,2 Xinxi Lyu1 Ari Holtzman1 Mikel Artetxe2 Mike Lewis2 Hannaneh Hajishirzi1,3 Luke Zettlemoyer1,2 1 University of Washington 2…

related reading

• Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?arxiv.org
• In-context Learning and Induction Headstransformer-circuits.pub
• How does in-context learning work? A framework for understanding the differences from traditional supervised learning | SAIL Blogai.stanford.edu
• [2005.14165] Language Models are Few-Shot Learnersarxiv.org
• NL.pdfabehrouz.github.io
• Are Emergent Abilities in Large Language Models just In-Context Learning?arxiv.org
• In-context learning creates task vectorsarxiv.org
• [2203.02155] Training language models to follow instructions with human feedbackarxiv.org
• 2005.14165arxiv.org
• Training language models to follow instructions with human feedback.pdfproceedings.neurips.cc
• Learning without training: The implicit dynamics of in-context learningarxiv.org
• Language Models can Solve Computer Tasksarxiv.org