[2305.18654] Faith and Fate: Limits of Transformers on Compositionality

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2305.18654] Faith and Fate: Limits of Transformers on Compositionality --> Computer Science > Computation and Language arXiv:2305.18654 (cs) [Submitted on 29 May 2023 ( v1 ), last revised 31 Oct 2023 (this version, v3)] Title: Faith and Fate: Limits of Transformers on Compositionality Authors: Nouha Dziri , Ximing Lu , Melanie Sclar , Xiang Lorraine Li , Liwei Jiang , Bill Yuchen Lin , Peter West , Chandra Bhagavatula , Ronan Le Bras , Jena D. Hwang , Soumya Sanyal , Sean Welleck , Xiang Ren , Allyson Ettinger , Zaid Harchaoui , Yejin Choi View a PDF of the paper titled Faith and Fate: Limits

saved by

• sashrika pandey

related reading

• [2402.12875] Chain of Thought Empowers Transformers to Solve Inherently Serial Problemsarxiv.org
• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• the-illusion-of-thinking.pdfml-site.cdn-apple.com
• Transformer Circuits Threadtransformer-circuits.pub
• Transformer Explainer: LLM Transformer Model Visually Explainedpoloclub.github.io
• Transformers from Scratche2eml.school
• Reasoning Models Reason Well, Until They Don'tarxiv.org
• Composer2.pdfcursor.com
• On the Tradeoffs of SSMs and Transformers | Goomba Labgoombalab.github.io
• [2310.16028] What Algorithms can Transformers Learn? A Study in Length Generalizationarxiv.org
• Language Models can Solve Computer Tasksarxiv.org
• Explore | alphaXivalphaxiv.org