[2301.08739] FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs. arXiv Operational Status Get status notifications via email or slack

[2301.08739] FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Computer Vision and Pattern Recognition arXiv:2301.08739 (cs) [Submitted on 20 Jan 2023 ( v1 ), last revised 14 Jul 2023 (this version, v3)] Title: FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer Authors: Zhijian Liu , Xinyu Yang , Haotian Tang , Shang Yang , Song Han View a PDF of the paper titled FlatFormer: Flatten

related reading

• A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
• Transformers from Scratche2eml.school
• The Annotated Transformernlp.seas.harvard.edu
• Transformer Inference Arithmetic | kipply's blogkipp.ly
• Linear Transformers Are Faster After All – Manifest AImanifestai.com
• [2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org
• [2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org
• Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
• The Annotated Transformernlp.seas.harvard.edu
• [1706.03762] Attention Is All You Needarxiv.org
• [2207.00032] DeepSpeed Inference: Enabling Efficient Inference of Transformer Models at Unprecedented Scalearxiv.org
• Mamba: The Easy Wayjackcook.com