Overleaf Example
arxiv.org · 10,690 words · saved by 2 readers
N/A
# link_od4aaim2x1.pdf ## Metadata - PDFFormatVersion=1.5 - IsLinearized=false - IsAcroFormPresent=false - IsXFAPresent=false - IsCollectionPresent=false - IsSignaturesPresent=false - CreationDate=D:20250211015825Z - Creator=LaTeX with hyperref - ModDate=D:20250211015825Z - Custom.PTEX.Fullbanner=This is pdfTeX, Version 3.141592653-2.6-1.40.25 (TeX Live 2023) kpathsea version 6.3.5 - Producer=pdfTeX-1.40.25 - Trapped=False ## Contents ### Page 1 TREE ATTENTION: TOPOLOGY-AWARE DECODING FORLONG-CONTEXT ATTENTION ON GPU CLUSTERSVasudev Shyam1∗, Jonathan Pilault1∗, Emily Shepperd2, Quentin Antho
saved by
related reading
- 2502.11089arxiv.org
- [2603.23516] MSA: Memory Sparse Attention for Efficient End-to-End Memory Model Scaling to 100M Tokensarxiv.org
- From Online Softmax to FlashAttentioncourses.cs.washington.edu
- transformer_attention.pdfarxiv.org
- A Mathematical Framework for Transformer Circuitstransformer-circuits.pub
- The Annotated Transformernlp.seas.harvard.edu
- 1706.03762arxiv.org
- NL.pdfabehrouz.github.io
- [2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org
- pdfopenreview.net
- arxiv.org/pdf/2512.24880#page=3.56arxiv.org
- Transformers Inference Optimization Toolset | AstraBlogastralord.github.io