flash-attention/csrc/flash_attn/src/flash_fwd_kernel.h at main · Dao-AILab/flash-attention
github.com · 8,835 words · saved by 1 readers
Fast and memory-efficient exact attention. Contribute to Dao-AILab/flash-attention development by creating an account on GitHub.
saved by
related reading
- We reverse-engineered Flash Attention 4modal.com
- [2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org
- Attention-Residuals/Attention_Residuals.pdf at master · MoonshotAI/Attention-Residuals · GitHubgithub.com
- From Online Softmax to FlashAttentioncourses.cs.washington.edu
- Flash Attention from Scratch Part 1: Introlubits.ch
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev
- GitHub - kuchin/awesome-cto: A curated and opinionated list of resources for Chief Technology Officers, with the emphasis on startups · GitHubgithub.com
- 2205.14135arxiv.org
- [2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org
- GitHub - wafer-ai/gpu-perf-engineering-resources: A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.github.com
- kForth-64/forth-src/struct-200x.4th at master · mynenik/kForth-64 · GitHubgithub.com
- Biao's Bloghebiao064.github.io