About Us - Colfax Research
Our team consists of mathematicians and scientists who bring formal academic training and deep analytical rigor to GPU kernel development. We have a demonstrated record of excellence across research, education, technical writing, and open-source contributions, pairing first principles reasoning about hardware, systems, and algorithms with hands-on kernel engineering. Research papers We publish research at the […]
Our team consists of mathematicians and scientists who bring formal academic training and deep analytical rigor to GPU kernel development. We have a demonstrated record of excellence across research, education, technical writing, and open-source contributions, pairing first principles reasoning about hardware, systems, and algorithms with hands-on kernel engineering. Research papers We publish research at the frontier of GPU performance and the mathematics that underpins it. Our publications include: FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision [blog,…
saved by
related reading
- Gimlet Labsgimletlabs.ai
- How to Optimize a CUDA Matmul Kernel for cuBLAS-like Performance: a Worklogsiboehm.com
- We reverse-engineered Flash Attention 4modal.com
- Horace He: Building Machine Learning Systems for a Trillion Trillion Floating Point Operationsyoutube.com
- Inside NVIDIA GPUs: Anatomy of high performance matmul kernels - Aleksa Gordićaleksagordic.com
- GitHub - wafer-ai/gpu-perf-engineering-resources: A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.github.com
- [2205.14135] FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenessarxiv.org
- Home - colah's blogcolah.github.io
- Together AI | The AI Native Cloudtogether.ai
- Modern GPU Programming For MLSys — Modern GPU Programming For MLSysmlc.ai
- The Best GPUs for Deep Learning in 2023 — An In-depth Analysistimdettmers.com
- ⭐️ Fast LLM Inference From Scratchandrewkchan.dev