The Exo Language | Exo is a low-level user-schedulable language designed to help performance engineers write, optimize, and target high-performance computing kernels onto new hardware accelerators.
Exo is a low-level user-schedulable language designed to help performance engineers write, optimize, and target high-performance computing kernels onto new hardware accelerators. Exo is a domain-specific programming language that helps low-level performance engineers transform very simple programs that specify what they want to compute into very complex programs that do the same thing as the specification, only much, much faster. The highest performance hardware made today (such as Google’s TPU, Apple’s Neural Engine, or Nvidia’s Tensor Cores) power key scientific computing and machine learning kernels: the Basic Linear Algebra Subroutines (BLAS) library, for example. However, these new chips—which take hundreds of engineers to design—are only as good (i.e. high performance) for application developers as these kernels allow. Unlike other programming languages and compilers, Exo is built around the concept of exocompilation. Traditionally, compilers are built to automatically optimize p
The Exo Language | Exo is a low-level user-schedulable language designed to help performance engineers write, optimize, and target high-performance computing kernels onto new hardware accelerators. What does Exo do? Exo is a domain-specific programming language that helps low-level performance engineers transform very simple programs that specify what they want to compute into very complex programs that do the same thing as the specification, only much, much faster. Background & Motivation The highest performance hardware made today (such as Google’s TPU, Apple’s Neural Engine, or Nvidia’s Ten
saved by
related reading
- It’s Time for a Modern Synthesis Kernel – Embedded in Academiablog.regehr.org
- Algorithms for Modern Hardware - Algorithmicaen.algorithmica.org
- A friendly introduction to machine learning compilers and optimizershuyenchip.com
- TPU Deep Divehenryhmko.github.io
- engler95exokernel.pdfpdos.csail.mit.edu
- Composer2.pdfcursor.com
- KernelBench: Can LLMs Write GPU Kernels?scalingintelligence.stanford.edu
- Meta harness makes 10 times better Kimi K3 chipluoluo.ai
- Executors & Harnesses | exo docsexoharness.ai
- GitHub - wafer-ai/gpu-perf-engineering-resources: A curated resource list for learning AI performance engineering, from GPU fundamentals to production inference.github.com
- Mixture-of-Kittens: our open-source MoE megakernel for NVL72scursor.com
- Retire the Abstractionshazyresearch.stanford.edu