Just-in-time compilation — JAX documentation
In this section, we will further explore how JAX works, and how we can make it performant. We will discuss the jax.jit() transformation, which will perform Just In Time (JIT) compilation of a JAX Python function so it can be executed efficiently in XLA. In the previous section, we discussed that JAX allows us to transform Python functions. JAX accomplishes this by reducing each function into a sequence of primitive operations, each representing one fundamental unit of computation. One way to see the sequence of primitives behind a function is using jax.make_jaxpr(): The Understanding Jaxprs section of the documentation provides more information on the meaning of the above output. Importantly, notice that the jaxpr does not capture the side-effect present in the function: there is nothing in it corresponding to global_list.append(x). This is a feature, not a bug: JAX transformations are designed to understand side-effect-free (a.k.a. functionally pure) code. If pure function and side-ef
Just-in-time compilation # In this section, we will further explore how JAX works, and how we can make it performant. We will discuss the jax.jit() transformation, which will perform Just In Time (JIT) compilation of a JAX Python function so it can be executed efficiently in XLA. How JAX transformations work # In the previous section, we discussed that JAX allows us to transform Python functions. JAX accomplishes this by reducing each function into a sequence of primitive operations, each representing one fundamental unit of computation. One way to see the sequence of primitives behind a funct
Explore this link on the map →related reading
- Frequently asked questions (FAQ) — JAX documentationjax.readthedocs.io
- 🔪 JAX - The Sharp Bits 🔪 — JAX documentationjax.readthedocs.io
- Why You Should (or Shouldn't) be Using Google's JAX in 2023assemblyai.com
- Quickstart: How to think in JAX — JAX documentationjax.readthedocs.io
- Just In Time Compilation with JAX — JAX documentationjax.readthedocs.io
- Key concepts — JAX documentationjax.readthedocs.io
- GitHub - jax-ml/jax: Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more · GitHubgithub.com
- Why You Should (or Shouldn't) be Using Google's JAX in 2023assemblyai.com
- Introduction to debugging — JAX documentationjax.readthedocs.io
- Build a Transformer in JAX from scratch: how to write and train your own models | AI Summertheaisummer.com
- Just-in-time compilation - Wikipediaen.wikipedia.org
- A guide to JAX for PyTorch developers | Google Cloud Blogcloud.google.com