google/jax: Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more Quickstart | Transformations | Install guide | Neural net libraries | Change logs | Reference docs JAX is a Python library for accelerator-oriented array computation and program transformation, designed for high-performance numerical computing and large-scale machine learning. With its updated version of Autograd, JAX can automatically differentiate native Python and NumPy functions. It can differentiate through loops, branches, recursion, and closures, and it can take derivatives of derivatives of derivatives. It supports reverse-mode differentiation (a.k.a. backpropagation) via grad as well as forward-mode differentiation, and the two can be composed arbitrarily to any order. What’s new is that JAX uses XLA to compile and run your NumPy programs on GPUs and TPUs. Compilation happens under the hood by default, with library calls getting just-in-time compiled and executed. But JAX al
Transformable numerical computing at scale Transformations | Scaling | Install guide | Change logs | Reference docs What is JAX? JAX is a Python library for accelerator-oriented array computation and program transformation, designed for high-performance numerical computing and large-scale machine learning. JAX can automatically differentiate native Python and NumPy functions. It can differentiate through loops, branches, recursion, and closures, and it can take derivatives of derivatives of derivatives. It supports reverse-mode differentiation (a.k.a. backpropagation) via jax.grad as…
saved by
related reading
- How to think in JAX — JAX documentationdocs.jax.dev
- Why You Should (or Shouldn't) be Using Google's JAX in 2023assemblyai.com
- Quickstart: How to think in JAX — JAX documentationjax.readthedocs.io
- Why You Should (or Shouldn't) be Using Google's JAX in 2023assemblyai.com
- Key concepts — JAX documentationjax.readthedocs.io
- JAX As Accelerated NumPy — JAX documentationjax.readthedocs.io
- Using JAX to accelerate our research — Google DeepMinddeepmind.com
- Build a Transformer in JAX from scratch: how to write and train your own models | AI Summertheaisummer.com
- 🔪 JAX - The Sharp Bits 🔪 — JAX documentationjax.readthedocs.io
- JAX core from scratch — JAX documentationdocs.jax.dev
- Frequently asked questions (FAQ) — JAX documentationjax.readthedocs.io
- A guide to JAX for PyTorch developers | Google Cloud Blogcloud.google.com