srush/Tensor-Puzzles: Solve puzzles. Improve your pytorch.
github.com · 1,429 words · saved by 2 readers
Solve puzzles. Improve your pytorch. Contribute to srush/Tensor-Puzzles development by creating an account on GitHub.
by Sasha Rush - srush_nlp (with Marcos Treviso) When learning a tensor programming language like PyTorch or Numpy it is tempting to rely on the standard library (or more honestly StackOverflow) to find a magic function for everything. But in practice, the tensor language is extremely expressive, and you can do most things from first principles and clever use of broadcasting. This is a collection of 21 tensor puzzles. Like chess puzzles these are not meant to simulate the complexity of a real program, but to practice in a simplified environment. Each puzzle asks you to reimplement one…
saved by
related reading
- Auto-research with codex: How I achieved a 232x Faster Kernel over baseline with Codex in GPU Mode's qr_v2 problemsankalp.bearblog.dev
- Tiny TPUtinytpu.com
- Making Deep Learning go Brrrr From First Principleshorace.io
- PyTorch internals : ezyang's blogblog.ezyang.com
- Chapter 0: Fundamentals - ARENAlearn.arena.education
- Tensors — PyTorch Tutorials 2.12.0+cu130 documentationpytorch.org
- Let's build GPT: from scratch, in code, spelled out.youtube.com
- Tensor Considered Harmfulnlp.seas.harvard.edu
- Thinking like Transformersrush.github.io
- Jane Street Blog - Can you reverse engineer our neural network?blog.janestreet.com
- GPT in 60 Lines of NumPy | Jay Modyjaykmody.com
- Taking PyTorch for Granted | whnrehiew.github.io