the tiny corp raised $5.1M | the singularity is nearer
The tiny corp is a computer company. We sell computers for more than they cost to make; I’ve been thinking about this one for a while. In the limit, it’s a chip company, but there’s a lot of intermediates along the way. The human brain has about 20 PFLOPS of compute. I’ve written various blog posts about this. Sadly, 20 PFLOPS of compute is not accessible to most people, costing about $1M to buy or $100/hr to rent. With the way AI is going, we risk large entities controlling the majority of the compute in the world. I do not want “I think there’s a world market for maybe five computers.” to ever be the world we live in. The goal of the tiny corp is: “to commoditize the petaflop” I started tinygrad in Oct 2020. It started as a toy project to teach me about neural networks, it’s now carved out a good niche in the inference space running the model in openpilot, and soon will be a serious competitor to PyTorch in many places. The main advantage is in the tinygrad IR. It has 12 operations,
Here we go again. I started another company. The money is in the bank. What is the tiny corp? The tiny corp is a computer company. We sell computers for more than they cost to make; I’ve been thinking about this one for a while. In the limit, it’s a chip company , but there’s a lot of intermediates along the way. The human brain has about 20 PFLOPS of compute. I’ve written various blog posts about this. Sadly, 20 PFLOPS of compute is not accessible to most people, costing about $1M to buy or $100/hr to rent. With the way AI is going, we risk large entities controlling the majority of the compu
related reading
- The tiny corp raised $5.1Mnews.ycombinator.com
- Tiny TPUtinytpu.com
- A Breakdown of AI Chip Companies | the singularity is nearergeohot.github.io
- Small Models Have Arrivedcalv.info
- The Short Case for Nvidia Stock | YouTube Transcript Optimizeryoutubetranscriptoptimizer.com
- AI Chip Architecturesjacobpeake.com
- Why compute might get 10x more expensive in coming yearsdwarkesh.com
- microgptkarpathy.github.io
- Horace He: Building Machine Learning Systems for a Trillion Trillion Floating Point Operationsyoutube.com
- Introducing tinygradsimonwenkel.com
- GitHub - adam-maj/tiny-gpu: A minimal GPU design in Verilog to learn how GPUs work from the ground up · GitHubgithub.com
- The Two Harvard Dropouts Who Raised $800M to Take on NVIDIAyoutube.com