RL isn’t the silver bullet for AI-powered chip design
My most popular post of all time was about why Y Combinator is wrong about LLMs for chip design. Put simply, I don’t think LLMs are able to generate high-performance or high-efficiency chip designs, because the process of designing high-performance chips is incredibly unforgiving. The entire “vibe coding” trend is about generating a large quantity of mediocre code, while the challenge of chip design is writing a relatively small amount of extremely high-quality, extremely performance-sensitive code in a specialized language called Verilog. And so far, I’ve been proven right. By and large, LLMs kinda suck at writing Verilog. Never fear, though! Reinforcement learning (aka RL) will come to the rescue, right? RL has proven invaluable when it comes to making normally error-prone AI agents solve unforgiving tasks, from playing board games to constructing complex mathematical proofs. Why can’t we leverage RL systems to train AI models to write the sort of high-quality, performance-sensitive
RL isn’t the silver bullet for AI-powered chip design But new EDA tools could change that… zach Sep 25, 2025 20 8 Share My most popular post of all time was about why Y Combinator is wrong about LLMs for chip design . Put simply, I don’t think LLMs are able to generate high-performance or high-efficiency chip designs, because the process of designing high-performance chips is incredibly unforgiving. The entire “vibe coding” trend is about generating a large quantity of mediocre code, while the challenge of chip design is writing a relatively small amount of extremely high-quality, extremely pe
saved by
related reading
- Meta harness makes 10 times better Kimi K3 chipluoluo.ai
- Taalas is what Etched should have been.zach.be
- Lil'Loglilianweng.github.io
- AI EDAs: Is It Real?youtube.com
- Chip Design: AI Alone Isn’t Ready for Chip Designspectrum.ieee.org
- How can LLM RL Work Despite Information-Theoretic Inefficiencyberen.io
- RLHF: Reinforcement Learning from Human Feedbackhuyenchip.com
- Launching Standard Machinesstandardmachines.com
- Architect Labsarchitectlabs.com
- State of RL for reasoning LLMs | A. Weersaweers.de
- Developing our position on AI - Blog - Recurse Centerrecurse.com
- [2510.13786] The Art of Scaling Reinforcement Learning Compute for LLMsarxiv.org