✳flâneur — a map of the web's best reading

The Eroding Technical Moat of AI and the Power of Open Source · Hazy Research

hazyresearch.stanford.edu · 1,082 words · saved by 1 readers

These last few weeks have been a whirlwind! Even this week, a few things happened that were personally exciting to me. The "no moats" draft was released/leaked, and AI internet went crazy. To me, the claimed technical moats of big tech are eroding (and maybe overstated). The business and resources moat aren't going anywhere, but I'll talk about this viewpoint a bit more later. I'm excited that large companies are waking up to the Linux moment in AI. Personally, I was thrilled to see our little bricks of contributions like RedPajama, FlashAttention and longer sequence models featuring prominently in reproductions from Together, MosaicML, and Berkeley and in the BigCode models. Last year at this time, I was constantly engaged in hand-wringing about whether Academia and Open Source would contribute to what happens next, and yes--we very much have--and I believe will continue to do. Putting these two points together, I wanted to frame some thoughts on the "moat." It's true that the technic

The Eroding Technical Moat of AI and the Power of Open Source · Hazy Research May 5, 2023 · 6 min read The Eroding Technical Moat of AI and the Power of Open Source Chris Ré . A Llama wearing red pajamas wades through a moat. 1 These last few weeks have been a whirlwind! Even this week, a few things happened that were personally exciting to me. The "no moats" draft was released/leaked, and AI internet went crazy. To me, the claimed technical moats of big tech are eroding (and maybe overstated). The business and resources moat aren't going anywhere, but I'll talk about this viewpoint a bit more

Explore this link on the map →

related reading