✳flâneur — a map of the web's best reading

Transformers Revolutionized AI. What Will Replace Them?

forbes.com · 3,343 words · saved by 1 readers

The transformer, today's dominant AI architecture, has interesting parallels to the alien language ... [+] If modern artificial intelligence has a founding document, a sacred text, it is Google’s 2017 research paper “Attention Is All You Need.” This paper introduced a new deep learning architecture known as the transformer, which has gone on to revolutionize the field of AI over the past half-decade. The generative AI mania currently taking the world by storm can be traced directly to the invention of the transformer. Every major AI model and product in the headlines today—ChatGPT, GPT-4, Midjourney, Stable Diffusion, GitHub Copilot, and so on—is built using transformers. Transformers are remarkably general-purpose: while they were initially developed for language translation specifically, they are now advancing the state of the art in domains ranging from computer vision to robotics to computational biology. In short, transformers represent the undisputed gold standard for AI technolo

Innovation AI Transformers Revolutionized AI. What Will Replace Them? By Rob Toews , Contributor. Forbes contributors publish independent expert analyses and insights. I write about the big picture of artificial intelligence. Follow Author Sep 03, 2023, 06:00pm EDT This article is more than 2 years old. The transformer, today's dominant AI architecture, has interesting parallels to the alien language in the 2016 science fiction film "Arrival." Paramount Pictures If modern artificial intelligence has a founding document, a sacred text, it is Google’s 2017 research paper “Attention Is All You Ne

Explore this link on the map →

related reading