Kalmogorov-Arnold Neural Networks Shake Up How AI Is Done - IEEE Spectrum
Artificial neural networks—algorithms inspired by biological brains—are at the center of modern artificial intelligence, behind both chatbots and image generators. But with their many neurons, they can be black boxes, their inner workings uninterpretable to users. Researchers have now created a fundamentally new way to make neural networks that in some ways surpasses traditional systems. These new networks are more interpretable and also more accurate, proponents say, even when they’re smaller. Their developers say the way they learn to represent physics data concisely could help scientists uncover new laws of nature. “It’s great to see that there is a new architecture on the table.” —BRICE MÉNARD, JOHNS HOPKINS UNIVERSITY For the past decade or more, engineers have mostly tweaked neural-network designs through trial and error, says Brice Ménard, a physicist at Johns Hopkins University who studies how neural networks operate but was not involved in the new work, which was posted on arX
Artificial neural networks—algorithms inspired by biological brains—are at the center of modern artificial intelligence, behind both chatbots and image generators. But with their many neurons, they can be black boxes, their inner workings uninterpretable to users. Researchers have now created a fundamentally new way to make neural networks that in some ways surpass traditional systems. These new networks are more interpretable and also more accurate, evidence shows, even when they’re smaller. Their developers say the way they learn to represent physics data concisely could help scientists…
related reading
- [2404.19756] KAN: Kolmogorov-Arnold Networksarxiv.org
- 200-Year-Old Math Opens Up AI’s Mysterious Black Boxspectrum.ieee.org
- KANarxiv.org
- Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
- Aman's AI Journal • Primers • Ilya Sutskever's Top 30aman.ai
- How to Make the Universe Think for Us | Quanta Magazinequantamagazine.org
- Artificial Neural Nets Finally Yield Clues to How Brains Learn | Quanta Magazinequantamagazine.org
- How Computationally Complex Is a Single Neuron? | Quanta Magazinequantamagazine.org
- Researchers Build AI That Builds AI | Quanta Magazinequantamagazine.org
- The World Inside Neural Networksgoodfire.ai
- Mechanistic Interpretability: A Challenge Common to Both Artificial and Biological Intelligencekempnerinstitute.harvard.edu
- AI Overcomes Stumbling Block on Brain-Inspired Hardware | Quanta Magazinequantamagazine.org