3 NeuroEvolution of Augmenting Topologies (NEAT)
The NEAT method of evolving artificial neural networks combines the usual search for appropriate network weights with complexification of the network structure. This approach is highly effective, as shown e.g. in comparison to other neuroevolution (NE) methods in the double pole balancing benchmark task . The NEAT method consists of solutions to three fundamental challenges in evolving neural network topology: (1) What kind of genetic representation would allow disparate topologies to crossover in a meaningful way? Our solution is to use historical markings to line up genes with the same origin. (2) How can topological innovation that needs a few generations to optimize be protected so that it does not disappear from the population prematurely? Our solution is to separate each innovation into a different species. (3) How can topologies be minimized throughout evolution so the most efficient solutions will be discovered? Our solution is to start from a minimal structure and add nodes an
3 NeuroEvolution of Augmenting Topologies (NEAT) Next: 4 The Robot Duel Up: Competitive Coevolution through Evolutionary Previous: 2 Background Subsections 3.1 Genetic Encoding 3.2 Tracking Genes through Historical Markings 3.3 Protecting Innovation through Speciation 3.4 Minimizing Dimensionality through Complexification 3 NeuroEvolution of Augmenting Topologies (NEAT) The NEAT method of evolving artificial neural networks combines the usual search for appropriate network weights with complexification of the network structure. This approach is highly effective, as shown e.g. in comparison to
related reading
- NEAT Overview — NEAT-Python 1.1.0 documentationneat-python.readthedocs.io
- Zoom In: An Introduction to Circuitsdistill.pub
- A Visual Guide to Evolution Strategies | 大トロblog.otoro.net
- Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
- The World Inside Neural Networksgoodfire.ai
- Analogies between Biology and Deep Learning [rough note] -- colah's blogcolah.github.io
- Spatially embedded recurrent neural networks reveal widespread links between structural and functional neuroscience findingsnature.com
- A biological perspective on evolutionary computationnn.cs.utexas.edu
- Ask HN: Which algorithms based on biological ideas do you know?news.ycombinator.com
- Open-endedness: The last grand challenge you’ve never heard of – O’Reillyoreilly.com
- Naturally Occurring Equivariance in Neural Networksdistill.pub
- Evo 2 Can Design Entire Genomesasimov.press