✳flâneur — a map of the web's best reading

Mixture of experts - Wikipedia

en.wikipedia.org · 6,356 words · saved by 1 readers

Sorry to interrupt, but today's fundraiser won't last long This Wednesday, we ask you to join the 2% of readers who give. If everyone reading this right now gave just $3, we'd hit our goal in a couple of hours. $3 is all we ask. GIVE $3 MAYBE LATER Proud hosts of Wikipedia and its sister sites Mixture of experts (MoE) is a machine learning technique where multiple expert networks (learners) are used to divide a problem space into homogeneous regions.[1] It differs from ensemble techniques in that typically only one or a few expert models will be run, rather than combining results from all models. In mixture of experts, we always have the following ingredients, but they are constructed and combined differently. Both the experts and the weighting function are trained by minimizing some form of loss function, generally by gradient descent. There is a lot of freedom in choosing the precise form of experts, the weighting function, and the loss function. The meta-pi network, reported by Hamp

Mixture of experts - Wikipedia Jump to content From Wikipedia, the free encyclopedia Machine learning technique "MoE" redirects here. For other uses, see Moe . Part of a series on Machine learning and data mining Paradigms Supervised learning Unsupervised learning Semi-supervised learning Self-supervised learning Reinforcement learning Meta-learning Online learning Batch learning Curriculum learning Rule-based learning Neuro-symbolic AI Neuromorphic engineering Quantum machine learning Problems Classification Generative modeling Regression Clustering Dimensionality reduction Density estimation

Explore this link on the map →

related reading