Vapnik–Chervonenkis dimension - Wikipedia

In Vapnik–Chervonenkis theory, the Vapnik–Chervonenkis (VC) dimension is a measure of the size (capacity, complexity, expressive power, richness, or flexibility) of a class of sets. The notion can be extended to classes of binary functions. It is defined as the cardinality of the largest set of points that the function class can shatter—that is, for which all possible binary labelings can be realized by some function in the class. It was originally defined by Vladimir Vapnik and Alexey Chervonenkis.[1] Informally, the capacity of a classification model is related to how complicated it can be. For example, consider the thresholding of a high-degree polynomial: if the polynomial evaluates above zero, that point is classified as positive, otherwise as negative. A high-degree polynomial can be wiggly, so that it can fit a given set of training points well. Such a polynomial has a high capacity. A much simpler alternative is to threshold a linear function. This function may not fit the trai

Vapnik–Chervonenkis dimension - Wikipedia Jump to content From Wikipedia, the free encyclopedia Notion in supervised machine learning In Vapnik–Chervonenkis theory , the Vapnik–Chervonenkis (VC) dimension is a measure of the size (capacity, complexity, expressive power, richness, or flexibility) of a class of sets. The notion can be extended to classes of binary functions. It is defined as the cardinality of the largest set of points that the function class can shatter —that is, for which all possible binary labelings can be realized by some function in the class. It was originally defined by

related reading

• Vapnik–Chervonenkis theory - Wikipediaen.wikipedia.org
• Support vector machine - Wikipediaen.wikipedia.org
• Support vector machine - Wikipediaen.wikipedia.org
• Toy Models of Superpositiontransformer-circuits.pub
• Alexey Chervonenkis - Wikipediaen.wikipedia.org
• arxiv.org/pdf/1805.08522arxiv.org
• Neural Networks, Manifolds, and Topology -- colah's blogcolah.github.io
• Curse of dimensionality - Wikipediaen.wikipedia.org
• Statistical learning theory - Wikipediaen.wikipedia.org
• deeplearningbook.org/contents/ml.htmldeeplearningbook.org
• perceptron learning algo, max margin classifierspeople.eecs.berkeley.edu
• Neural networks generalize because of this one weird trick — AI Alignment Forumalignmentforum.org