Markov random fields
Bayesian networks are a class of models that can compactly represent many interesting probability distributions. However, we have seen in the previous chapter that some distributions may have independence assumptions that cannot be perfectly represented by the structure of a Bayesian network. In such cases, unless we want to introduce false independencies among the variables of our model, we must fall back to a less compact representation (which can be viewed as a graph with additional, unnecessary edges). This leads to extra, unnecessary parameters in the model, and makes it more difficult to learn these parameters and to make predictions. There exists, however, another technique for compactly representing and visualizing a probability distribution that is based on the language of undirected graphs. This class of models (known as Markov Random Fields or MRFs) can compactly represent independence assumptions that directed models cannot represent. We will explore the advantages and draw
Markov random fields Bayesian networks are a class of models that can compactly represent many interesting probability distributions. However, we have seen in the previous chapter that some distributions may have independence assumptions that cannot be perfectly represented by the structure of a Bayesian network. In such cases, unless we want to introduce false independencies among the variables of our model, we must fall back to a less compact representation (which can be viewed as a graph with additional, unnecessary edges). This leads to extra, unnecessary parameters in the model, and makes
saved by
related reading
- Bayesian Neural Networkscs.toronto.edu
- Bayesian network - Wikipediaen.wikipedia.org
- Coordinate Ascent Mean-field Variational Inference (Univariate Gaussian Example)suzyahyah.github.io
- Bayesian programming - Wikipediaen.wikipedia.org
- Understanding Convolutions on Graphsdistill.pub
- Normalizing flowsbehindml.com
- Contentsermongroup.github.io
- Learning to be Bayesian without Supervisionpapers.nips.cc
- 07-representation-learning.pdfweb.stanford.edu
- Probabilistic Relevance Frameworkstaff.city.ac.uk
- Causal Markov condition - Wikipediaen.wikipedia.org
- Normalizing Flows for Probabilistic Modeling and Inferencealphaxiv.org