[1809.09087] Implicit Maximum Likelihood Estimation
Abstract:Implicit probabilistic models are models defined naturally in terms of a sampling procedure and often induces a likelihood function that cannot be expressed explicitly. We develop a simple method for estimating parameters in implicit models that does not require knowledge of the form of the likelihood function or any derived quantities, but can be shown to be equivalent to maximizing likelihood under some conditions. Our result holds in the non-asymptotic parametric setting, where both the capacity of the model and the number of data examples are finite. We also demonstrate encouraging experimental results.
Implicit Maximum Likelihood Estimation Ke Li Jitendra Malik Department of Electrical Engineering and Computer Sciences University of California, Berkeley Berkeley, CA 94720 United States arXiv:1809.09087v2 [cs.LG] 22…
saved by
related reading
- Marginally Better blogrishit-dagli.github.io
- A Gallery of Methods Beyond RL — Part I: Sampling Methodsshengyu-feng.github.io
- Alexi Gladstone | Explorative Modeling -- Unlocking a Third Pretraining Axis and End-to-End Generationalexiglad.github.io
- Gregory Gundersengregorygundersen.com
- 2409.02908arxiv.org
- What are Diffusion Models? | Lil'Loglilianweng.github.io
- Tips for Training Likelihood Modelsblog.evjang.com
- David Duvenaudcs.toronto.edu
- Denoising Density Estimatorsarxiv.org
- Generative Modeling by Estimating Gradients of the Data Distribution | Yang Songyang-song.github.io
- Maximum likelihood estimation - Wikipediaen.wikipedia.org
- Yang Songyang-song.net