Unsupervised Learning with SURE.pdf
Learning from unlabeled and noisy data is one of the grand challenges of machine learning. As such, it has seen a flurry of research with new ideas proposed continuously. In this work, we revisit a classical idea: Stein's Unbiased Risk Estimator (SURE). We show that, in the context of image recovery, SURE and its generalizations can be used to train convolutional neural networks (CNNs) for a range of image denoising and recovery problems without any ground truth data. Specifically, our goal is to reconstruct an image $x$ from a noisy linear transformation (measurement) of the image. We consider two scenarios: one where no additional data is available and one where we have measurements of other images that are drawn from the same noisy distribution as $x$, but have no access to the clean images. Such is the case, for instance, in the context of medical imaging, microscopy, and astronomy, where noise-less ground truth data is rarely available. We show that in this situation, SURE can be used to estimate the mean-squared-error loss associated with an estimate of $x$. Using this estimate of the loss, we train networks to perform denoising and compressed sensing recovery. In addition, we also use the SURE framework to partially explain and improve upon an intriguing results presented by Ulyanov et al. in "Deep Image Prior": that a network initialized with random weights and fit to a single noisy image can effectively denoise that image. Public implementations of the networks and methods described in this paper can be found at this https URL.
Unsupervised Learning with Stein’s Unbiased Risk Estimator Christopher A. Metzler Ali Mousavi Reinhard Heckel Stanford University Google AI Rice University cmetzler@stanford.edu alimous@google.com rh43@rice.edu arXiv:1805.10531v3 [stat.ML] 22 Jul 2020…
saved by
related reading
- Extending Stein's unbiased risk estimator to train deep denoisers with correlated pairs of noisy imagesproceedings.neurips.cc
- [2007.13640] Solving Linear Inverse Problems Using the Prior Implicit in a Denoiserarxiv.org
- Noise2Scoreproceedings.neurips.cc
- Noiser2Noise.pdfarxiv.org
- Neighbor2Neighborarxiv.org
- generalized surearxiv.org
- Denoising Density Estimatorsarxiv.org
- Regularized by Score Matching (LeCun)papers.nips.cc
- empirical_bayes_without_prior_or_supervision_raphan.pdfcns.nyu.edu
- Beyond Gaussian Noise: A Generalized Approach to Likelihood Analysis with Non-Gaussian Noiseiopscience.iop.org
- Deep Energy Estimator.pdfarxiv.org
- Learning to be Bayesian without Supervisionpapers.nips.cc