Mode collapse
In machine learning, mode collapse is a failure mode observed in generative models, originally noted in Generative Adversarial Networks (GANs). It occurs when the model produces outputs that are less diverse than expected, effectively "collapsing" to generate only a few modes of the data distribution while ignoring others. This phenomenon undermines the goal of generative models to capture the full diversity of the training data.
Mode collapse - Wikipedia Jump to content From Wikipedia, the free encyclopedia Failure of a generative model to generate diverse samples Not to be confused with Model collapse . In machine learning , mode collapse is a failure mode observed in generative models , originally noted in Generative Adversarial Networks (GANs) . It occurs when the model produces outputs that are less diverse than expected, effectively "collapsing" to generate only a few modes of the data distribution while ignoring others. This phenomenon undermines the goal of generative models to capture the full diversity of the
saved by
related reading
- Being creative requires taking riskshenrikkarlsson.xyz
- Mysteries of mode collapse — LessWronglesswrong.com
- What are Diffusion Models? | Lil'Loglilianweng.github.io
- What are Diffusion Models?lilianweng.github.io
- The “it” in AI models is the dataset. — Non_Intnonint.com
- suchir.net/fair_use.htmlsuchir.net
- Grokking Diffusion Models – Non_Interactive – Software & MLnonint.com
- [2404.01413v2] Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Dataarxiv.org
- ⭐️ Diffusion Modelsandrewkchan.dev
- Yang Songyang-song.net
- Alexi Gladstone | Explorative Modeling -- Unlocking a Third Pretraining Axis and End-to-End Generationalexiglad.github.io
- GenAI Handbookgenai-handbook.github.io