Mode collapse

In machine learning, mode collapse is a failure mode observed in generative models, originally noted in Generative Adversarial Networks (GANs). It occurs when the model produces outputs that are less diverse than expected, effectively "collapsing" to generate only a few modes of the data distribution while ignoring others. This phenomenon undermines the goal of generative models to capture the full diversity of the training data.

Mode collapse - Wikipedia Jump to content From Wikipedia, the free encyclopedia Failure of a generative model to generate diverse samples Not to be confused with Model collapse . In machine learning , mode collapse is a failure mode observed in generative models , originally noted in Generative Adversarial Networks (GANs) . It occurs when the model produces outputs that are less diverse than expected, effectively "collapsing" to generate only a few modes of the data distribution while ignoring others. This phenomenon undermines the goal of generative models to capture the full diversity of the

saved by

• Arjun Khandelwal
• Rohan Kanti
• Hyojae Park

related reading

• What are Diffusion Models? | Lil'Loglilianweng.github.io
• What failure looks like — AI Alignment Forumalignmentforum.org
• What are Diffusion Models?lilianweng.github.io
• Do Machine Learning Models Memorize or Generalize?pair.withgoogle.com
• Generative modelling in latent space – Sander Dielemansander.ai
• Mode-Conditioning Unlocks Superior Test-Time Scalingarxiv.org
• ⭐️ Diffusion Modelsandrewkchan.dev
• Diffusion models from scratchchenyang.co
• Dynamical regimes of diffusion modelsnature.com
• Diffusion model - Wikipediaen.wikipedia.org
• Generalization Dynamics of LM Pre-training — Jiaxin Wenjiaxin-wen.github.io
• Generative Modeling via Driftingarxiv.org