🤖 Machine Learning / AI
Advanced
What is a diffusion model?
Answer
A diffusion model is a generative model that learns to reverse a gradual noising process. The forward process progressively adds Gaussian noise to data over T timesteps until the signal is pure noise. The reverse process trains a neural network (typically a U-Net) to predict and remove the noise at each step, learning the score function ∇log p(x). At inference, you start from pure noise and iteratively denoise to generate samples. Diffusion models power Stable Diffusion, DALL-E 2, Imagen, and achieve state-of-the-art image generation quality, outperforming GANs in diversity and stability.
Previous
What is the difference between model parallelism and data parallelism?
Next
What is LoRA (Low-Rank Adaptation)?
More Machine Learning / AI Questions
View all →- Advanced What is the Transformer self-attention mechanism in detail?
- Advanced What is RLHF (Reinforcement Learning from Human Feedback)?
- Advanced What is the difference between model parallelism and data parallelism?
- Advanced What is LoRA (Low-Rank Adaptation)?
- Advanced What is knowledge distillation?