Starkly Speaking: Generative Modeling via Drifting
45 views
Skip to first unread message
Hannes Stärk
Feb 21, 2026, 5:03:07 PM (13 days ago) Feb 21
to stark...@googlegroups.com
Hi together,
On monday we will have MingYang and Kaiming's paper on Drifting models!
Speaker:
MingYang Deng who is a PhD student at MIT working with Kaiming He.
Paper:
Generative Modeling via Drifting https://arxiv.org/abs/2602.04770v1 (Mingyang Deng, He Li, Tianhong Li, Yilun Du, Kaiming He)
Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and flow-based models. In this paper, we propose a new paradigm called Drifting Models, which evolve the pushforward distribution during training and naturally admit one-step inference. We introduce a drifting field that governs the sample movement and achieves equilibrium when the distributions match. This leads to a training objective that allows the neural network optimizer to evolve the distribution. In experiments, our one-step generator achieves state-of-the-art results on ImageNet at 256 x 256 resolution, with an FID of 1.54 in latent space and 1.61 in pixel space. We hope that our work opens up new opportunities for high-quality one-step generation.
Meeting Details:
Every Monday at 9:00 PT / 12:00 ET / 18:00 CE(S)T
https://zoom.us/j/5775722530?pwd=ZzlGTXlDNThhUDZOdU4vN2JRMm5pQT09
MingYang Deng who is a PhD student at MIT working with Kaiming He.
Paper:
Generative Modeling via Drifting https://arxiv.org/abs/2602.04770v1 (Mingyang Deng, He Li, Tianhong Li, Yilun Du, Kaiming He)
Generative modeling can be formulated as learning a mapping f such that its pushforward distribution matches the data distribution. The pushforward behavior can be carried out iteratively at inference time, for example in diffusion and flow-based models. In this paper, we propose a new paradigm called Drifting Models, which evolve the pushforward distribution during training and naturally admit one-step inference. We introduce a drifting field that governs the sample movement and achieves equilibrium when the distributions match. This leads to a training objective that allows the neural network optimizer to evolve the distribution. In experiments, our one-step generator achieves state-of-the-art results on ImageNet at 256 x 256 resolution, with an FID of 1.54 in latent space and 1.61 in pixel space. We hope that our work opens up new opportunities for high-quality one-step generation.
Meeting Details:
Every Monday at 9:00 PT / 12:00 ET / 18:00 CE(S)T
https://zoom.us/j/5775722530?pwd=ZzlGTXlDNThhUDZOdU4vN2JRMm5pQT09
Meeting Details:
Every Monday at 9:00 PT / 12:00 ET / 18:00 CE(S)T
https://zoom.us/j/5775722530?pwd=ZzlGTXlDNThhUDZOdU4vN2JRMm5pQT09
Slack Workspace for discussion and paper voting:
https://join.slack.com/t/logag/shared_invite/zt-2zuxi7gd1-rLUgxg6gnCkhO7WlRsyElg
All information: Schedule of upcoming papers, recordings, mailing list:
https://portal.valencelabs.com/starklyspeaking
Hannes Stärk
Website: https://hannes-stark.com
PhD student at MIT
Reply all
Reply to author
Forward
0 new messages