🛰️ Daily AI Frontier
‹ back to 2026-08-13

免蒸馏,只改一个Loss!5行代码实现扩散模型4步生成

WeChat: PaperWeekly Multimodal & Generative 2026-08-11
Representative image for 免蒸馏,只改一个Loss!5行代码实现扩散模型4步生成

TL;DR - Perceptual Flow Matching replaces MSE with a semantic perceptual loss to generate images and videos in 4–8 steps, approaching the quality of conventional 35–50-step flow-matching models without distillation or teacher models.

  • Perceptual supervision penalizes off-manifold predictions, reducing the posterior-mean blurring that accumulates during few-step inference.
  • The method was evaluated on text-to-image generation, image editing, and video generation.
  • Experiments link stronger off-manifold discrimination in feature spaces such as DINO and SigLIP to better few-step generation.
  • Huber, pixel-space, and randomly initialized ViT losses did not provide the same gains, indicating that semantically rich supervision spaces are essential.

view merged work →