🛰️ Daily AI Frontier
‹ back to 2026-08-16

Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation

arXiv cs.CV Multimodal & Generative Hmrishav Bandyopadhyay, Xuanchi Ren, Zijian Huang, Jay Zhangjie Wu, Tianshi Cao, Ruilong Li, Bryan Chu, Sanja Fidler, Yi-Zhe Song, Zian Wang 2026-08-13
Representative image for Context-Matched Distillation: Teacher Causality for Autoregressive Video Distillation

TL;DR - Context-Matched Distillation accelerates autoregressive video generation while ensuring teacher supervision obeys the student’s causal constraints. It achieves state-of-the-art aggregate performance and improves adherence to time-varying camera controls.

  • Replaces bidirectional full-clip scoring with a causal teacher that cannot access future frames or controls.
  • Prefix Scoring evaluates targets using the actual student-generated context that produced them.
  • Prefix Corruption stabilizes early training by perturbing unreliable generated prefixes.
  • Supports frame-wise, chunk-wise, long-video, and camera-conditioned distillation.

view merged work →