Vidu S2: Real-Time Interactive, Editable, and Spatial Video Generation
TL;DR - Vidu S2 introduces models for real-time 720p digital-character generation and live video editing, with an exploration of spatial video generation. It advances interactive generative video by allowing references and visual elements to be changed during a stream.
- Vidu S2-Avatar supports dynamic references, stronger instruction following, and real-time 720p generation.
- Vidu S2-Editing enables live style rendering and replacement of clothing, characters, or backgrounds.
- The authors explore real-time spatial video generation for both avatar generation and video editing.
- Reported experiments show Vidu S2 outperforming the evaluated baselines.