🛰️ Daily AI Frontier
‹ back to 2026-07-30

PhiZero: A World Model Built Around Physical Language

arXiv cs.CV Multimodal & Generative Shuyao Shang, Yuqi Wang, Ruopeng Gao, Xu Chen, Tieniu Tan, Lue Fan, Zhaoxiang Zhang 2026-07-30

TL;DR - PhiZero is a world model that predicts compact “physical-language” representations of state transitions before rendering them as video. This reason-then-render design makes physical dynamics explicit rather than leaving them implicit in pixel-space prediction.

  • Learns its discrete physical-language representation from in-the-wild videos through self-supervision.
  • Separates future-state reasoning from video generation to promote physically coherent evolution.
  • Evaluated on both generation and understanding benchmarks.
  • Supports interactive modeling, action-conditioned simulation, and zero-shot motion transfer.

view merged work →