🛰️ Daily AI Frontier
‹ back to 2026-08-02

ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine

arXiv cs.CV Embodied AI Yukang Cao, Haozhe Xie, Beichen Wen, Runmao Yao, Yinghao Liu, Yue Huang, Zhichao Liao, Yunxiang Wang, Haiheng Liu, Xingshun Tian, Dawei Su, Long Zhuo, Dacheng Tao, Xiaogang Wang, Liang Pan, Ziwei Liu 2026-07-30
Representative image for ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine

TL;DR - ACE-Data-0 is a synchronized multisensory dataset capturing human activity at table and room scales. It addresses fragmented embodied-AI supervision for imitation learning, world models, and vision-language-action systems.

  • Contains 150 hours, 17 million video frames, and 75,000 episodes across 200 tasks performed by 50 participants.
  • Aligns egocentric and exocentric video with body and hand motion, object geometry and trajectories, audio, and tactile signals.
  • Covers fine-grained manipulation, long-horizon household activities, locomotion, and human-scene interaction.
  • Its hierarchical benchmark reveals limitations of current methods under contact, occlusion, egomotion, and long temporal horizons.

view merged work →