EgoExoMoCap: Distributed Ego-Exo Human Motion Capture

TL;DR - EgoExoMoCap combines egocentric and exocentric multimodal signals from multiple smart-glasses wearers to reconstruct human motion without conventional camera rigs or mocap suits. This could enable scalable motion-data collection for embodied AI and VR/AR.

• Jointly estimates the wearer’s motion and the movements of nearby people.
• Uses head and optional wrist tracking to recover global 3D motion.
• Incorporates context-aware DINOv3 image features for robustness to noise and occlusion.
• Experiments on two in-the-wild datasets demonstrate reconstruction in challenging scenarios.