终于！世界模型进入“有声时代”：24FPS画面+48kHz立体声实时生成
Ranking
Overall
71
Content
80
Popularity
N/A
No observed public metrics; popularity remains neutral/archived.
Merged summary
TL;DR - Noiz AI unveiled HelixWorld 1.0, an interactive world model that jointly generates real-time video at 24 FPS and 48 kHz stereo audio. Native audiovisual generation could make simulated environments more responsive and spatially immersive.
- A unified Transformer jointly generates audio and video conditioned on user actions rather than adding sound after video generation.
- Training combines cleaned real-world first-person footage with game-engine data containing precise action, geometry, and sound-source annotations.
- Causal generation, KV caching, self-generated-history training, and diffusion distillation enable continuous real-time output.
- Noiz AI says the model weights and code will be fully open-sourced in the coming weeks.
Sources (1)
终于！世界模型进入“有声时代”：24FPS画面+48kHz立体声实时生成
Public signals
N/A
TL;DR - Noiz AI unveiled HelixWorld 1.0, an interactive world model that jointly generates real-time video at 24 FPS and 48 kHz stereo audio. Native audiovisual generation could make simulated environments more responsive and spatially immersive.
- A unified Transformer jointly generates audio and video conditioned on user actions rather than adding sound after video generation.
- Training combines cleaned real-world first-person footage with game-engine data containing precise action, geometry, and sound-source annotations.
- Causal generation, KV caching, self-generated-history training, and diffusion distillation enable continuous real-time output.
- Noiz AI says the model weights and code will be fully open-sourced in the coming weeks.