RT by @_akhaliq: Today, we're introducing CaliBench, evaluating whether video world models…

TL;DR - Odyssey introduced CaliBench, a benchmark for testing whether video world models reproduce the real-world probability distributions of random physical events. It matters because visually plausible frames do not guarantee statistically calibrated simulations.

• Evaluates stochastic events such as rolling dice and drawing cards.
• Compares model-generated outcome distributions with those expected in reality.
• Focuses on probabilistic calibration rather than only frame-level physical plausibility.
• The provided announcement describes the benchmark’s purpose but does not report results.