RT by @ylecun: Physical AI evals are starting to become a real category. Until recently, most VLA…

TL;DR - Physical AI evaluation is expanding beyond simulation success-rate leaderboards toward unified, independent assessments across simulated and real robots. This matters because reliability, speed, generalization, throughput, and failure rates better reflect real-world deployment readiness.

• Allen AI and LeRobot aim to standardize evaluation across multiple simulation benchmarks.
• PhAIL and Robocurve emphasize real-robot testing and production-oriented metrics.
• RoboDojo combines simulation and real-world evaluation.
• Independent evaluations could distinguish robot models whose demonstrations appear increasingly similar.