Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
TL;DR - Echoverse generates deep, stateful applications and co-evolves their tasks and verifiers with computer-use agents. Training a 9B model on 12 environments improved performance from 36.5% to 67.1% across 14 evaluation splits.
- Database-grounded grading evaluates actions against actual application state.
- Deep environments improved live-site accuracy, while shallow ones degraded it below the base model.
- Targeted interface-control practice transferred to unseen widget families and the open web.
- Reinforcement learning with grounded and dense per-step rewards raised held-out scores from 58.8% to 68.0%.