Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
Ranking
Overall
86
Content
95
Popularity
66
Observed public metrics from 1 member.
Merged summary
TL;DR - Echoverse generates deep, stateful applications and co-evolves their tasks and verifiers with computer-use agents. Training a 9B model on 12 environments improved performance from 36.5% to 67.1% across 14 evaluation splits.
- Database-grounded grading evaluates actions against actual application state.
- Deep environments improved live-site accuracy, while shallow ones degraded it below the base model.
- Targeted interface-control practice transferred to unseen widget families and the open web.
- Reinforcement learning with grounded and dense per-step rewards raised held-out scores from 58.8% to 68.0%.
Sources (1)
Echoverse: Deep, Evolving Environments for Training Computer-Use Agents at Scale
Public signals
Hugging Face upvotes 13
TL;DR - Echoverse generates deep, stateful applications and co-evolves their tasks and verifiers with computer-use agents. Training a 9B model on 12 environments improved performance from 36.5% to 67.1% across 14 evaluation splits.
- Database-grounded grading evaluates actions against actual application state.
- Deep environments improved live-site accuracy, while shallow ones degraded it below the base model.
- Targeted interface-control practice transferred to unseen widget families and the open web.
- Reinforcement learning with grounded and dense per-step rewards raised held-out scores from 58.8% to 68.0%.