🛰️ Daily AI Frontier
‹ back to 2026-07-21

SEE: Structure-aware Exploring \& Exploiting for Long-horizon GUI Agent Trajectory Synthesis

arXiv cs.LG LLM Agents Zhuohang Fan, Beichen Zhang, Yuanfa Li, Changqiao Wu, Wei Liu, Jian Luan, Weigang Zhang 2026-07-20

TL;DR - SEE synthesizes diverse, long-horizon training trajectories for GUI agents by mapping app interfaces into transition graphs and planning paths through them. This reduces dependence on human demonstrations and improves agents’ success and generalization to unseen screens.

  • Builds explicit transition graphs spanning screens and UI elements.
  • Uses graph planning and controlled sampling to compose reproducible, explainable trajectories.
  • Generates 14.8-step trajectories on average while preventing spurious cycles.
  • Fine-tuning on SEE improves performance across multiple real-world apps.

view merged work →