🛰️ Daily AI Frontier
‹ back to 2026-09-09

Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents

Research LLM Agents

Ranking

Overall 78
Content 95
Popularity 37

Observed public metrics from 1 member.

Merged summary

TL;DR - Experience Funnel is a self-evolving agent framework that alternates between rapidly updating explicit textual state and slowly consolidating reusable behaviors into model parameters. This aims to preserve fast adaptation while reducing long-term dependence on external context.

  • Distills interaction trajectories into editable textual states, such as skills or agent harnesses, for rapid incorporation and validation of new experience.
  • Selectively transfers state-enabled behaviors that remain useful across revisions into the parametric policy using transition-aware distillation.
  • Repeats rollout generation, state adaptation, and policy consolidation as an iterative improvement loop.
  • Across diverse agent benchmarks, it reportedly outperforms state-only evolution and policy-internalization approaches while progressively internalizing useful experience.

Sources (1)

Experience Funnel: A State-Policy Alternating Loop for Self-Evolving Agents

arXiv cs.CL Wenbo Gao, Zhaomou Song, Zhiyuan Ji, Renxi Liu, Xing Li, Xianzhi Yu, Xiaoguang Li, James Chung-wai Cheung, Weizhe Lin, Yaoyuan Wang 2026-09-08 arXiv:2609.08919
Public signals Semantic Scholar citations 0 · Semantic Scholar influential citations 0
Providers: Hugging Face · N/A OpenAlex · N/A Publisher · N/A Semantic Scholar · Citations 0 · Influential citations 0 X · N/A Fetched 2026-09-14 14:10:32.284840 UTC

TL;DR - Experience Funnel is a self-evolving agent framework that alternates between rapidly updating explicit textual state and slowly consolidating reusable behaviors into model parameters. This aims to preserve fast adaptation while reducing long-term dependence on external context.

  • Distills interaction trajectories into editable textual states, such as skills or agent harnesses, for rapid incorporation and validation of new experience.
  • Selectively transfers state-enabled behaviors that remain useful across revisions into the parametric policy using transition-aware distillation.
  • Repeats rollout generation, state adaptation, and policy consolidation as an iterative improvement loop.
  • Across diverse agent benchmarks, it reportedly outperforms state-only evolution and policy-internalization approaches while progressively internalizing useful experience.
item →