🛰️ Daily AI Frontier
‹ back to 2026-08-07

When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents

arXiv cs.AI LLM Agents Linfang Shang, Ming Xu, Yiding Sun, Tianle Xia, Lingxiang Hu, Lan Xu, Ning Zheng 2026-08-06
Representative image for When Self-Evolution Backfires: Pre-Commit Gating against Skill Contamination in LLM Agents

TL;DR - An arXiv paper showing that self-evolving LLM agents suffer a "capability contamination" phase transition, where accumulating distilled skills past a critical pool size degrades performance irreversibly, and proposes a pre-commit verifier gate (VaG) to admit only safe skills.

  • Contamination is structural: a defective skill entering the decision context becomes reference material for later skill distillation, forming cross-round contamination chains; post-hoc removal of the culprit skill recovers only a small fraction of lost performance.
  • VaG uses a progressive trust hierarchy of three heterogeneous critics — structural validity, behavioral harmlessness, semantic consistency — filtering each skill individually, plus marginal-gain subset selection at the top tier to remove combinatorial contamination before runtime.
  • On Terminal-Bench 2, unconditional accumulation peaks then degrades, while VaG improves every round to 72% pass@1 with a roughly 5x smaller skill pool.
  • The frozen VaG skill pool transfers positively to four other backbones and a second benchmark without re-evolution; ablations show the three critics are complementary and intercept largely disjoint classes of harmful skills.

view merged work →