Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents
Ranking
Overall
90
Content
100
Popularity
67
Observed public metrics from 1 member.
Merged summary
TL;DR - This paper analyzes how reusable skills can cause LLM-agent failures and higher execution costs. Across two benchmarks, it identifies 307 skill-induced regressions and introduces SkillTriage for evidence-based failure attribution.
- The study finds 125 functional failures and 182 efficiency regressions.
- Seemingly relevant skills can cause agents to implement requirements incorrectly or omit them.
- Efficiency regressions are not attributable to prompt length alone.
- Excessive verification and heavy implementation pipelines account for 67 and 30 excessive-procedure cases, respectively.
Sources (1)
Agent Skills Can Be Harmful: An Empirical Study of Skill-Induced Failures in LLM Agents
Public signals
Hugging Face upvotes 3 · Semantic Scholar citations 1 · Semantic Scholar influential citations 0
TL;DR - This paper analyzes how reusable skills can cause LLM-agent failures and higher execution costs. Across two benchmarks, it identifies 307 skill-induced regressions and introduces SkillTriage for evidence-based failure attribution.
- The study finds 125 functional failures and 182 efficiency regressions.
- Seemingly relevant skills can cause agents to implement requirements incorrectly or omit them.
- Efficiency regressions are not attributable to prompt length alone.
- Excessive verification and heavy implementation pipelines account for 67 and 30 excessive-procedure cases, respectively.