Know Your Agent: Reconnaissance-Driven Pentesting of AI Agents

TL;DR - This paper introduces Know Your Agent (KYA), a framework for automated black-box security testing of AI agents through reconnaissance-driven indirect prompt-injection attacks. It matters because agent profiling can expose hidden weaknesses and enable stronger, target-specific attacks.

• Formalizes agent reconnaissance and the knowledge assets attackers seek.
• Connects extracted information to exploitable agent weaknesses.
• Probes agents, builds target profiles, and crafts tailored attacks automatically.
• Evaluates KYA on security benchmarks and a real-world coding agent, with code and baselines released.