PeakBench: Benchmarking Resource-Aware Tool Invocation in LLM Agents

TL;DR - PeakBench evaluates whether LLM agents can correctly parallelize multi-tool workflows while respecting resource limits. It matters because sound dependency planning alone does not ensure safe, low-latency execution.

• Provides executable workflows with execution-grounded dependencies and measured resource profiles.
• Separately evaluates logical dependency planning and physical resource-constrained scheduling.
• Finds that strong planners can still execute inefficiently or trigger avoidable resource overflows.
• Shows that exposing resource information can reduce overflows and improve utilization.