8位AI Infra高管复盘WAIC：当堆砌「暴力美学」触顶，AI Infra如何求变？

TL;DR - Interviews with eight AI infrastructure executives at WAIC 2026 suggest the industry is shifting from maximizing GPU and training-cluster scale toward delivering reliable, low-cost inference tokens. Agent adoption matters because long-running, tool-using workflows sharply increase token consumption and infrastructure demands.

• Inference reportedly now dominates enterprise AI compute spending, making token throughput, latency, utilization, and cost more important operational metrics than GPU count.
• “Token factories” are framed as the inference-focused component of broader AI factories, optimized for standardized, scalable model serving.
• Post-scaling competition increasingly centers on system-wide optimization across chips, interconnects, inference engines, heterogeneous scheduling, energy, and workload routing.
• Agent infrastructure must sustain complex, continuous workloads through reliable networking, fault tolerance, model routing, tool orchestration, memory, and sandboxing.