商汤大装置首提TPW,重新定义AI基础设施效能标尺
Ranking
Overall
68
Content
75
Popularity
N/A
No observed public metrics; popularity remains neutral/archived.
Merged summary
TL;DR - SenseTime introduced Tokens Per Watt (TPW), a metric linking AIDC energy use and cost to effective token output, alongside an agent that jointly schedules computing workloads, storage, and power. Its Lingang deployment reportedly raised token output per unit electricity cost by 80%.
- TPW extends PUE by incorporating GPU utilization, model efficiency, electricity pricing, and token output into a unified measure.
- The scheduling agent shifts delay-tolerant training, evaluation, and batch jobs toward lower-cost or lower-load periods while preserving real-time service requirements.
- SenseTime reports 60% more effective IT capacity under existing power constraints and 96% load-forecast accuracy.
- During a Shanghai demand-response event, the Lingang AIDC reduced midday load by 75% and released 46 MWh over two hours.
Sources (1)
商汤大装置首提TPW,重新定义AI基础设施效能标尺
Public signals
N/A
TL;DR - SenseTime introduced Tokens Per Watt (TPW), a metric linking AIDC energy use and cost to effective token output, alongside an agent that jointly schedules computing workloads, storage, and power. Its Lingang deployment reportedly raised token output per unit electricity cost by 80%.
- TPW extends PUE by incorporating GPU utilization, model efficiency, electricity pricing, and token output into a unified measure.
- The scheduling agent shifts delay-tolerant training, evaluation, and batch jobs toward lower-cost or lower-load periods while preserving real-time service requirements.
- SenseTime reports 60% more effective IT capacity under existing power constraints and 96% load-forecast accuracy.
- During a Shanghai demand-response event, the Lingang AIDC reduced midday load by 75% and released 46 MWh over two hours.