Pricing the Risk of Runtime Compression: Anytime-Valid Admission and a Served-Output Law for Compressed Serving State
Ranking
Overall
79
Content
95
Popularity
41
Observed public metrics from 1 member.
Merged summary
TL;DR - This paper introduces formally verified, anytime-valid risk accounting for dynamically compressing LLM serving state. On live traffic, it maintained guarantees across 352,333 admission decisions and reduced exact fallbacks from 30% to 14% at matched risk.
- Replaces request-level union bounds—which exhausted on every long request—with a physically accounted risk ledger valid at every admission call.
- Derives a machine-checked law linking served-output total variation to a configurable compression threshold.
- Audits a 1,064× certification gap and attributes nearly all of it to the gate’s operating point rather than query-envelope looseness.
- Uses exchangeable order-statistic bounds across 80 serving histories for non-vacuous extrapolation; 228 probabilistic theorems are checked in Lean 4 without
sorry.
Sources (1)
Pricing the Risk of Runtime Compression: Anytime-Valid Admission and a Served-Output Law for Compressed Serving State
Public signals
Semantic Scholar citations 0 · Semantic Scholar influential citations 0
TL;DR - This paper introduces formally verified, anytime-valid risk accounting for dynamically compressing LLM serving state. On live traffic, it maintained guarantees across 352,333 admission decisions and reduced exact fallbacks from 30% to 14% at matched risk.
- Replaces request-level union bounds—which exhausted on every long request—with a physically accounted risk ledger valid at every admission call.
- Derives a machine-checked law linking served-output total variation to a configurable compression threshold.
- Audits a 1,064× certification gap and attributes nearly all of it to the gate’s operating point rather than query-envelope looseness.
- Uses exchangeable order-statistic bounds across 80 serving histories for non-vacuous extrapolation; 228 probabilistic theorems are checked in Lean 4 without
sorry.