🛰️ Daily AI Frontier
‹ back to 2026-08-10

Conformal Coverage Guarantees for Any Video Temporal Grounder

arXiv cs.CV Multimodal & Generative Aseel Mohamed, Rasul Khanbayov, Erchin Serpedin, Hasan Kurban 2026-08-07
Representative image for Conformal Coverage Guarantees for Any Video Temporal Grounder

TL;DR - COVER is a post-hoc, model-agnostic conformal prediction wrapper that converts any video temporal grounder into one that outputs a temporal region guaranteed to contain the true moment with probability ≥ 1−α. It matters because event boundaries are inherently ambiguous — annotators often overlap by less than half — so single-interval predictions hide reliability that calibrated regions expose.

  • Calibrates a quantile of a temporal nonconformity score on held-out labels and widens the base prediction accordingly; the guarantee is finite-sample and distribution-free under exchangeability, with no retraining or white-box access required.
  • Two score families are provided: a two-sided boundary-widening score for interval-emitting grounders, and a super-level-set score for grounders emitting a relevance signal.
  • Grounding-specific theory bounds certified region size, characterizes when coverage survives conditioning on event length, and analyzes degradation when multiple moments from one video break exchangeability.
  • Evaluated across three benchmarks and five grounders (trained localizers and black-box video–language models), realized coverage tracks the target, and calibration reveals failure modes that point metrics obscure.

view merged work →