Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social Dissemination
Ranking
Overall
88
Content
95
Popularity
71
Observed public metrics from 1 member.
Merged summary
TL;DR - RA-Bench evaluates AI-generated crisis-video detection across generators, detector families, human judgments, and social dissemination. Current detectors generalize inconsistently, especially on videos that deceive people or circulate socially.
- Includes 17,886 videos spanning 10 social-risk categories, with 1,830 real anchors and 16,056 clips from nine generators.
- Evaluates seven traditional detectors, ten zero-shot multimodal models, and two detection-fine-tuned MLLMs.
- Generation quality, conditioning information, and sampling seeds affect detector performance differently.
- Social dissemination reduces detection reliability, underscoring the need for more robust detectors.
Sources (1)
Can We Defend Against AI-Generated Video Attacks on Real-World Crisis Events? A Systematic Evaluation of Detectors, Generators and Social Dissemination
Public signals
Hugging Face upvotes 282
TL;DR - RA-Bench evaluates AI-generated crisis-video detection across generators, detector families, human judgments, and social dissemination. Current detectors generalize inconsistently, especially on videos that deceive people or circulate socially.
- Includes 17,886 videos spanning 10 social-risk categories, with 1,830 real anchors and 16,056 clips from nine generators.
- Evaluates seven traditional detectors, ten zero-shot multimodal models, and two detection-fine-tuned MLLMs.
- Generation quality, conditioning information, and sampling seeds affect detector performance differently.
- Social dissemination reduces detection reliability, underscoring the need for more robust detectors.