JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety
Ranking
Overall
86
Content
95
Popularity
66
Observed public metrics from 1 member.
Merged summary
TL;DR - JANUS trains an agent guard to anticipate delayed risks from partial trajectories and block unsafe actions before execution. Its Vanguard model improves both protection and benign task completion across four safety benchmarks.
- Uses multi-agent simulation to synthesize diverse, long-horizon trajectories.
- Jointly trains future-risk anticipation and safety adjudication with CoAA-RL.
- Improves average protection by 15.9 percentage points over baseline guards.
- Increases benign task completion by 5.1 percentage points.
Sources (1)
JANUS: Foreseeing Latent Risk for Long-Horizon Agent Safety
Public signals
Hugging Face upvotes 1
TL;DR - JANUS trains an agent guard to anticipate delayed risks from partial trajectories and block unsafe actions before execution. Its Vanguard model improves both protection and benign task completion across four safety benchmarks.
- Uses multi-agent simulation to synthesize diverse, long-horizon trajectories.
- Jointly trains future-risk anticipation and safety adjudication with CoAA-RL.
- Improves average protection by 15.9 percentage points over baseline guards.
- Increases benign task completion by 5.1 percentage points.