蚂蚁发布大模型内生式安全护栏SingProbe，让AI边生成边识别风险

TL;DR - Ant Group released SingProbe, an open-source guardrail that detects safety and factual-reliability risks during LLM generation by reusing internal inference signals. It aims to enable earlier intervention with less than 0.5% reported decoding overhead.

• SingProbe continuously emits risk scores so applications can warn, stop, or retry generation before unsafe content is fully displayed.
• Tests on Ling-3.0-flash reportedly beat selected public baselines for response safety classification and streaming detection, while roughly matching a reference baseline for hallucination detection.
• The accompanying SingStreamBench evaluates whether streaming guardrails detect the precise transition from safe to risky content without triggering too early.
• SingProbe-Med’s targeted decoding intervention corrected 25.03% of previously incorrect AntAngelMed-100B answers; SingProbe supports 29 open-source models plus SGLang and vLLM.