SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning

Hugging Face Daily Papers Papers

Summary

SingGuard is a policy-adaptive multimodal LLM guardrail model for text, image, and multilingual safety moderation, featuring dynamic reasoning and a new benchmark SingGuard-Bench. It achieves state-of-the-art results across multiple datasets.

Vision-language models (VLMs) are increasingly deployed in consumer, medical, financial, and enterprise applications. This broad deployment expands the safety surface: risks can arise from multimodal question answering, assistant responses, and cross-modal composition, while moderation policies may vary across products, regions, and deployment stages. Most existing guardrails either rely on fixed taxonomies or target only a narrow set of interaction settings, which limits their adaptability when safety rules change at deployment time. We present SingGuard, a policy-adaptive multimodal guardrail model family for safety assessment in multimodal conversations. SingGuard treats the active policy as a runtime input: given natural-language rules, it checks the target content against the active policy rule by rule and predicts both the safety label and the triggered rule. To balance efficiency and interpretability, SingGuard supports fast, hybrid, and slow inference regimes along a fast-to-slow reasoning spectrum, ranging from direct safety judgments to policy-grounded deliberation. We further optimize this behavior with fast--slow decoupled reinforcement learning. We also introduce SingGuard-Bench, a multimodal guardrail benchmark with 56{,}340 examples spanning 80+ fine-grained risk types across multimodal QA, adversarial attack, and dynamic-rule evaluation settings, including cross-modal joint-risk cases where each modality is harmless in isolation but their composition implies unsafe intent. Across six benchmark families (35 datasets), SingGuard achieves state-of-the-art average F1 in every family. Dynamic-rule evaluation further shows improved policy-following accuracy from 0.6465 to 0.7415 under runtime policy shifts. Our code is available at https://github.com/inclusionAI/Sing-Guard.
Original Article
View Cached Full Text

Cached at: 06/29/26, 06:01 AM

Paper page - SingGuard: A Policy-Adaptive Multimodal LLM Guardrail with Dynamic Reasoning

Source: https://huggingface.co/papers/2606.22873

image

SingGuard is a policy-adaptive multimodal LLM guardrail model family for text, image, image-text, query-response, and multilingual safety moderation. Unlike static guardrails that rely on a fixed taxonomy, SingGuard treats the active safety policy as a runtime input and performs rule-by-rule policy-grounded judgment, enabling different products or deployment scenarios to apply customized and dynamically updated safety rules.

SingGuard supports three inference regimes: fast judgment for low-latency moderation, slow policy-grounded reasoning for complex or audit-sensitive cases, and hybrid fast-slow reasoning with early exit. It also introduces Rule Isolation Mask (RI-Mask), an inference-time acceleration method for multi-rule moderation: shared image-text content is encoded once, while different rule branches remain isolated through attention masking, enabling parallel rule checking without cross-rule interference.

We further introduce SingGuard-Bench, a 56,340-example multimodal guardrail benchmark covering 80+ fine-grained risk types, including image safety, multimodal QA safety, cross-modal hidden-intent attacks, multilingual moderation, and dynamic-rule evaluation. Across 6 benchmark families and 35 datasets, SingGuard achieves state-of-the-art average F1 and improves policy-following accuracy under runtime rule shifts.

Similar Articles

Robust and Efficient Guardrails with Latent Reasoning

arXiv cs.AI

CoLaGuard is a new guardrail model that transfers multi-step safety reasoning into a continuous latent space, achieving 12.9x speedup and 22.4x token reduction compared to explicit reasoning baselines while matching macro-F1 performance on ten safety benchmarks.

OpenGuardrails: An Open-Source Context-Aware AI Guardrails Platform

Papers with Code Trending

OpenGuardrails is an open-source platform for AI safety, offering context-aware content-safety and manipulation detection (e.g., prompt injection, jailbreaking) via a unified model, plus a separate NER pipeline for data-leakage identification. It achieves state-of-the-art performance on safety benchmarks and supports private, enterprise-grade deployment.