When No Benchmark Exists: Validating Comparative LLM Safety Scoring Without Ground-Truth Labels
Summary
This paper introduces a framework for validating comparative LLM safety scoring without ground-truth labels, using an 'instrumental-validity chain' to establish deployment evidence. It demonstrates the method using a local-first tool called SimpleAudit on Norwegian safety packs and compares models like Borealis and Gemma 3.
View Cached Full Text
Cached at: 05/08/26, 10:54 AM
Paper page - When No Benchmark Exists: Validating Comparative LLM Safety Scoring Without Ground-Truth Labels
Source: https://huggingface.co/papers/2605.06652
Abstract
Comparative safety scoring without labeled benchmarks relies on scenario-based audits with validity chains measuring responsiveness, variance dominance, and stability to establish deployment evidence.
Many deployments must compare candidate language models for safety before a labeled benchmark exists for the relevant language, sector, or regulatory regime. We formalize this setting asbenchmarkless comparative safety scoringand specify the contract under which ascenario-based auditcan be interpreted as deployment evidence. Scores are valid only under a fixed scenario pack, rubric, auditor, judge, sampling configuration, andrerun budget. Because no labels are available, we replace ground-truth agreement with aninstrumental-validity chain: responsiveness to a controlled safe-versus-abliterated contrast, dominance oftarget-driven varianceover auditor andjudge artifacts, and stability across reruns. We instantiate the chain in SimpleAudit, alocal-first scoring instrument, and validate it on a Norwegiansafety pack. Safe and abliterated targets separate withAUROCvalues between 0.89 and 1.00, target identity is the dominant variance component (η^2 approx 0.52), and severity profiles stabilize by ten reruns. Applying the same chain to Petri shows that it admits both tools. The substantial differences arise upstream of the chain, in claim-contract enforcement and deployment fit. A Norwegian public-sector procurement case comparing Borealis and Gemma 3 demonstrates the resulting evidence in practice: the safer model depends on scenario category and risk measure. Consequently, scores, matched deltas, critical rates, uncertainty, and the auditor and judge used must be reported together rather than collapsed into a single ranking.
View arXiv pageView PDFGitHub14Add to collection
Get this paper in your agent:
hf papers read 2605\.06652
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.06652 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.06652 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.06652 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Beyond Binary Labels: Diagnostic Evaluation of LLM Safety with Prompt-Level Rubrics
该论文提出 DiagSafe 诊断式评估框架,用提示级评分标准(prompt-level rubrics)替代二元安全标签,构建了中英双语、基于 84 类安全分类体系的基准,使 LLM-as-a-judge 与人工标注的一致性达到 95.34%(Cohen's κ=0.864),并揭示了主流模型在中文与多轮对话场景下的独特漏洞。
Benchmarking the Benchmarks: Evaluating Automated Safety Benchmarks for Small Language Models
This paper evaluates automated safety benchmarks for small language models, finding high ambiguity in judgments that compromises reliability and reveals a capability-safety confound.
Benchmarks Are Not Monolithic: Sample-Level Auditing and Orchestration for LLM Evaluation
This paper proposes a dataset-centric meta-evaluation framework that audits LLM benchmarks at the sample level across five latent dimensions, exposing internal heterogeneity and enabling criterion-driven composition of benchmark subsets for targeted model evaluation.
Gate AI: LLM Security Benchmark Evaluation Methodology and Results
This paper presents an evaluation methodology for LLM security detectors that addresses systematic weaknesses like per-dataset threshold tuning and undisclosed operating points. The framework uses cross-validation across 16 benchmarks, selects a single global operating point, and includes multiple diagnostics for generalization.
Stress-testing medical large language models reveals latent safety pathology beyond benchmark accuracy
This paper introduces AI-MASLD, a stress-audit framework for medical LLMs that reveals how benchmark accuracy can hide serious safety failures, and demonstrates that open-weight models can match or exceed proprietary ones on safety dimensions.