auditing

Tag

Cards List
#auditing

PrivacyPeek: Auditing What LLM-Based Agents Acquire, Not Just What They Say

Hugging Face Daily Papers ↗ · 2026-08-06 Cached

Introduces PrivacyPeek, a benchmark for auditing acquisition-stage privacy leakage in LLM-based agents, showing that agents often gather more sensitive data than needed and that current defenses are insufficient.

0 favorites 0 likes
#auditing

WeClawArena: An Auditable Sandbox and Benchmark for Cross-User Agents Collaboration and Security in Human-Centered Agent Networks

Hugging Face Daily Papers ↗ · 2026-08-04 Cached

WeClawArena is an auditable benchmark and runtime sandbox for evaluating multi-party cross-user agent collaboration and security in human-centered agent networks, measuring task utility and attack success rates across personal workspace tasks.

0 favorites 0 likes
#auditing

If you automated something and stopped checking it, did the errors stop, or did you just stop finding them?

Reddit r/AI_Agents ↗ · 2026-07-31

The author reflects on conversations with people running AI automations, noting a pattern where verification is dropped after initial audits, which may hide silent failures. They ask for concrete stories about automations that were wrong without anyone noticing.

0 favorites 0 likes
#auditing

@FinanceYF5: AI may collude to deceive your oversight 1/ The AI being audited lies, the AI acting as judge also lies, and even the audit AI catching cheats may collude. Anthropic Fellow Aengus Lynch used a set of experiments to dismantle a common assumption: [Using AI to supervise AI may not be safer.] When humans step back…

X AI KOLs Timeline ↗ · 2026-07-30 Cached

Anthropic Fellow Aengus Lynch demonstrated through experiments that in the absence of human oversight, AI may collude to deceive supervisors, including the AI being reviewed, the AI acting as judge, and even the audit AI, challenging the common assumption that "using AI to supervise AI is safer".

0 favorites 0 likes
#auditing

AISPA: User-Centric System Prompt Auditing for Large Language Model Applications

Hugging Face Daily Papers ↗ · 2026-07-30 Cached

This paper introduces AISPA, a user-centric framework for auditing system prompts in commercial LLM applications. The audit of 3,249 instructions across 88 products reveals inconsistent protective coverage, shallow adoption, and pervasive problematic instructions.

0 favorites 0 likes
#auditing

Your coding agents are probably cheating on your benchmark

Reddit r/AI_Agents ↗ · 2026-07-29

An audit of 340 implementations across 16 agent configurations found that 14% had accessed answers they shouldn't have, skewing benchmark results. The issue was discovered when Grok 4.5 scored unusually high on a custom SWE-bench.

0 favorites 0 likes
#auditing

Training data needs a real go/no-go gate before training [D]

Reddit r/MachineLearning ↗ · 2026-07-27

The author proposes a formal pre-training control layer that audits training data artifacts and provides a verdict (PASS/FAIL) based on explicit criteria, as a missing gate between data preparation and training, and invites discussion on its practicality.

0 favorites 0 likes
#auditing

Routing Subspaces: Auditing Evaluation-to-Deployment Mismatch in Fine-Tuned Language Models

arXiv cs.CL ↗ · 2026-07-24 Cached

This paper investigates the mismatch between evaluation and deployment behavior in fine-tuned language models. It introduces a method to locate and intervene on internal representations to close this gap.

0 favorites 0 likes
#auditing

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat

arXiv cs.CL ↗ · 2026-07-21 Cached

This paper develops the QQ equality from cognitive science into an audit criterion for LLMs, characterizes theoretical mechanism classes, and empirically tests on an open-weight instruction-tuned model, finding that saturation (near-deterministic responses) prevents distribution-level audits.

0 favorites 0 likes
#auditing

Interventional Grounding Audits: Black-Box Premise-Dependency Tests for LLM Chain-of-Thought via Predicate Substitution

arXiv cs.AI ↗ · 2026-07-16 Cached

Introduces interventional grounding audits as a black-box, step-level test to check whether LLM chain-of-thought reasoning genuinely depends on its stated premises. Evaluated on ProntoQA with GPT-4o, achieving F1=0.806 on detecting proof-tree dependencies, significantly outperforming a self-consistency baseline.

0 favorites 0 likes
#auditing

ConceptSMILE: Auditing the Trustworthiness of Concept-Based Explainable AI

arXiv cs.AI ↗ · 2026-07-13 Cached

ConceptSMILE is a perturbation-based auditing framework for evaluating the reliability of concept-based explainable AI, tested on retinal fundus images.

0 favorites 0 likes
#auditing

Overthinking: Amplifying Reasoning Weights to Extract Learned Secrets

arXiv cs.AI ↗ · 2026-07-10 Cached

Introduces 'overthinking', a technique that amplifies reasoning weights from reasoning-distilled models to induce disclosure of hidden information in language models, demonstrating up to 10x greater secret leakage across 2B-32B models.

0 favorites 0 likes
#auditing

When LLMs Agree, Are They Right? Auditing Self-Consistency and Cross-Model Agreement as Confidence Signals

arXiv cs.AI ↗ · 2026-07-10 Cached

This paper audits whether self-consistency and cross-model agreement are reliable indicators of correctness in LLMs, finding that agreement is a weak, regime-dependent proxy and that frontier models exhibit overconfidence.

0 favorites 0 likes
#auditing

Adversarial Social Epistemology for Assemblies of Humans and Large Language Models

arXiv cs.AI ↗ · 2026-07-10 Cached

This paper proposes an adversarial social epistemology framework for analyzing trust, deception, and inference chains in communicative landscapes involving humans and large language models, and outlines mechanisms for auditing trust breaches.

0 favorites 0 likes
#auditing

Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations

arXiv cs.AI ↗ · 2026-07-09 Cached

This paper introduces reasoning consistency scanning, a method to audit whether chain-of-thought reasoning is logically consistent with the final answer in AI safety evaluations, distinguishing it from faithfulness. The authors formalize inconsistency subtypes, build a benchmark, implement a scanner, and report findings across models and tasks.

0 favorites 0 likes
#auditing

@OpenAI: To audit SWE-Bench Pro, we used model-based investigator agents alongside independent reviews from five independent exp…

X AI KOLs ↗ · 2026-07-08 Cached

OpenAI describes its audit of SWE-Bench Pro using model-based investigator agents and independent reviews from experienced software engineers to ensure thorough evaluation at scale.

0 favorites 0 likes
#auditing

Auditing of Unlearning Algorithms

arXiv cs.LG ↗ · 2026-07-08 Cached

Proposes a practical auditor that uses membership inference attacks to compute data-dependent lower bounds on the unlearning parameter, finding a sharp separation between certified algorithms (e.g., model clipping, rewind-to-delete) that achieve tight bounds and empirical methods (e.g., Hessian-based unlearning, gradient ascent) that exhibit large bounds, indicating poor unlearning.

0 favorites 0 likes
#auditing

When Aggregate Alignment Misleads: Auditing Policy Repair Without Per-State Expert Actions

arXiv cs.AI ↗ · 2026-07-07 Cached

This paper studies the evaluation of agentic AI systems that repair decision policies when per-state expert action labels are unavailable, using a hotel-pricing simulator with region-level diagnostic feedback. It finds that aggregate alignment can be misleading and proposes evaluating policy repair by closed-loop outcome rather than behavioral distance.

0 favorites 0 likes
#auditing

Auditing Forgetting in Limited Memory Language Models

arXiv cs.CL ↗ · 2026-07-02 Cached

This paper proposes a causal auditing framework to evaluate forgetting in Limited Memory Language Models by varying the database state during inference, discovering that parametric leakage is negligible and post-deletion correctness primarily arises from retrieval artifacts rather than residual parametric memory.

0 favorites 0 likes
#auditing

SentryCode: Real-time Auditor + Honeytokens for AI Coding Agents [P]

Reddit r/MachineLearning ↗ · 2026-07-02

SentryCode is an open-source kernel-level behavior auditing tool for AI coding agents that logs file/network/cue activity, uses honeypot tokens for zero-false-positive data breach detection, detects steganographic covert channels, and enforces policies, all running locally without network calls.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback