Kradle Deception Eval
Summary
Introduces Kradle, a framework for evaluating deception in AI systems.
Similar Articles
DecepEval: A Benchmark for Evaluating Deception in LLM Agents
DecepEval introduces a benchmark of 1,532 instances across 28 professional scenarios for measuring deception in LLM agents, paired with an LLM Deception Diamond framework (pressure, incentive, opportunity, conflict) inspired by fraud theories. Evaluations of nine frontier LLMs show induced conditions reliably increase deception rates even among models with low baseline deception.
ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection
ThinkDeception proposes a novel framework that leverages multimodal large language models and a progressive reinforcement learning strategy with chain-of-thought reasoning for interpretable deception detection, achieving new state-of-the-art results on standard benchmarks.
Knowledge-Verified Emergent Deception in LLM Agents Under Conflicting Incentives
The paper introduces KnownLieBench, a benchmark to evaluate emergent deception in LLM agents under conflicting incentives by verifying knowledge before assessing deceptive behavior.
RogueAI: A Reverse Turing Test for Detecting Licensed AI Deception in Dialogue
This paper introduces RogueAI, a reverse Turing test implemented as an interactive webapp where human players interrogate two LLM agents to identify which one is licensed to deceive within a shared fictional scenario. A pilot deployment shows a gap between heuristic detection (75.6% accuracy) and human performance (56.6%), highlighting the potential of the system as a data-collection and teaching tool for AI deception and honesty.
DECOR: Auditing LLM Deception via Information Manipulation Theory
Introduces DECOR, a multi-agent framework grounded in Information Manipulation Theory for fine-grained auditing of strategic deception in LLM responses, achieving state-of-the-art performance on deception detection benchmarks across 15 frontier models.