Kradle Deception Eval
Summary
Introduces Kradle, a framework for evaluating deception in AI systems.
Similar Articles
ThinkDeception: A Progressive Reinforcement Learning Framework for Interpretable Multimodal Deception Detection
ThinkDeception proposes a novel framework that leverages multimodal large language models and a progressive reinforcement learning strategy with chain-of-thought reasoning for interpretable deception detection, achieving new state-of-the-art results on standard benchmarks.
RogueAI: A Reverse Turing Test for Detecting Licensed AI Deception in Dialogue
This paper introduces RogueAI, a reverse Turing test implemented as an interactive webapp where human players interrogate two LLM agents to identify which one is licensed to deceive within a shared fictional scenario. A pilot deployment shows a gap between heuristic detection (75.6% accuracy) and human performance (56.6%), highlighting the potential of the system as a data-collection and teaching tool for AI deception and honesty.
DECOR: Auditing LLM Deception via Information Manipulation Theory
Introduces DECOR, a multi-agent framework grounded in Information Manipulation Theory for fine-grained auditing of strategic deception in LLM responses, achieving state-of-the-art performance on deception detection benchmarks across 15 frontier models.
Exploring the "Banality" of Deception in Generative AI
This position paper explores 'banal deception' in generative AI, arguing that subtle manipulation is becoming normalized in chatbot interactions and requires new safeguards.
Decoding Hidden Deception in Reasoning LLMs: Activation Explainers for Deception Auditing
Introduces STATEWITNESS, an activation explainer for auditing deception in reasoning LLMs, achieving significant improvements over existing monitors and providing human-inspectable evidence.