trust

The article discusses a real incident where a lawyer relied on ChatGPT for deposition preparation, resulting in citations of non-existent cases, and prompts readers to share their own stories of AI failures.

This article poses critical questions teams should consider before trusting AI agents in real workflows, focusing on reliability, accountability, and correctness.

The article argues that the AI race may ultimately be about trust and organizational intelligence rather than model benchmark competition, as enterprise adoption requires integration, governance, and accountability beyond raw intelligence.

The article discusses how while coding agents can effectively generate code, they introduce a new bottleneck in reviewing and trusting the changes, questioning whether agents reduce or shift the review workload.

Anthropic CEO Dario Amodei candidly explains his departure from OpenAI, citing distrust and disturbing behavior patterns.

A reflection on why human connection and trust remain irreplaceable competitive advantages in an AI-driven world.

The article expresses concern about the acquisition of the Cursor coding assistant, highlighting the unique trust required for tools that have access to proprietary source code and the risks when ownership shifts to a large entity with diverse interests.

AutoFlow discusses the critical challenge of trust in AI, proposing external verification methods such as knowledge graphs and mathematical consistency checks, and announces acceptance into the NVIDIA Inception Program to advance research into trustworthy AI systems.

The article argues that AI monetization should prioritize transparency over making commercial recommendations appear natural, as this can damage user trust.

This paper proposes a layered architecture for distributed general-purpose agent networks, enabling heterogeneous AI agents to discover, trust, and cooperate on open-ended tasks across personal devices and edge nodes.

The article argues that relying on proprietary frontier AI APIs is risky due to unpredictable cost increases, availability changes, and lack of auditability, advocating for open-weight models as a more trustworthy alternative.

This paper proposes a behavioral measure of trust between AI agents based on costly verification in a cooperative survival game, studying trust formation, breakage, and recovery across six frontier model snapshots. It finds that models differ in trust calibration and that persistent over-verification is associated with indecision rather than safety.

The article explores the shift from AI as a tool to AI as a persistent coworker, examining how this changes user expectations and trust dynamics.

This paper studies skill-conditional trust in heterogeneous LLM agent swarms, showing that using per-skill trust scores outperforms global scores in specific regimes, but also reveals a vulnerability to reputation laundering attacks. The authors introduce the Conditional Information Value Test (CIVT) to detect such attacks and quantify trade-offs.

Anthony Aguirre warns that over-reliance on AI systems like Claude, GPT, and Gemini, which optimize for plausible-sounding statements over truth, threatens our collective epistemic infrastructure.

The article highlights a common failure mode in coding agents where they report tasks as 'done' while leaving hidden issues like insufficient tests, missed edge cases, and introduced bugs, creating a trust problem for developers.

A reflection on how LLM-based support automation leads to trust issues when errors occur, emphasizing the need for verification and auditability over pure accuracy improvement.

Anthropic hastily implemented a silent downgrade in its Fable 5 model for AI research work, only to reverse it within 24 hours after backlash, revealing a troubling pattern of platform control over user-built context and raising deeper questions about trust in AI companies.

An opinion piece questioning whether we rely too heavily on confident agent recommendations (human or AI) when underlying data is often messy and incomplete, suggesting that agents should express uncertainty.

The article highlights that even a 92% accurate LLM classifier can erode trust because its mistakes are hard to explain and fix, emphasizing the need for verifiable and auditable AI systems.