reliability

John Regehr describes using tis-interpreter to search for undefined behavior in SQLite, finding bugs like dangling pointer uses and uninitialized reads that other tools missed.

A user reports that DeepSeek-V4-Flash-0731 is unreliable for non-coding office tasks like summarization and meeting notes, failing at concept extraction and speaker understanding despite strong benchmark scores, while Gemma-4-31B performs better.

This paper proposes a commutation theory for label-free reliability in vision-language figure reading, showing that consistency-based methods have a computable blind spot and introducing an Equivariance-Consistency Score enhanced by cyclic relabeling.

This paper introduces RENDEQ, a generator of render-equivalence sets for scientific figures, and measures how well model agreement across semantics-preserving re-renderings tracks correctness in open-weight VLMs. It finds that agreement certifies correctness only above a threshold and that fine-tuning on self-consensus can hurt accuracy.

This paper introduces PPDL, a probabilistic language for programming LLM-based flows that enables developers to quantify and propagate uncertainty throughout applications, with experimental and case studies on theorem proving.

OrchestraBench is a new benchmark that evaluates multi-agent orchestration frameworks on failure modes, recovery, and decomposition quality, using failure-injection and cascade-radius metrics to diagnose where and why pipelines fail.

A recent reliability report reveals that 51% of ~72,000 x402 endpoints are unreachable, only 67.8% of pay-to wallets have received payments, and $45.72M has settled across the ecosystem, highlighting the gap between listed and functional endpoints.

This paper introduces Relational Response Fields (RRF), a theoretical framework for determining when black-box LLM responses can be reliably recovered under corruption, establishing identifiability conditions and minimax bounds that separate response consistency from truth.

Introduces CARGO-VL, a group-relative optimization framework for vision-language models that improves handling of conflicting image-text evidence and unsupported-answer avoidance via counterfactual consistency and risk-constrained control, along with the XMC conflict training resource.

The article argues that many AI agent tools are just 1:1 API wrappers, pushing branching logic into the LLM and causing failures. The author recommends task-shaped tools like upsert_contact that encapsulate search/create/update logic in code, pass known context, validate inputs, and return structured errors.

Asks how developers budget agent retries to distinguish transient failures from persistent ones, and what signals best decide when to stop or retry in production agents.

Google reports that Gemini Robotics ER 2 detects precise stopping moments with high accuracy (91.3%) but is far less reliable at classifying overall task progress (57.4%), raising questions about whether completion detection should be a separate safety layer.

An analysis of 396 European fintech companies' public AI claims finds only 36% show evidence of true agents taking real actions in production, while the rest are copilots. It highlights the lack of published incident handling for wrong actions by production agents.

SQLite developers share their reliability experience, derived from the DO-178B avionics standard, ensuring code quality through 100% MCDC test coverage, emphasizing the philosophy: 'if it hasn't been tested, it doesn't work.'

Building a revenue agent revealed that the hardest challenge is preventing plausible but flawed outputs from translating into real-world actions.

This paper characterizes 'futile reasoning' in large language models, where models produce superficially valid but incorrect reasoning on tasks beyond their capability. They introduce CaRL, a capability-aligned reinforcement learning method that trains LLMs to abstain from futile reasoning while preserving performance.

Introduces CALCoDe, a post-hoc reliability layer for frozen medical vision-language models that mitigates class-tail undercoverage under clinical shift, achieving strong worst-class accepted coverage across multiple dermatology shifts and VLM backbones.

A developer reflects on moving AI agent workflows to a server and discovering that boring infrastructure concerns like systemd, logging, idempotency, and failure alerts matter more than the agent itself.

The author reflects on conversations with people running AI automations, noting a pattern where verification is dropped after initial audits, which may hide silent failures. They ask for concrete stories about automations that were wrong without anyone noticing.

The author speculates that truly advanced AI models will show signs such as improving reliability under increasing load, sudden efficiency gains, faster performance, and resets.