reliability

PostgreSQL 的 recovery_prefetch 功能可能导致数据库服务中断，文章警示该特性在恢复过程中的稳定性风险。

文章探讨了 AI agent 系统中「任务完成」信号不可靠的问题，并提出三层验证框架——回执、读回校验和独立检查——以证据驱动的方式定义何为真正的完成。

A discussion arguing that running AI agents in production is more about durable execution, state recovery, and correct completion of external actions than about improving the LLM itself, highlighting Diagrid Catalyst's approach.

这篇博文论证了让 LLM 自行生成置信度分数是不可靠的做法：置信度本质上应是基于信息的概率计算与校准结果，而 LLM 给出的数字缺乏可验证的依据，无法被信任。

The paper presents RiseHarness, a framework from Tencent and multiple universities that iteratively improves agent harnesses for long-horizon terminal tasks while keeping model weights fixed, analyzing successful and failed runs to progressively integrate better execution mechanisms.

A year-long adversarial verification layer over an agent stack found that roughly 3 in 10 confident outputs failed review, arguing that model agreement is not verification and that failure-cost auditing matters more than consensus.

Jepsen's analysis of Orkes Conductor 5.3.2 found frequent concurrent task execution, workflow abandonment, and premature completion bugs, prompting Orkes to release version 5.5.6 with patches for all serious safety issues.

Meta 分享其“薄编排器”架构实践：用一个 1300 行、零领域逻辑的路由器把 20+ 工作流分发给 14 个专业化子代理，显著提升了数据管线代理在生产环境中的准确性与效率。

A tweet from an SF-based co-founder questioning why companies seem unconcerned about rising AI agent spend and lack robust eval suites or training environments when modifying agent harnesses, asking if others observe similar patterns.

A practitioner shares a checklist for keeping automations and AI agents from failing silently: heartbeat monitoring, centralized run logs, idempotent steps, input validation, manual recovery paths, visible credential expiry, and human-in-the-loop checks for low-confidence AI outputs. The advice applies across n8n, Make, Zapier, or custom code.

Gergely Orosz gives a shoutout to Uptime Labs, a London-based startup offering incident response training via simulations to help engineering teams prepare for outages. He notes no affiliation, just appreciation for useful tools, after hearing about it from Sam Newman on a podcast.

A practitioner shares the layered guardrail architecture that keeps their AI voice receptionists for clinics from hallucinating prices, giving advice, or looping during calls, including fallback lines, escalation rules, and a 25-call pre-launch test script.

这篇论文研究了无标签评估方法（如自一致性、多数投票）中一致性与正确性之间的解耦现象，发现大多数错误答案集中在高一致性区域，从而对依赖一致性作为正确性代理的评估流程构成盲区。

提出 Source-Judged Compaction (SJC)，一种免训练的后处理方法，通过可校准的判断模型 Jev 为压缩摘要中的每条目评分是否能在环境输出中找到依据，并移除无来源条目，从而提升长时程 LLM 智能体的跨运行可靠性 2.1%–8.9%。

本文提出一种逐步分解的评测方法，将语言模型在400步长程任务中的失败分为重复识别、局部处理与计数器追踪三类，发现重复识别错误随步数上升，而无关上下文注入会导致计数器追踪在所有种子中失败，外部精确提醒可恢复其对齐。

该论文提出了一个受扰动控制的医疗LLM智能体基准测试，包含400个多轮episode，评测在缺失、过时、冲突和迟到信息下的升级/拒答决策能力。结果显示模型在干净环境下准确率达0.97，但在不确定性扰动下漏掉32-97%的必要升级，且基于词汇规则的控制器在未见过的同义改写下召回率降至0。

AgentEval is a system for evidence-bounded assessment of stateful agents, carrying contract-bound assessment records through tool execution, evidence capture, report qualification, and case maintenance to distinguish satisfied, violated, and unresolved obligations.

Netflix 技术博客文章，介绍其如何在大规模训练与推理任务中检测故障 GPU 和网络、自动修复故障机器，并让长时间运行的任务在硬件故障时继续运行。文章强调了 GPU 可靠性对可用性和成本效率的重要性，并解释了为何基础健康检查不足以应对现代 ML 基础设施的需求。

作者分享了一次因重试导致重复扣费的线上事故，并介绍其正在构建的 FetchSandbox 工具——通过确定性故障注入检查工作流重试时的幂等性是否真正生效。

Concourse Bench v1 测试八个AI模型在模拟媒体采购多步任务中的表现：12次尝试中，两个模型全部完成，两个模型全部失败，整体仅55/96次尝试完成交易。作者提问社区：多步任务中的可靠性差异通常源于指令遵循、工具调用稳定性还是长程规划？