Tag
Jepsen 的这份分析报告测试了面向 AI 工作负载的多模型数据库 ParticleDB(1.1.4 至 1.1.18.11.rc-22),发现其宣称的"完全 ACID"并不成立,共报告 96 个问题,包括崩溃、死锁、数据丢失及各类一致性异常,最新的 1.1.19-rc.13 声称已修复全部问题。
IBM researchers formalize LLM consistency as scoped semantic invariance over knowledge-graph-defined semantic domains, showing inconsistencies cluster in stable hotspot subgraphs and that selective, layered KG grounding improves cross-model agreement and reliability.
该论文提出了 Recursive Semantic Divergence (RSD),一种基于强化学习双模拟度量的无监督轨迹级一致性指标,用于衡量 LLM 智能体在相同状态下多次独立执行时的行为差异;将其作为奖励信号进行微调可显著降低任务进展方差并提升性能。
本文提出 VMem-Bench,一个两阶段诊断基准,系统研究长视频生成中视觉记忆(检索历史画面)对历史一致性与当前故事准确性的权衡影响,发现检索虽提升实体召回率却降低了精确度与禁用实体规避能力。
这篇论文研究了无标签评估方法(如自一致性、多数投票)中一致性与正确性之间的解耦现象,发现大多数错误答案集中在高一致性区域,从而对依赖一致性作为正确性代理的评估流程构成盲区。
一篇关于分布式系统一致性的技术博客,指出一致性并非单个组件的局部属性,即使 Apache Kafka 花费数年实现 exactly-once 语义,仍需要应用端到端设计和专人对整体属性负责。
This paper identifies a 'detectability gap' in hallucination detection: hallucinations split into high-agreement (Ghost) and low-agreement (Flickering) regimes with a 0.35–0.46 AUC gap, persisting across four models and three factual QA datasets even after freezing regime assignments and using stricter trajectory-based tests. The authors argue aggregate detection metrics hide model-dependent heterogeneity and call for regime-conditioned evaluation.
The article discusses a consistency issue in Shopify's WebMCP checkout rollout where structured tool responses can drift from the visible UI, proposing that agents verify user-visible invariants before submission.
The Qwen Image 2.1 Consistency LoRA is a tool that maintains image consistency during edits, preventing drift and unwanted repaints in AI image generation workflows.
This article addresses the consistency problem in AI agents, where tasks may fail on repeated attempts, and introduces ALTK-Evolve's Consistency Analyzer to diagnose and improve reliability, reducing the consistency gap from 24.4pp to 12.0pp without losing average accuracy.
MovieGrid is a multi-grid post-training paradigm that decomposes long videos into spatially arranged chunks to improve multi-shot coherence and efficiency, achieving state-of-the-art intra-shot and inter-shot consistency in video generation.
This paper introduces Prefix-Denoising Consistency (PDC), a test-time verification method for Diffusion Language Models that improves performance on reasoning tasks by using prefix-conditioned regeneration and majority voting.
The article discusses advancements in AI video generation with Wan 3.0 on Magnific, highlighting the ability to maintain consistency across ages and scenes in long-form stories.
AI video technology is evolving from generating clips to enabling full scene direction, which could reduce the cost of consistency in film production and empower small teams to create complete productions.
This paper introduces Cross-Contextual Consistency (C3), a behavioral property for measuring LLM credibility by checking whether answers remain stable under topic-aligned, content-neutral perturbations. Across 26 models and six benchmarks, they find that higher consistency correlates with correctness, offering a complementary evaluation axis.
The article introduces Revision Prompting, a technique for industrial LLM processes that improves speed, cost, and consistency when re-processing updated inputs by generating output patches from diffs.
This paper investigates whether tabular foundation models (TFMs) like TabPFN, TabICL, TabDPT, and TabFM produce predictions consistent with any joint distribution. It demonstrates that all evaluated TFMs violate both marginalization and factorization consistency for classification and regression, questioning their Bayesian inference claims.
SEAM is a generator-agnostic framework that audits global consistency of explanations in scientific machine learning, detecting incompatible local explanations even when predictions are locally accurate and attributing failures to specific channels and overlaps. The paper presents theory and experiments across PDE systems, neural operators, and four open datasets.
This paper proposes a commutation theory for label-free reliability in vision-language figure reading, showing that consistency-based methods have a computable blind spot and introducing an Equivariance-Consistency Score enhanced by cyclic relabeling.
This paper investigates how training-free acceleration can silently change generated content in diffusion-based multimodal large language models, and proposes paired diagnostics and consistency-control methods to mitigate content drift.