Articles from arXiv
Rubricon is a pipeline from Handshake AI that automatically generates and refines discriminative rubrics for LLM evaluation and post-training without human labels or fine-tuning, achieving 9% better alignment with expert rubrics than prior synthetic methods and 4.5% better HealthBench performance when training Qwen3.5-9B.
This paper introduces the concept of 'disparity laundering,' showing that clinical multi-agent LLM teams do not eliminate demographic bias but instead carry it through into consensus decisions, with interventions only working when counterfactual versions are made visible and pooled during deliberation.
GAAC is a lossless KV cache compression and serving system that exploits BF16 exponent redundancy with group-adaptive codes and a fused attention kernel, achieving ~1.4x KV compression and 1.04-1.27x speedups on NVIDIA DGX Spark and Apple M4 without approximating KV values.
Tsinghua University researchers propose a Bounded Dual-Loop Automated Schematic Synthesis Framework that converts natural language specifications into verified KiCad schematics for power electronics, boosting component verification coverage from 22.2% to 98.6% and SPICE pass rates from 0% to 100% versus a vanilla LLM baseline.
论文提出 Bottle-SPU(Bottle-SKU)大规模多SKU洗发水瓶表面缺陷检测基准,包含13,119张图像与20,419个实例级标注框,并提出原型引导的动态域调制方法 ProDMM,通过SKU视觉原型生成低秩Query/Value调制以提升跨产品变体的缺陷检测泛化能力。
论文提出 DecompGym 基准,包含来自九类问题族的 81 个实例,用于评估 12 个 GPT、Claude、Gemini 编码智能体设计与实现 Benders 分解和列生成求解器的能力,并比较了独立重生成与反思两种失败修复策略的效果。
BridgeRouter 将多桥跨模态迁移建模为实例级算法选择问题,通过增益感知的轻量路由器在冻结的 EEG 基础模型桥路径间进行推理时路由,在 FOG 和 ISRUC 数据集上显著优于单一最佳桥路径。
SkillCT 提出一个多维度智能体技能评估基准,从静态规范、动态行为稳健性与人工辅助三个层面覆盖九个评估维度,并提出无需执行的质量评估基线,可降低评测成本并提升下游任务成功率。
A paper arguing that instead of expanding models to handle hard tasks, developers should decompose them by extracting deterministic sub-tasks to a host, leaving only a small generative core to the model — demonstrating 'parity by construction' where model size no longer affects performance on extracted sub-tasks across nine models.
IBM Research introduces LLMON (LLM Object Notation), a post-training methodology that separates executable instructions from passive data, reducing prompt-injection attack success rates from 53-100% to 0.02-5.6% when fine-tuning Granite-4.1 models while preserving general capabilities.
论文提出 ProACT,一个性能驱动的自适应 VR 消防训练系统,通过闭环调节火灾蔓延动力学与物体可燃性来动态调整训练难度,实验表明其在客观训练效果和主观体验上均优于基线方法。
该论文提出一个将强化学习代理集成到 FlexSim 数字孪生环境中的框架,用于仓库产品动态上架优化,实验显示拣选时间减少 29.66%、吞吐量提升 35.42%、搬运距离下降 18.54%。
The paper critically examines CLadder, a popular benchmark for evaluating causal reasoning in LLMs, revealing that it embeds superficial, highly predictive patterns. Simple models like random forests perform well on its generated datasets, and commercial LLMs' performance is brittle, suggesting their strong results come from exploiting shortcuts rather than genuine causal reasoning.
PromptSense proposes a sentiment- and depression-aware framework that dynamically constructs prompts with a rule-based filtering mechanism to improve empathy, relevance, and safety in LLM-based mental health chatbots, outperforming DSFT and RLAIF in evaluations.
Researchers from Los Alamos National Laboratory and NVIDIA present an expert-curated benchmark of 250 questions on inertial confinement fusion to evaluate LLMs' scientific fluency, physical reasoning, and quantitative analysis. They compare frontier open/closed models with Prospero, a domain-specialized model, finding that specialization improves scores but critical physics errors persist, and recommend assessing existing capabilities and retrieval benefits before investing in further specialization.
A survey and interview study of healthcare professionals examining how job roles and perspectives shape views on algorithmic bias causes, fairness criteria, and bias mitigation in healthcare ML systems, finding significant variation across clinical and administrative roles.
GAUSS 是一个工作负载感知的分析与蒙特卡洛模拟器,可预测 LLM 推理服务中 TTFT 和 TBT 的完整延迟分布及可持续请求速率,支持对未部署的工作负载、路由策略和硬件进行容量规划与尾延迟分析。
SkillMem introduces a compact external latent memory for reusable skills in latent multi-agent reasoning, achieving 38× storage reduction and up to 4.23× inference speedup across benchmarks with Qwen3 models from 4B to 14B.
The paper studies LLMs as numerical optimizers, finding they can capture problem structure and produce near-optimal solutions, but reliability degrades with problem dimension—improved via iterative refinement—motivating hybrid LLM plus deterministic solver approaches.
GARDEN 提出一种由 LLM 自动设计并可跨场景复用的奖励函数框架,用于协作多智能体强化学习,在 Overcooked 与 SMAX 基准上显著优于默认奖励和 Eureka 式反思方法。