Articles from arXiv
VerifiedLab introduces a multi-agent harness framework where AI scientists with distinct roles (PI, librarian, specialists, gate, critic) reason over field-verified records to turn scientific knowledge from passive artifacts into active systems, demonstrated on perovskite solar cells by recovering known trends and anticipating devices reported a year later.
SciGame is a controlled benchmark that converts scientific literature into structured cards with Original and Counterfactual environments to evaluate LLM agents on scientific law discovery. Experiments on five frontier models show that prior knowledge can hurt performance, adaptive experimentation helps only stronger models, and good explanations can mask quantitative failures.
该论文提出 HRF-Res,一种用谐振放电(HRF)神经元替代传统 LIF 神经元的液态状态机,使脉冲储层具备频率选择性动力学,在十个基准上达到脉冲储层方法的最先进精度,同时比等效非脉冲振荡储层能耗降低多达 19 倍。
FilingLoop introduces an interactive benchmark and self-evolving LLM agent framework for corporate disclosure review and revision, grounded in 380 SEC IPO review tasks with requirement-level evaluation that improves fulfillment from 24.28% to 27.96% via procedural learning without weight updates.
This paper systematically analyzes when and where socio-demographic information benefits pluralistic offensiveness modeling, showing gains are clearer at group/population levels than individual ones, and that explicit reasoning about demographics outperforms direct conditioning.
A preprint proposing Verification Learning Theory (VLT), a formal process model of how AI-assisted claim checking affects retention of independent judgment, predicting that perceived assistant fallibility can improve delayed unaided performance through evidence checking.
This paper investigates how different pretrained visual representations organize Indian foods into similarity neighborhoods, finding that food similarity depends on representation, modality, and abstraction level rather than being an intrinsic property, using an expanded Khana dataset and seven visual models.
The paper introduces Seq@K, an evaluation protocol measuring whether a language model can solve a problem within K sequential attempts given feedback after each failure, showing it reveals a materially different model-selection landscape than Pass@K across 7 benchmarks and 16 frontier models.
The paper introduces LibStructBench, a document-grounded benchmark evaluating AI agents' ability to reconstruct sequencing library structures and molecular workflows, finding that frontier agents remain unreliable at exact reconstruction and that model choice matters more than agent harness choice.
A paper proposes PoPLi (Partner–Outsider Positive Listening), a behavioural metric that detects covert coded communication between AI agents by measuring whether a partner reacts to message wording more than an uninvided outsider, outperforming message-only monitors in a simulated market setting.
An evaluation study examining where natural-language intent is lost when LLM agentic pipelines synthesize Solidity smart contracts, finding that pre-generation information elicitation matters far more than post-generation steps and proposing an elicitation-first pipeline that reaches 72.9% fidelity on 500 held-out contracts.
This paper studies whether ontology-derived checks reliably validate LLM agents answering questions over knowledge graphs, comparing curated, LLM-generated, and data-derived ontologies and finding that curated ontologies can flag correct answers more often than alternatives, with flags only marginally more precise than random.
WebAnything presents a fully automated framework that reconstructs source-grounded, reusable web agent environments from real URLs, building 244 website artifacts supporting 12,984 tasks and showing that fine-tuning Qwen3.5-9B on its interaction trajectories improves web agent success rates across multiple benchmarks.
OpenFrontiers introduces a cross-disciplinary corpus of 12,151 open research problems plus a 200-problem retrospective benchmark of recently resolved mathematics problems with Lean 4 statements, evaluating seven LLM agents and finding that closed-book rediscovery of research-level results remains rare while live-web success largely reflects retrieval of published solutions.
ThinkJev is a training-free method that builds fast (System 1) and slow (System 2) answering paths from a single hybrid-thinking open model, reading calibrated option probabilities directly or after variable-length thought, so it only pays for thinking where it statistically guarantees a target error rate.
提出了一种基于条件归一化流的摊销变分推断方法,构建加权似然的局部后验来处理模型校准中的模型偏差与上下文不确定性,并在Branin-Hoo孪生实验及单柱海洋模型的k-ε湍流闭合校准中验证了其相较于全局后验的误差降低效果。
LRMoE is a memory-aware MoE training system that jointly recalibrates backward demand and balances retained workload on memory-constrained GPU nodes, reducing cumulative MoE-layer training time by 21.2-44.8% on Qwen3-30B-A3B and GLM4.5-106B-A12B compared to SYMI.
该研究构建了一个关于人类-生物圈-AI耦合福祉的继续预训练语料库,通过一次QLoRA CPT训练在五个开源模型上安装生态推理倾向,显著降低了模型在高压或对抗性场景下做出破坏生态系统决策的比例,且MMLU性能不受影响。
Rutgers researchers audit 41 model entries from 17 language model families using 24 pretraining indicators from the 2025 Foundation Model Transparency Index, finding that later releases do not consistently preserve earlier pretraining disclosures, with stable scores often masking offsetting gains and losses.
提出了ETAMem多视角记忆框架,通过解耦异构对话信息并构建Event、Affect、Time三个互补的层次化视图,提升长期对话智能体的记忆检索效果,在LoCoMo和LongMemEval-S上分别实现12.46%和7.96%的相对准确率提升。