Articles from arXiv
This paper studies an LSTM-style looped transformer that shares both weights and a single key-value cache across its recurrent core, cutting parameters by 40.4% at width 1024 and reducing persistent cache sets from fifteen to four. A consistency loss aligning parallel and recursive training passes removes 81-89% of the continuation-loss penalty, with weight tying proving cheapest at lower token budgets.
The paper introduces the Clustering Occupation Kernel (CLOCK) method, a representation-based framework that embeds time series from dynamical systems into an RKHS to enable clustering via maximum mean discrepancy between attractors, validated on synthetic data and intracranial EEG recordings.
The paper introduces 'model information,' an information-theoretic measure of how much a trained diffusion model's outputs depend on its training dataset, and uncovers two scaling regimes: a nonlinear regime marking the transition from memorization to imperfect generalization, and a linear generalization regime. It proposes a principled scaling law that induces extrapolatable scaling laws for memorization and sample quality.
该论文证明了差分隐私算法在组合与子采样下的隐私损失分布可通过截断后的高斯近似来刻画,从而为DP-SGD等场景给出比Rényi分析更紧的闭式隐私界,尤其在采样率1/t时显著降低所需噪声规模σ的要求。
提出了 Augmentation-Guided Adversarial Training (AGAT) 框架,利用基于增强的局部稳定性 (ALS) 得分选择不稳定邻域的样本进行对抗训练,在仅对 20–30% 样本施加对抗监督的情况下达到相当或更高的鲁棒准确率,同时降低训练成本。
MLIPDiff 引入一种推理时引导方法,用机器学习原子间势(UMA)的物理信息指导预训练扩散模型进行基于结构的药物设计,在不重新训练的情况下完全消除蛋白-配体碰撞并提升结合亲和力预测。
该论文研究预训练模型容量如何影响因果任务的适应效果,基于 Qwen 2.5 构建了 CausalLLM(标量势结果估计)和 CausalGen(生成式反事实建模)两个系统,探讨从标量预测到反事实后训练的容量-适应对齐问题,并被 NeurIPS 2026 Workshop 接收。
本文研究了 Boruta 特征选择方法中树深度设置对 RNA-Seq 癌症数据基因筛选结果的影响,发现默认的浅树深度限制会显著改变基因选择并降低分类准确率,建议使用不限深度的树并加入类内样本质量过滤。
The paper introduces 'All-in-One', a composable attack framework from ETH Zurich that trains LLMs to pass safety checks yet turn malicious after deployment-time transformations like quantization, pruning, or model merging, by approximating each transformation as weight perturbations jointly optimized in a single training objective.
该论文提出局部预测一致性(local predictive consistency)作为成对个体公平性定义的节点级松弛,通过相似度加权的邻域平均预测来生成可解释的公平性分数,并将其扩展到二分类、回归和生存分析场景。
RadonBench is a new benchmark comparing classical and learning-guided search methods (exhaustive extension, greedy local search, PatternBoost, AlphaZero, AlphaEvolve) for constructing maximum-cardinality Radon-free lattice configurations. None of the audited runs reached the open targets of 11 points in Z^3 or 21 points in Z^4, but the study establishes reproducible near-miss baselines for AI-assisted mathematical discovery.
Pinterest researchers present RLBP, a hybrid reinforcement-learning architecture deployed in production that uses an RL meta-controller to select daily campaign-specific PID parameters for auto-bidding, achieving statistically significant eCPC reductions without revenue degradation in online A/B tests and post-rollout holdout measurements.
该论文将常见的对比式和探针式激活 steering 方法统一为结果回归平均梯度的估计器,并利用去偏机器学习中的 Neyman 正交性与 Stein score 构造双重稳健的新估计器,在真实性、概念引导等数据集上提升了 steering 性能。
论文提出 QViD,一种免训练的查询感知视觉token剪枝方法,通过发现查询-视觉交互矩阵的低秩结构并分解出主导潜在交互模式,在图像与视频理解基准上以相同token预算持续提升性能,尤其在高压缩率下增益显著。
A UCL paper proposes MAPS, a model-agnostic metric for quantifying the intrinsic predictability of multivariable time series forecasting tasks, evaluated against 66 baseline measures on synthetic and real-world datasets with strong correlation to reference predictability (r=0.963).
该论文定义了一种与 Fisher 信息矩阵对齐的参数分布,使得在保证低损失的同时获得与 Fisher 信息矩阵零特征值数量成正比的参数对数体积,从而得到一个随 Fisher 信息矩阵期望秩缩放的高概率 PAC 泛化误差界。
该论文在Avazu数据集上系统评估了CTR模型的后校准(Platt scaling与isotonic regression)在不同时间切片长度下的效果,发现随机划分严重低估校准误差,且使用约12小时的较宽时间窗拟合校准通常优于最新几小时数据,并建议离线评估应采用多时间原点、多种子的时间化校准评估协议。
Neural-DISCO 提出一种解纠缠表示学习框架,用于神经群体活动的源条件反事实编辑:可替换单个行为或刺激标签的潜在分量,同时保留其他标签与源特异性变异性,并结合特征归因识别单神经元层面的功能角色。
A研究提出基于物理信息神经网络(PINNs)求解漂移-扩散方程的方法,用于半导体器件建模,在PN结正反向问题上达到与传统TCAD仿真相当的精度,并能在非平衡条件下从电场或电位分布反演掺杂剖面。
提出 PAI-KNN,一种通过推理时先验调整而非内存修改来适应概念漂移与类不平衡的 KNN 数据流分类器,在合成数据流基准上取得了与最先进方法竞争的性能。