Articles from arXiv
StrictPRMBench introduces a replayable benchmark for auditing how fixed-score PRM aggregation rules (product vs. geometric mean) affect best-of-N selection, showing product yields higher deletion-induced selection instability across 14 cells with reproducible reanalysis artifacts.
The paper presents PIFT, a framework that transfers peptide–target interaction patterns to small-molecule generation via joint sampling-time guidance of masked discrete diffusion and flow matching, targeting challenging protein-protein interaction interfaces with strong docking results.
rl_rob is an open-source, from-scratch Python library for teaching reinforcement learning, covering tabular TD methods through linear function approximation to deep value-based and policy-gradient methods with transparent, few-line update rules and a unified agent interface.
SPT-Flow 提出一种连续时间世界模型的训练方法:每条轨迹采样一个隐变量,并将自由运行的 ODE 展开与多个读出时刻的演示状态对齐,从而克服监督捷径问题。在 LIBERO 上,该方法相对 ODEWorld 基线在中段与最终帧的 best-of-10 PSNR 分别提升 2.0 和 2.4 dB,平均 LPIPS 降低 23%。
A unified framework for estimating the probability of data-dependent events, covering missing mass, adaptive data analysis, and test-error estimation, with new hybrid Good–Turing style estimators and bounds based on VC dimension and mutual information.
The paper introduces a divergence-kernel method for jointly training neural SDE drift and diffusion fields with losses that depend directly on the terminal density, achieving fewer off-mode samples than score-based generators on Gaussian-mixture benchmarks with time-independent fields.
The paper proposes Corroborative Learning (CL), a method where independently trained models mutually enhance each other via source-excluded reconstruction of task-response increments from collaborator representations, avoiding direct output or feature matching. Evaluated across six language tasks with 24 models and 36 pairs, CL consistently improves over capacity-matched independent adaptation and existing transfer/mutual-learning methods.
This paper proposes a realizability theory for length generalization in a controlled single-head attention setting, deriving via a simulation transfer operator why relative and absolute positional encodings differ in extrapolation behavior, with experiments on 2625 trained models confirming the structure.
The paper introduces a controlled evaluation framework separating unique class support from representation allocation to determine when encoder adaptation remains worthwhile after classifier correction in long-tailed recognition, showing benchmark construction alone can flip this training decision.
The paper proposes Role-Aware Server Optimization (RASO), a method that coordinates contributor selection with role-specific server momentum updates to improve multimodal federated learning when some modalities are missing, demonstrating effectiveness across datasets and fusion architectures.
The paper proves a general frequency principle for finite linear approximation classes under gradient descent, showing high-frequency amplitudes vanish uniformly during training and establishing sufficient conditions for low-frequency priority, validated numerically with Legendre and trigonometric bases.
The paper proposes CAP (Candidate Acquisition Policy), a method that learns a feedback-conditioned query policy from sparse records of related black-box optimization tasks, achieving the best final-budget results on four synthetic families and two engineering benchmarks (BOPTEST, SU2).
Microsoft AI introduces TalentRL, a strategy-guided reinforcement learning framework for hierarchical routing over procedural memory in LLM agents, where coarse-grained 'talents' guide selection of fine-grained skills. It improves success rates across seven QA benchmarks and achieves 99.3% on ALFWorld and 90.7 on WebShop across Qwen and Llama backbones.
The paper proposes Muon-RT, a momentum-free variant of the Muon optimizer that reuses the EMA teacher-student weight displacement in LLM self-distillation, eliminating separate momentum buffers while improving accuracy and reducing persistent training memory on Qwen2.5-7B and Olmo-3-7B.
该论文研究随机舍入(stochastic rounding)如何影响低精度训练中的预测风险,针对两层线性网络推导了匹配的上下界,并给出了随计算量、模型规模、训练时长与精度变化的 scaling laws,揭示前向与后向舍入对最优计算缩放的不同影响。
该论文发现RL后训练中fp32主权重经bf16四舍五入导出时,大多数小于半个bf16间隔的策略更新被静默丢弃,使采样器落后优化器50-150步;作者提出仅需一行代码的Fair Cast(随机舍入/误差反馈),在Qwen3-0.6B到4B的25组配对实验中平均提升6.1分。
The paper develops a degree-resolved analysis of nonlinear interactions between irreducible representations in graph neural networks, introducing Specht Triple, a residual architecture for unordered graph triples that cuts test MSE by 11.05% over a parameter-matched control on a synthetic benchmark with a frozen GIN backbone.
An academic paper proposing correlated private quantization for communication-efficient, locally differentially private federated reinforcement learning in vehicular networks, coupled with post-quantum authentication; it reports 92.4% smaller authenticated uplink sizes and 14.3% lower mean travel time versus independent quantization.
The paper introduces CUTTIE, a hierarchical testing method that clusters a trained network's units into a tree and tests them top-down with conditional independence tests to localize predictive concepts (e.g., regulatory DNA motifs) while controlling the family-wise error rate, demonstrating it on a model predicting chromatin accessibility from sequence.
The paper frames continual reinforcement learning with a contextual MDP that splits context into behavioral and physical components, and studies zero-shot reuse of world models in FourRooms tasks with Dyna-Q and TD-MPC, finding that physical-context changes substantially degrade reuse depending on the observation representation. It identifies representation generalization as a key bottleneck for reliable world-model reuse in continual RL.