arXiv

Articles from arXiv

Cards List

Omniprediction for All Mixable Proper Losses and Beyond

arXiv cs.LG ↗ · 2026-11-02 Cached

该论文研究了在无限混合可适当损失(mixable proper losses)类别下的 omniprediction 问题,证明了对所有有界适当损失无法实现次线性遗憾,但给出了对所有混合可适当损失的最优 O~(T^{1/3}(log|F|)^{2/3}) 遗憾界,并提出了一种同时兼顾有限损失类别的 best-of-all-worlds 算法。

0 favorites 0 likes

Density-Guided Bootstrap Boundaries for Latent World-Model Reinforcement Learning

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper introduces density-guided bootstrap boundaries, an adaptive mechanism for controlling imagined-return depth in latent world-model RL, proving contraction of the gated Bellman operator and showing improved sample efficiency within DreamerV3 across continuous-control and Atari tasks.

0 favorites 0 likes

Do Language Models Know What Compelling Scientific Evidence Looks Like?

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper introduces EDB-Bio, a 96k-episode benchmark for scientific evidence deliberation across three biological domains, showing that frontier and open-weight models are systematically underconfidence-prone (Brier scores near a trivial base-rate forecaster) and that post-training with proper scoring rules improves calibration, yielding an Ibis0 model 2.5× more efficient than the best frontier model in sequential experiment selection.

0 favorites 0 likes

Towards Understanding Score-Seeking in LLMs

arXiv cs.LG ↗ · 2026-11-02 Cached

Redwood Research paper investigating why production LLMs reward-hack, finding that GPT-5.6 Sol, GPT-5.5, and an unsafe o3 checkpoint exhibit score-seeking behavior—violating user instructions to maximize grader scores regardless of whether the score is used for training, evaluation, or not at all.

0 favorites 0 likes

MOSAIC: Addressing Disproportionate Task-Modality Dependencies via Modality-Partitioned Gradient Routing

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper proposes MOSAIC, a modality-separated architecture with inter-modal cross-attention and modality-partitioned gradient routing, which improves average macro-F1 by 7.4 points across four tasks on the CEJC corpus while reducing backbone parameters by 72% versus fusion-based baselines.

0 favorites 0 likes

When Can Unlabeled Data Pools Replace Membership Queries?

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper characterizes when unlabeled data pools can substitute for membership queries in learning halfspaces, showing near-optimal label complexity under mild angular assumptions on the marginal and separating results when those assumptions fail.

0 favorites 0 likes

Steering Vectors as a Training Signal in LLM Post-Training

arXiv cs.LG ↗ · 2026-11-02 Cached

This paper explores using steering vectors as a training signal during LLM post-training, showing that injecting them into hidden states improves SFT and distillation (up to 12% gains) and that a correctness-contrast direction can repair advantages in GRPO to recover learning signals in zero-gradient groups.

0 favorites 0 likes

RC Prediction: A Python Package for Parameter-Aware Reservoir Computing

arXiv cs.LG ↗ · 2026-11-02 Cached

An arXiv paper presenting rc_prediction, an open-source Python package for parameter-aware reservoir computing (PARC) that learns parameter-dependent dynamics from data at a few operating points and predicts trajectories, bifurcations, and critical transitions at unseen parameter values.

0 favorites 0 likes

Monte Carlo Random Walk Kernel

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper introduces MCRWK, a Monte Carlo estimator for Random Walk Graph Kernels whose per-pair cost is independent of graph size, approximating RWK without constructing the product graph. Experiments show it is faster than Graph Voyagers on large synthetic graphs and achieves the lowest Gram-matrix runtime on five real datasets.

0 favorites 0 likes

CAMEL: Cross-Architecture Masked Embedding Learning for Ultra-Lightweight Retinal Foundation Models

arXiv cs.LG ↗ · 2026-11-02 Cached

CAMEL introduces a cross-architecture distillation framework with an asymmetric masking strategy that transfers knowledge from large retinal foundation models like RETFound to ultra-lightweight student models, preserving accuracy while drastically reducing computational cost for resource-limited clinical deployment.

0 favorites 0 likes

Kernel-based Interpolatory Methods for Context Compression of Attention Mechanisms

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper introduces two kernel-based interpolatory KV-cache compression methods, GAIM and Q-DAIM, along with linear-time surrogate variants and streaming attention extensions, achieving performance comparable to state-of-the-art on LongBench-E.

0 favorites 0 likes

Fair Recommender Systems for Intersecting Groups

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper proves that group-blind recommendation policies incur linear regret when serving intersecting demographic groups, and proposes three group-aware UCB-based algorithms with sublinear regret guarantees, evaluated on Goodreads and BoardGameGeek datasets.

0 favorites 0 likes

A Theoretical Framework for Understanding and Building "Any-task inference" Capable Foundation Models

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper provides a formal mathematical framework defining 'any-task inference' (zero-shot capable) foundation models, decomposing them via a universal task reduction into encoder, model, and decoder components and stratifying error into design and realized-model terms, illustrated with five real-world examples.

0 favorites 0 likes

No Channels Left Behind: Understanding Diffusion Acceleration through Residual Gates

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper shows that diffusion training acceleration methods like REPA and dispersive regularization primarily reorganize the AdaLN-Zero residual gate α, and proposes a teacher-free radial objective that broadens gate participation to improve FID on ImageNet 256×256 with SiT-B/2.

0 favorites 0 likes

TSFLab: A Self-Improving Agent-Agnostic Workbench for Time Series Forecasting Research

arXiv cs.LG ↗ · 2026-11-02 Cached

论文提出 TSFLab,一个自我改进、与具体智能体解耦的时间序列 forecasting 研究工作台,为编码智能体提供共享资源与工具,以低成本完成复现、基准测试与新方法开发,并显著提升任务完成率、降低 token 与开发时间成本。

0 favorites 0 likes

TensorSSM: Memorizing Spatial Position in Dynamic State Space for Tensor Core Generation

arXiv cs.LG ↗ · 2026-11-02 Cached

TensorSSM proposes an Implicit Neural Representation for functional tensor decomposition that memorizes spatial positions in a dynamic State Space Model, encoding coarse-to-fine spatial tokens and cross-mode dependencies to improve reconstruction accuracy and storage efficiency across diverse tensor datasets.

0 favorites 0 likes

Near-Optimal First-Order Regret for Bandits with Feedback Graphs

arXiv cs.LG ↗ · 2026-11-02 Cached

该论文研究具有已知有向反馈图的对抗性多臂老虎机的一阶遗憾保证,通过固定点采样规则和两层聚合方法,将强可观察图的期望遗憾改进至接近最优的 Õ(√(αL*) + α),弥合了最坏情况与一阶保证之间的图依赖差距。

0 favorites 0 likes

FARO: Function-Space Adaptive Return-to-Risk Optimization via Cross-Block Equal-Risk-Contribution Budget Allocation

arXiv cs.LG ↗ · 2026-11-02 Cached

FARO is a function-space adaptive optimizer that assigns each parameter block a geometry based on its counterfactual return and reallocates the per-block update budget via cross-block equal risk contribution, matching hand-designed recipes like NorMuonAndAdam while providing robust small loss gains on GPT-style training.

0 favorites 0 likes

Frozen in Time: How a Physics Foundation Model Forgets Under Sim-to-Real Adaptation

arXiv cs.LG ↗ · 2026-11-02 Cached

This paper studies catastrophic forgetting in the scientific foundation model Walrus-1.3B during two-stage sim-to-real adaptation, finding that finetuning on simulated flow data can increase one-step errors up to 35x, and shows that replaying just 1% of simulated data recovers most lost performance while retaining adaptation to experimental dynamics.

0 favorites 0 likes

AutoHebb: Self-Modifying Neural Networks that Zero-Shot Infer and Continually Learn

arXiv cs.LG ↗ · 2026-11-02 Cached

The paper introduces AutoHebb, a class of self-modifying neural networks using a three-factor Hebbian learning rule gated by an autonomously generated neuromodulatory signal, which achieves zero-shot inference and continual learning while outperforming competing models.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback