Tag
OmniSpectra 提出一种波长原生的光谱基础模型,采用连续坐标与物理约束解码器实现跨仪器表征学习,仅用 12.2M 参数即在八个巡天数据集上超越更大的基线模型,表明物理结构编码可以替代参数规模。
This paper extends the Platonic Representation Hypothesis to robotics, introducing Sensorimotor Alignment (S²) as an offline proxy that measures overlap between a model's sensory representations and end-effector trajectories, showing it correlates with downstream robot task success across VLAs, WAMs, and real-robot policies.
文章介绍了一种名为"Next-Concept Modeling"的新范式,主张生成式AI应先生成抽象概念、再生成文字,而非直接以词为输出单位,有望改变现有生成式AI的建模方式。
TRACE is a training-aware benchmark framework that reorganizes 168 text-vision embedding tasks into General, Adaptability, and Challenge categories, revealing that data adaptation improves adaptability but fails to solve challenging multilingual and visual-document tasks.
论文提出正交边界遗忘(OBU)框架,通过在激活协方差的正交零空间中限制参数更新,在大模型中消除双用领域(如网络安全、生物、化学、核工程)的危险能力,同时不损害良性科学能力,避免概念混淆。
This paper classifies when the represented mobility map of parameter gradient flow is fully determined by the representation, proving an initialization classification for wide two-factor matrix representations and relating ordinary closure to invariant-level metric factorization in analytic and smooth regimes.
This paper introduces 'decision sufficiency' as a framework for evaluating whether learned representation interfaces, such as selected sparse autoencoder features, retain enough information for a controller to safely steer language models, and audits Qwen2.5, SmolLM2, and Phi showing measurable information loss in safety-critical decisions.
The paper proposes 'predictive closure,' a set-level characterization of how JEPA selects features to encode, showing that feature retention depends on relationships within feature sets rather than individual predictability, with experiments demonstrating that unpredictable features can be preserved when they aid prediction of others.
The paper introduces a self-supervised representation learning framework that uses temporal proximity as supervision to learn compact representations from short-term animal movement trajectories, showing they reveal individual identity and learning progress in freely behaving rats.
该论文提出将系统的本体状态定义为在给定查询空间上的完整响应谱,研究通过预测学习到的状态能在多大程度上恢复真实状态,并在合成系统与神经记录中给出预测-恢复的理论保证。
This paper proposes a post-hoc latent projection method for latent world model planning that prunes noisy latent directions by fitting the state dynamics matrix and restricting the ℓ2 planning cost to the least-uncertain subspace, reporting up to +54.7 points success-rate gains on 2D navigation tasks like TwoRoom and PointMaze.
ALPS is a pretrained ViT-B/16 visual state encoder for world models that unifies physical-state prediction, language alignment, and pixel reconstruction in a single patch-token representation, achieving state-probe performance matching the 3.5x larger V-JEPA 2-L and 85.5% mean policy success on LIBERO when paired with its native text tower.
OverSeer introduces a multi-agent world model that augments egocentric agent views with fixed auxiliary camera views acting as a world-centric representation, compressed via delta-VAE to cut token computation, showing improved consistency in Minecraft and Doom.
Slot-JEPA 将 JEPA 的稠密表示分解为可复用的语义槽与空间掩码,提供面向对象的预测接口,并结合 Transition Memory Predictor 与非平衡最优传输提升视觉理解迁移和目标条件规划,在七项视觉基准与 REALM-JEPA 机器人规划任务上取得改进。
该论文区分了表征相似性的两种度量——原生余弦几何与线性可恢复性,并在五个模型族的天文数据集嵌入上发现,模型规模主要提升线性对齐后的邻域对应,而非原生几何收敛。
该论文研究了奖励模型中的涌现性错位(Emergent Misalignment),发现对 Skywork-Reward-V2 奖励模型进行窄域有害微调会泛化到七个未见领域,并通过几何压缩与内容特异性旋转两种机制解释了偏好反转的实现方式,表明奖励模型比语言模型更易受此影响。
FlexUMM提出了一种灵活的统一多模态模型框架,动态决定何时保留共享计算、何时路由专门化容量、何时提前停止处理,从而在提升理解与生成任务准确性的同时提高计算效率,可作为即插即用模块增强现有UMM。
This paper shows that null controls alone are insufficient for validating scientific discovery and interpretability systems, demonstrating that acceptance tests like closure can be passed by scientifically empty candidates, and proposes combining multiple criteria to both accept genuine results and reject nulls.
提出在由2D基础模型导出的高维隐式3D潜在空间中直接进行扩散建模,实现3D-grounded的场景级3D生成,相比2D多视角方法在空间一致性和效率上更具优势,并验证了其在表示与模型容量上的可扩展性。
SpecMRL 提出在参数化谱空间中重新组织特征以改进嵌入的前缀读出,在 MTEB 上以更少的嵌入维度超越标准 MRL 及其全维表现。