representation-learning

Tag

Cards List
#representation-learning

OmniSpectra: A Unified Foundation Model for Universal Spectra Representation Learning

Hugging Face Daily Papers ↗ · 2026-10-23 Cached

OmniSpectra 提出一种波长原生的光谱基础模型,采用连续坐标与物理约束解码器实现跨仪器表征学习,仅用 12.2M 参数即在八个巡天数据集上超越更大的基线模型,表明物理结构编码可以替代参数规模。

0 favorites 0 likes
#representation-learning

Sensorimotor Alignment: A Platonic Proxy for Embodied Policy Success

Hugging Face Daily Papers ↗ · 2026-10-23 Cached

This paper extends the Platonic Representation Hypothesis to robotics, introducing Sensorimotor Alignment (S²) as an offline proxy that measures overlap between a model's sensory representations and end-effector trajectories, showing it correlates with downstream robot task success across VLAs, WAMs, and real-robot policies.

0 favorites 0 likes
#representation-learning

Generative AI Gets Shaken Up By Next-Concept Modeling That Produces Concepts First And Words Second

Reddit r/singularity ↗ · 2026-10-21

文章介绍了一种名为"Next-Concept Modeling"的新范式,主张生成式AI应先生成抽象概念、再生成文字,而非直接以词为输出单位,有望改变现有生成式AI的建模方式。

0 favorites 0 likes
#representation-learning

TRACE: Training-aware Robustness and Challenge Evaluation for Text-Vision Embedding Models

arXiv cs.CL ↗ · 2026-10-21 Cached

TRACE is a training-aware benchmark framework that reorganizes 168 text-vision embedding tasks into General, Adaptability, and Challenge categories, revealing that data adaptation improves adaptability but fails to solve challenging multilingual and visual-document tasks.

0 favorites 0 likes
#representation-learning

Orthogonal Boundary Unlearning for Dual-Use Concepts in Large Language Models

arXiv cs.LG ↗ · 2026-10-21 Cached

论文提出正交边界遗忘(OBU)框架,通过在激活协方差的正交零空间中限制参数更新,在大模型中消除双用领域(如网络安全、生物、化学、核工程)的危险能力,同时不损害良性科学能力,避免概念混淆。

0 favorites 0 likes
#representation-learning

When Parameter Gradient Flows Close in Representation Space

arXiv cs.LG ↗ · 2026-10-21 Cached

This paper classifies when the represented mobility map of parameter gradient flow is fully determined by the representation, proving an initialization classification for wide two-factor matrix representations and relating ordinary closure to invariant-level metric factorization in analytic and smooth regimes.

0 favorites 0 likes
#representation-learning

Decision Sufficiency of Learned Representation Interfaces for Safe Generative Control

arXiv cs.LG ↗ · 2026-10-21 Cached

This paper introduces 'decision sufficiency' as a framework for evaluating whether learned representation interfaces, such as selected sparse autoencoder features, retain enough information for a controller to safely steer language models, and audits Qwen2.5, SmolLM2, and Phi showing measurable information loss in safety-critical decisions.

0 favorites 0 likes
#representation-learning

Predictive Closure: A Set-Level Characterization of JEPA's Feature Selection

arXiv cs.LG ↗ · 2026-10-21 Cached

The paper proposes 'predictive closure,' a set-level characterization of how JEPA selects features to encode, showing that feature retention depends on relationships within feature sets rather than individual predictability, with experiments demonstrating that unpredictable features can be preserved when they aid prediction of others.

0 favorites 0 likes
#representation-learning

Representing short-term movement to reveal animal identity and learning progress

arXiv cs.LG ↗ · 2026-10-21 Cached

The paper introduces a self-supervised representation learning framework that uses temporal proximity as supervision to learn compact representations from short-term animal movement trajectories, showing they reveal individual identity and learning progress in freely behaving rats.

0 favorites 0 likes
#representation-learning

Ontic state recovery through prediction

arXiv cs.LG ↗ · 2026-10-21 Cached

该论文提出将系统的本体状态定义为在给定查询空间上的完整响应谱,研究通过预测学习到的状态能在多大程度上恢复真实状态,并在合成系统与神经记录中给出预测-恢复的理论保证。

0 favorites 0 likes
#representation-learning

Latent Projection for Latent Planning

arXiv cs.LG ↗ · 2026-10-21 Cached

This paper proposes a post-hoc latent projection method for latent world model planning that prunes noisy latent directions by fitting the state dynamics matrix and restricting the ℓ2 planning cost to the least-uncertain subspace, reporting up to +54.7 points success-rate gains on 2D navigation tasks like TwoRoom and PointMaze.

0 favorites 0 likes
#representation-learning

ALPS: Visual State Encoders for World Models

Hugging Face Daily Papers ↗ · 2026-10-21 Cached

ALPS is a pretrained ViT-B/16 visual state encoder for world models that unifies physical-state prediction, language alignment, and pixel reconstruction in a single patch-token representation, achieving state-probe performance matching the 3.5x larger V-JEPA 2-L and 85.5% mean policy success on LIBERO when paired with its native text tower.

0 favorites 0 likes
#representation-learning

OverSeer: Multi-Agent World Models Beyond What Agents See

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

OverSeer introduces a multi-agent world model that augments egocentric agent views with fixed auxiliary camera views acting as a world-centric representation, compressed via delta-VAE to cut token computation, showing improved consistency in Minecraft and Doom.

0 favorites 0 likes
#representation-learning

Slot-JEPA: Object-Structured Prediction Interfaces for Latent World Models

Hugging Face Daily Papers ↗ · 2026-10-20 Cached

Slot-JEPA 将 JEPA 的稠密表示分解为可复用的语义槽与空间掩码,提供面向对象的预测接口,并结合 Transition Memory Predictor 与非平衡最优传输提升视觉理解迁移和目标条件规划,在七项视觉基准与 REALM-JEPA 机器人规划任务上取得改进。

0 favorites 0 likes
#representation-learning

Native Geometry vs. Linear Recoverability: How Alignment Changes Platonic Scaling

arXiv cs.LG ↗ · 2026-10-19 Cached

该论文区分了表征相似性的两种度量——原生余弦几何与线性可恢复性,并在五个模型族的天文数据集嵌入上发现,模型规模主要提升线性对齐后的邻域对应,而非原生几何收敛。

0 favorites 0 likes
#representation-learning

Compression Precedes, Content Decides: Emergent Misalignment in Reward Models

arXiv cs.AI ↗ · 2026-10-19 Cached

该论文研究了奖励模型中的涌现性错位(Emergent Misalignment),发现对 Skywork-Reward-V2 奖励模型进行窄域有害微调会泛化到七个未见领域,并通过几何压缩与内容特异性旋转两种机制解释了偏好反转的实现方式,表明奖励模型比语言模型更易受此影响。

0 favorites 0 likes
#representation-learning

FlexUMM: Flexible Representation Learning for Unified Multimodal Models

arXiv cs.AI ↗ · 2026-10-19 Cached

FlexUMM提出了一种灵活的统一多模态模型框架,动态决定何时保留共享计算、何时路由专门化容量、何时提前停止处理,从而在提升理解与生成任务准确性的同时提高计算效率,可作为即插即用模块增强现有UMM。

0 favorites 0 likes
#representation-learning

Null Controls Are Necessary but Not Sufficient: Evaluating Acceptance Guards for Scientific Discovery and Interpretability

arXiv cs.AI ↗ · 2026-10-19 Cached

This paper shows that null controls alone are insufficient for validating scientific discovery and interpretability systems, demonstrating that acceptance tests like closure can be passed by scientifically empty candidates, and proposes combining multiple criteria to both accept genuine results and reject nulls.

0 favorites 0 likes
#representation-learning

Any 3D Scene is Worth 1K Tokens: 3D-Grounded Representation for Scene Generation at Scale

Hugging Face Daily Papers ↗ · 2026-10-19 Cached

提出在由2D基础模型导出的高维隐式3D潜在空间中直接进行扩散建模,实现3D-grounded的场景级3D生成,相比2D多视角方法在空间一致性和效率上更具优势,并验证了其在表示与模型容量上的可扩展性。

0 favorites 0 likes
#representation-learning

SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum

Hugging Face Daily Papers ↗ · 2026-10-19 Cached

SpecMRL 提出在参数化谱空间中重新组织特征以改进嵌入的前缀读出,在 MTEB 上以更少的嵌入维度超越标准 MRL 及其全维表现。

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback