Sub-JEPA: Subspace Gaussian Regularization for Stable End-to-End World Models
Summary
The authors introduce Sub-JEPA, a method using Subspace Gaussian Regularization to improve the stability of end-to-end world models like LeWM, showing consistent performance gains on continuous-control benchmarks.
View Cached Full Text
Cached at: 05/12/26, 07:33 AM
Paper page - Sub-JEPA: Subspace Gaussian Regularization for Stable End-to-End World Models
Source: https://huggingface.co/papers/2605.09241 We’re releasing Sub-JEPA 🌐
LeWM (from LeCun’s group) is the first end-to-end trainable JEPA world model — it uses isotropic Gaussian regularization to prevent representation collapse. Clean and effective.
Our take: latent representations sit on low-dimensional manifolds, so enforcing a full-space Gaussian is too strong a bias.
We propose Subspace Gaussian Regularization: instead of constraining the full embedding space, we project latents into multiple orthogonal subspaces and apply Gaussian constraints there. Simple change, better inductive bias.
Results on 4 continuous-control benchmarks consistently outperform LeWM, with gains correlated to reductions in effective rank — the lower the task’s intrinsic dimensionality, the larger the gain.
Similar Articles
Sub-JEPA: a simple fix to LeCun group's LeWorldModel that consistently improves performance [P]
Sub-JEPA improves LeWorldModel by applying Gaussian regularization in frozen random orthogonal subspaces, consistently outperforming the original on benchmarks with up to +10.7 percentage points improvement.
@reza_byt: World Modeling with JEPA has recently gained traction thanks to a novel anti-collapse mechanism called "SIGReg" (by @yl…
Explains SIGReg, a novel regularizer for JEPA that prevents representation collapse by forcing embeddings to follow an isotropic Gaussian distribution, with theoretical guarantees and a clean training loop.
No Gaussian Required: Contrastive Inverse Dynamics for JEPA World Models
The paper introduces AC-MTM, a contrastive inverse dynamics method to prevent encoder collapse in JEPA world models, achieving improved performance on multi-object tasks without Gaussian constraints.
LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels
LeWorldModel introduces a stable, end-to-end Joint-Embedding Predictive Architecture that trains directly from pixels with minimal hyperparameters and provable anti-collapse guarantees. It achieves significant speedups in planning compared to foundation models while maintaining competitive performance on robotic manipulation tasks.
Temporal-Distance JEPA: Plan-Aware Representation Learning for Latent World Model Predictive Control
Proposes temporal-distance JEPA (TD-JEPA) which mines directed temporal cost from offline trajectories to improve latent world model predictive control, achieving higher success rates on robotic environments.