Tag
The paper develops an early-training stability theory for Joint-Embedding Predictive Architectures that unifies empirical collapse-avoidance heuristics via a drive/decay stability ratio, predicts a phase boundary confirmed across 800+ Tabular-JEPA configurations, and introduces a ResidualPred transformer predictor that improves effective rank and accuracy on tabular and I-JEPA image benchmarks.