Tag
Introduces STST-JEPA, a self-supervised transformer for EEG that predicts masked-token representations, pretrained on 47,703 sessions for brain age regression across ages 5–81.
Introduces DLLM-JEPA, a JEPA formulation for masked diffusion language models that constructs two views from a single input via the diffusion noise schedule, reducing training FLOPs by 33% relative to LLM-JEPA and improving fine-tuning performance on tasks like GSM8K.