auxiliary-objectives

Tag

Cards List
#auxiliary-objectives

Representation Without Reward: A JEPA Audit for LLM Fine-Tuning

arXiv cs.LG · 2026-05-18 Cached

This paper audits Joint-embedding predictive architectures (JEPA) for LLM fine-tuning on a natural-language-to-regex task, testing twenty-two auxiliary objectives. The results show that hidden-state representation improvements are only weakly coupled to decoded-task accuracy, with no auxiliary surviving family-wise correction.

0 favorites 0 likes
← Back to home

Submit Feedback