gradient-retrieval

Tag

Cards List
#gradient-retrieval

Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift

arXiv cs.CL ↗ · 2026-06-16 Cached

Proposes ReGrad, a paradigm that treats gradients as retrievable units of knowledge for continual post-training, avoiding cumulative weight drift by storing document-specific gradients in a Gradient Bank and retrieving query-relevant gradients for temporary weight adaptation.

0 favorites 0 likes
← Back to home

Submit Feedback