continuous-weights

Tag

Cards List
#continuous-weights

Testing whether discrete topology is a more durable memory medium than continuous weights — it isn't ... probably [R]

Reddit r/MachineLearning · 2026-08-23

The article compares discrete and continuous memory adapters for frozen language models, finding that binary-mask methods like EPMem forget facts as quickly as continuous ones, emphasizing that the write/allocation rule, not discreteness, is crucial for preventing forgetting.

0 favorites 0 likes
← Back to home

Submit Feedback