rational-activations

Tag

Cards List
#rational-activations

Rational Sparse Autoencoder

arXiv cs.LG · 2026-06-16 Cached

Introduces Rational Sparse Autoencoder (RSAE), which replaces fixed encoder activations with trainable rational functions, improving reconstruction and sparsity trade-offs on residual-stream activations of open-weight language models across multiple baseline families.

0 favorites 0 likes
← Back to home

Submit Feedback