gated-networks

RecurrentGPT introduces a recurrent depth transformer that uses gated modulation to iteratively reuse shared layers, achieving competitive accuracy with fewer parameters and improved memory efficiency compared to standard transformers.