cascadeformer

This paper introduces CascadeFormer, a depth-tapered transformer architecture, and CascadeFlow pruning, both motivated by Gradient Fan-in Asymmetry (GFA), which explains why deeper layers contribute less. The methods improve efficiency by reducing latency and increasing throughput while maintaining competitive performance.