filter-design

An independent researcher's paper ablates filter properties (DC/Nyquist suppression, bandwidth, centre frequency, multi-scale coverage) for FourierQK frequency-collapse attention, finding that admissible bandpass filters like the Mexican Hat DOG yield gains over dot-product attention in bidirectional settings, while causal autoregressive use requires a Morlet-based variant. Part of a seven-paper series on spectral inductive biases for transformer attention.