positional-embeddings

Tag

Cards List
#positional-embeddings

Bifocal Attention: Harmonizing Geometric and Spectral Positional Embeddings for Algorithmic Generalization

arXiv cs.CL · 2026-07-20 Cached

This paper introduces Bifocal Attention, which decouples positional encoding into geometric (standard RoPE) and spectral (learnable harmonic operators) modalities to address the 'Spectral Rigidity' of fixed RoPE, improving algorithmic generalization beyond the training window.

0 favorites 0 likes
← Back to home

Submit Feedback