rotary-position-embedding

Tag

Cards List
#rotary-position-embedding

PJ-RoPE: A Fourier-Jet-Affine Position Space for Relative Attention

arXiv cs.LG · 2026-06-05 Cached

PJ-RoPE unifies RoPE's Fourier phase, Jordan-RoPE's finite jets, and ALiBi's affine recency into a single learnable relative-position space, and studies task-driven selection of sectors.

0 favorites 0 likes
← Back to home

Submit Feedback