rotary-position-embedding

Tag

Cards List
#rotary-position-embedding

Phase Structure in Rotary Attention: A Spectral Framework for Semantic Continuity and Execution-Boundary Governance

arXiv cs.CL · 2026-07-29 Cached

This paper develops a spectral framework for analyzing rotary phase alignment, semantic continuity, and representation drift in transformer language models, proposing a bounded spectral method and distinguishing internal coherence from execution-boundary governance.

0 favorites 0 likes
#rotary-position-embedding

PJ-RoPE: A Fourier-Jet-Affine Position Space for Relative Attention

arXiv cs.LG · 2026-06-05 Cached

PJ-RoPE unifies RoPE's Fourier phase, Jordan-RoPE's finite jets, and ALiBi's affine recency into a single learnable relative-position space, and studies task-driven selection of sectors.

0 favorites 0 likes
← Back to home

Submit Feedback