Tag
MinkowskiPE proposes a Minkowski-geometry-based positional encoding that makes attention scores depend only on relative spacetime displacement, preserving spacetime translation invariance while remaining FlashAttention-compatible, and shows consistent gains on molecular dynamics and video prediction tasks.