gated-rotary-attention

Tag

Cards List
#gated-rotary-attention

GRATE: Temporal Extensions for Inductive KG Foundation Models via Gated Rotary Attention

arXiv cs.AI · 4d ago Cached

This paper proposes GRATE (Gated Rotary Attention for Temporal Encoding), a parameter-free temporal encoding method that enhances inductive knowledge graph foundation models by incorporating relative time differences and query-conditioned gating. It also introduces new inductive temporal knowledge graph benchmarks (GDELTIndT and WIKIIndT) to evaluate cross-dataset transfer, demonstrating improved performance over static base models.

0 favorites 0 likes
← Back to home

Submit Feedback