graph-tokens

Tag

Cards List
#graph-tokens

When Graph Tokens Sink: A Mechanistic Analysis of Graph Language Models

Hugging Face Daily Papers · 2026-06-02

This paper analyzes how large language models internally process graph tokens in Graph Language Models (GLMs), finding a decoupling between activation-level saliency and graph-semantic utility. Graph sink tokens emerge as activation outliers but are not the primary carriers of graph structure, revealing limitations in current graph-token construction and alignment mechanisms.

0 favorites 0 likes
← Back to home

Submit Feedback