inductive-biases

Tag

Cards List
#inductive-biases

The Cognitive Categorical Transformer: Category-Theoretic Inductive Biases for Language Modeling

arXiv cs.AI · 2026-05-29 Cached

The Cognitive Categorical Transformer (CCT) augments GPT-2 Small with category-theoretic components, achieving a 12% relative perplexity reduction on WikiText-103 under matched training conditions, with simplicial message passing responsible for 84% of the improvement.

0 favorites 0 likes
← Back to home

Submit Feedback