inflectional-morphology

#inflectional-morphology

The Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models

arXiv cs.CL ↗ · 2d ago Cached

This article analyzes BPE tokenization in Polish, highlighting its limits in inflectional languages and proposing grammatical form anchoring to improve language modeling.

0 favorites 0 likes

inflectional-morphology

The Limits of BPE Tokenization in Polish: Segmentation-Flexional Forms, Grammatical Anchoring, and First-Person Stability in Inflectional Language Models

Submit Feedback