Tag
POSPAN introduces a position-constrained span masking framework that unifies existing span-level methods for language model pre-training, showing enhanced performance on NLU benchmarks.