edge-asr

Tag

Cards List
#edge-asr

Tokenizer Transplantation: Mitigating Autoregressive Collapse in Edge-Efficient Bengali ASR

arXiv cs.CL · 2026-07-13 Cached

This paper proposes a tokenizer transplantation pipeline for lightweight ASR models like Moonshine to address autoregressive collapse in Bengali. By replacing the English-centric tokenizer with a BanglaBERT WordPiece vocabulary, token fertility drops from 9.16 to 1.30 and sequence length by 85.8%, achieving 21.54% WER on the Lipi-Ghor dataset.

0 favorites 0 likes
← Back to home

Submit Feedback