rare-words

论文揭示连续扩散语言模型（如ELF）因生成过程缺少逐步离散采样步骤而导致长尾词汇严重缺失（稀有词生成率仅为人类文本的0.30×），并提出训练无关的GRAFT方法，通过在模型未确定时提交稀有词再重新生成序列，将稀有词比例恢复至人类水平的0.82–1.10×。

This paper compares context biasing methods and speech LLMs for recognizing rare and new words in automatic speech recognition, reporting trade-offs in word error rate across read and non-read speech.