How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMs
Summary
This paper compares context biasing methods and speech LLMs for recognizing rare and new words in automatic speech recognition, reporting trade-offs in word error rate across read and non-read speech.
View Cached Full Text
Cached at: 08/07/26, 07:51 AM
# How to Recognize New Words: A Comparison Between Context Biasing Methods and Speech LLMs
Source: [https://arxiv.org/html/2608.05759](https://arxiv.org/html/2608.05759)
###### Abstract
Recognizing new and rare words \- named entities, acronyms, domain specific special words, and other items scarce in training data \- remains a key challenge for automatic speech recognition \(ASR\)\. We compare two strategies for this: context biasing methods, where an ASR model is extended such that during inference a word list can be supplied, and speech large language models \(LLMs\) prompted with context directly\. We evaluate two context biasing methods based on Whisper against three speech LLMs across read and non\-read speech, reporting biased, unbiased, and overall word error rate \(WER\)\. The context biasing methods cut biased WER by up to 88% relative while leaving other words largely unaffected\. Speech LLMs excel on read speech but generalize less well to non\-read speech, and prove sensitive to distractor count and prompt word order\. We characterize the resulting trade\-offs to guide method selection\.
## IIntroduction
End\-to\-end ASR has advanced rapidly, driven by the transformer architecture\[[29](https://arxiv.org/html/2608.05759#bib.bib2),[20](https://arxiv.org/html/2608.05759#bib.bib3)\]and, more recently, by large models trained with weak supervision on hundreds of thousands of hours of audio, such as Whisper\[[22](https://arxiv.org/html/2608.05759#bib.bib4)\]\. These systems achieve low word error rates across a wide range of conditions and have become the default choice for many transcription tasks\. Nevertheless, they share a persistent weakness: words that are rare or absent in the training data \- named entities, acronyms, and domain\-specific terminology \- are recognized far less reliably than common words\. This weakness is consequential because rare words are often the most informative parts of an utterance\. A person’s name, a product identifier, or a technical term typically carries more meaning than the surrounding function words, so an error on such a word degrades the usefulness of a transcript disproportionately\. At the same time, because these words are infrequent, their errors are diluted in the overall WER, which can stay low even when the words that matter most are systematically missed\.
Two strategies can be used to address this\. The first, context biasing methods, which extends an ASR model with a mechanism that accepts a list of words or phrases at inference and biases decoding toward them, without altering the model’s parameters for each new list\. The second exploits speech LLMs, a recent class of models that jointly consume audio and a text prompt: the words of interest \- or even a free\-form description of the context \- can be placed in the prompt, and the model can attend to them\. Context biasing methods offers a dedicated, controllable interface, whereas speech LLMs promise greater flexibility\.
## IIRelated Work
The difficulty of recognizing new and rare words is long\-standing\. Some works have combined statistical or neural language models with end\-to\-end ASR models using shallow fusion\[[24](https://arxiv.org/html/2608.05759#bib.bib15),[30](https://arxiv.org/html/2608.05759#bib.bib16),[13](https://arxiv.org/html/2608.05759#bib.bib17),[10](https://arxiv.org/html/2608.05759#bib.bib18),[14](https://arxiv.org/html/2608.05759#bib.bib19)\]\. Because the biasing component is trained separately from the acoustic model, the gains are typically modest\. On the other hand, many recent works have used attention\-based deep biasing\[[21](https://arxiv.org/html/2608.05759#bib.bib20),[2](https://arxiv.org/html/2608.05759#bib.bib21),[12](https://arxiv.org/html/2608.05759#bib.bib22),[11](https://arxiv.org/html/2608.05759#bib.bib7),[16](https://arxiv.org/html/2608.05759#bib.bib1),[7](https://arxiv.org/html/2608.05759#bib.bib23),[5](https://arxiv.org/html/2608.05759#bib.bib24),[9](https://arxiv.org/html/2608.05759#bib.bib25),[33](https://arxiv.org/html/2608.05759#bib.bib26),[26](https://arxiv.org/html/2608.05759#bib.bib27),[34](https://arxiv.org/html/2608.05759#bib.bib28),[31](https://arxiv.org/html/2608.05759#bib.bib29),[25](https://arxiv.org/html/2608.05759#bib.bib8)\]\. Some of them use only textual context information and some also include pronunciation information\.
Recently, speech LLMs were introduced\[[3](https://arxiv.org/html/2608.05759#bib.bib31),[27](https://arxiv.org/html/2608.05759#bib.bib30),[8](https://arxiv.org/html/2608.05759#bib.bib32)\]\. The audio signal is encoded and the resulting representation is fed in an LLM\. Some works adapt a speech LLM to include context\[[15](https://arxiv.org/html/2608.05759#bib.bib33),[6](https://arxiv.org/html/2608.05759#bib.bib34)\]\. The latest speech LLMs\[[23](https://arxiv.org/html/2608.05759#bib.bib5),[32](https://arxiv.org/html/2608.05759#bib.bib6),[19](https://arxiv.org/html/2608.05759#bib.bib9)\]are explicitly trained to use the context given in the prompt\. Closest to our work is\[[25](https://arxiv.org/html/2608.05759#bib.bib8)\], however, they do not study the effect of distractor count for large speech LLMs and only evaluate on read speech \(LibriSpeech\)\.
In this paper, we \(1\) present a controlled, head\-to\-head comparison of two Whisper\-based context biasing methods against three recent speech LLMs \(Qwen3\-ASR, Qwen3\-Omni, VibeVoice\-ASR\) on rare\-word recognition and report with the biased, unbiased, and overall WER metrics, \(2\) evaluate across read \(LibriSpeech\) and non\-read \(Earnings\-21, Yodas\) speech, showing that speech LLMs are strong on read speech but generalize less well to non\-read speech, \(3\) systematically probe robustness, quantifying sensitivity to distractor count and sensitivity to the order of words in the prompt, \(4\) study a filtering stage that uses an auxiliary speech LLM to prune the bias list, showing how much of the loss it recovers\. \(5\) From these results we characterize the resulting trade\-offs to guide method selection: dedicated context biasing methods remain the more robust choice when a clean word list is available, whereas speech LLMs offer a more flexible interface at the cost of prompt sensitivity and an extra filtering stage\.
## IIIBackground
In the following paragraphs we summarize the two context biasing methods we compare\.
An auto\-regressive end\-to\-end ASR model directly estimates the probability distribution
P\(Yt\|Y0,…,Yt−1;X\)P\(Y\_\{t\}\|Y\_\{0\},\\ldots,Y\_\{t\-1\};X\)\(1\)of the next tokenYtY\_\{t\}given the already decoded sequenceY0,…,Yt−1Y\_\{0\},\\ldots,Y\_\{t\-1\}and the audio inputXX\. The model is then used to find the word sequenceY^\\hat\{Y\}with the highest probability
Y^\\displaystyle\\hat\{Y\}=argmaxYP\(Y\|X\)\\displaystyle=\\operatorname\*\{argmax\}\_\{Y\}P\(Y\|X\)=argmaxY∏t=1TP\(Yt\|Y0,…,Yt−1;X\),\\displaystyle=\\operatorname\*\{argmax\}\_\{Y\}\\prod\_\{t=1\}^\{T\}P\(Y\_\{t\}\|Y\_\{0\},\\ldots,Y\_\{t\-1\};X\),whereY0Y\_\{0\}is the start of sequence token\.
We work with a transformer\-based encoder\-decoder ASR model\. First,Y0,…,Yt−1Y\_\{0\},\\ldots,Y\_\{t\-1\}is embedded:
E=Emb\(Y0,…,Yt−1\)∈ℝt×d,E=Emb\(Y\_\{0\},\\ldots,Y\_\{t\-1\}\)\\in\\mathbb\{R\}^\{t\\times d\},\(2\)withd∈ℕd\\in\\mathbb\{N\}\. Then, the decoder output is computed:
O=Dec\(HX,E\)∈ℝt×d,O=Dec\(H\_\{X\},E\)\\in\\mathbb\{R\}^\{t\\times d\},whereHX=EncAudio\(X\)H\_\{X\}=Enc\_\{Audio\}\(X\)is the encoded audio input\. Finally, the output and softmax layers are applied:
α=Linear\(O\)∈ℝt×nvocab,\\alpha=Linear\(O\)\\in\\mathbb\{R\}^\{t\\times n\_\{vocab\}\},p=Softmax\(α\)∈ℝt×nvocab,p=Softmax\(\\alpha\)\\in\\mathbb\{R\}^\{t\\times n\_\{vocab\}\},\(3\)wherenvocabn\_\{vocab\}is the vocabulary size\.
Based on that model, we trained two context biasing models using the training scheme from\[[11](https://arxiv.org/html/2608.05759#bib.bib7)\]together with the architecture from either\[[11](https://arxiv.org/html/2608.05759#bib.bib7)\]\(denoted A\) or\[[25](https://arxiv.org/html/2608.05759#bib.bib8)\]\(denoted B\)\. The methods works as follows: Equation[1](https://arxiv.org/html/2608.05759#S3.E1)is replaced by
P\(Yt\|Y0,…,Yt−1;X;Z\),P\(Y\_\{t\}\|Y\_\{0\},\\ldots,Y\_\{t\-1\};X;Z\),whereZZis some context provided to the model\. In our case,
Z=\(Z1,…,ZL\),L∈ℕ,Z=\(Z\_\{1\},\\ldots,Z\_\{L\}\),L\\in\\mathbb\{N\},is a list denoted context biasing list and eachZlZ\_\{l\},l∈\{1,…,L\}l\\in\\\{1,\\ldots,L\\\}, is a word or short phrase the model is biased towards\.
### III\-AContext encoding
Both models incorporate the context biasing list by first encoding and embedding each item\. The result is denoted
Zlemb=Emb\(Tokenize\(Zl\)\)\.Z\_\{l\}^\{emb\}=Emb\(Tokenize\(Z\_\{l\}\)\)\.Then, an encoder is applied independently for each item, and afterward the mean over the sequence dimension is computed\. This results in one vector per list entry, denoted
Zls=Avg\(Enc\(Zlemb\)\),Z\_\{l\}^\{s\}=Avg\(Enc\(Z\_\{l\}^\{emb\}\)\),which can be interpreted as a summary vector of the list entry\. For method A, a learned dummy vectorZ0sZ\_\{0\}^\{s\}is added, which is later used to determine when there is no relevant information in the context biasing list\.
### III\-BContext decoding
Method A:Each decoder layer of the baseline model consists of a self\-attention layer, a cross\-attention layer and a positionwise feed\-forward layer\. After each cross\-attention layer, a context\-attention layer is added, which as first step predicts the availability/location of relevant information in the context biasing list \(see next paragraph on how to train that task\)\. If there is relevant information, it is extracted in the second step using attention \(see equation[4](https://arxiv.org/html/2608.05759#S3.E4)\): LetImI^\{m\},m∈\{1,…,M\}m\\in\\\{1,\\ldots,M\\\},M∈ℕM\\in\\mathbb\{N\}, be the input of themm\-th context\-attention layer\. First,ImI^\{m\}is used as a query and\(Zls\)l=0,…,L\(Z\_\{l\}^\{s\}\)\_\{l=0,\\ldots,L\}as keys to compute similarity scoresSm=Im⋅\(Zls\)l=0,…,LTS^\{m\}=I^\{m\}\\cdot\(Z\_\{l\}^\{s\}\)\_\{l=0,\\ldots,L\}^\{T\}\. Then, the outputOmO^\{m\}of themm\-th context\-attention layer is computed as follows, wherent=argmax0≤l≤LSt,lmn\_\{t\}=\\operatorname\*\{argmax\}\_\{0\\leq l\\leq L\}S\_\{t,l\}^\{m\}:
Otm=Itm\+\{Attn\(q=Itm,k=Zntemb,v=Zntemb\),nt\>0,0,nt=0\.O\_\{t\}^\{m\}=I\_\{t\}^\{m\}\+\\begin\{cases\}Attn\(q=I\_\{t\}^\{m\},k=Z\_\{n\_\{t\}\}^\{emb\},v=Z\_\{n\_\{t\}\}^\{emb\}\),&\{n\_\{t\}\}\>0,\\\\ 0,&\{n\_\{t\}\}=0\.\\end\{cases\}\(4\)
Using only the most relevant context biasing list item \(because of the argmax\) for each token has the advantage that the result is independent from items which are irrelevant\.
Method B:For this methodZsZ^\{s\}is used to extend the vocabulary of the decoder\. This is done by extending the output layer, which maps the output of the final decoder layer to the vocabulary, and extending the embedding layer\.
In particular,
αContext=Linear2\(O\)⋅Linear3\(Zs\)Td∈ℝt×L\.\\alpha\_\{Context\}=\\frac\{Linear\_\{2\}\(O\)\\cdot Linear\_\{3\}\(Z^\{s\}\)^\{T\}\}\{\\sqrt\{d\}\}\\in\\mathbb\{R\}^\{t\\times L\}\.\(5\)is calculated andα\\alphain equation[3](https://arxiv.org/html/2608.05759#S3.E3)is replaced by
Concat\(α,αContext\)∈ℝt×\(nvocab\+L\)\.Concat\(\\alpha,\\alpha\_\{Context\}\)\\in\\mathbb\{R\}^\{t\\times\(n\_\{vocab\}\+L\)\}\.Furthermore,Y0,…,Yt−1Y\_\{0\},\\ldots,Y\_\{t\-1\}is replaced byY0′,…,Yt−1′Y^\{\\prime\}\_\{0\},\\ldots,Y^\{\\prime\}\_\{t\-1\}, whereY0′,…,Yt−1′Y^\{\\prime\}\_\{0\},\\ldots,Y^\{\\prime\}\_\{t\-1\}is calculated by replacing all subsequences ofY0,…,Yt−1Y\_\{0\},\\ldots,Y\_\{t\-1\}which correspond to a context biasing list entryZlZ\_\{l\}with a dynamic tokenvlv\_\{l\}\. Finally,EEin equation[2](https://arxiv.org/html/2608.05759#S3.E2)is replaced by
E′=Emb\(Y0′,…,Yt−1′\),E^\{\\prime\}=Emb\(Y^\{\\prime\}\_\{0\},\\ldots,Y^\{\\prime\}\_\{t\-1\}\),where dynamic tokensvlv\_\{l\}are embedded byLinear4\(Zls\)Linear\_\{4\}\(Z\_\{l\}^\{s\}\)and the rest of the tokens is embedded usingEmbEmb\.
### III\-CTraining
During model training, in each step, the context bias listZZis sampled from the labels of the corresponding batch\.
Therefore, for each tokenYtY\_\{t\}the ground truth itemGt∈\{0,…,L\}G\_\{t\}\\in\\\{0,\\ldots,L\\\}in the context biasing list is known, whereGt=0G\_\{t\}=0means that for that token no relevant information is available in the context biasing list\. For model A, thelosslossconsists of two cross\-entropy parts\. The first term classifies the next tokenYtY\_\{t\}of the sequence and the second term guides the network towards relevant context biasing list items:
loss=\\displaystyle loss=1T∑t=1TCE\(fθ\(Y0,…,Yt−1;X;Z\),Yt\)\\displaystyle\\ \\frac\{1\}\{T\}\\sum\_\{t=1\}^\{T\}CE\(f\_\{\\theta\}\(Y\_\{0\},\\ldots,Y\_\{t\-1\};X;Z\),Y\_\{t\}\)\+λMT∑m=1M∑t=1TCE\(Stm,Gt\),\\displaystyle\+\\frac\{\\lambda\}\{MT\}\\sum\_\{m=1\}^\{M\}\\sum\_\{t=1\}^\{T\}CE\(S\_\{t\}^\{m\},G\_\{t\}\),wherefθ\(Y0,…,Yt−1;X;Z\)f\_\{\\theta\}\(Y\_\{0\},\\ldots,Y\_\{t\-1\};X;Z\)is the network output,CECEthe cross\-entropy loss function andλ\>0\\lambda\>0a hyperparameter\.
For model B, only the firstlosslossterm is present\.
Specifically, we used a batch size of 16 and sampled on average three context biasing list entries per utterance of the batch\. Then the context biasing list is filled up to a length of 200 with distractors sampled from other batches\.
## IVExperiments
### IV\-AModels
We compare the two context biasing methods explained in Section[III](https://arxiv.org/html/2608.05759#S3)with three speech LLMs: Qwen3\-ASR\[[23](https://arxiv.org/html/2608.05759#bib.bib5)\]\(1\.7B, denoted C\), Qwen3\-Omni\[[32](https://arxiv.org/html/2608.05759#bib.bib6)\]\(30B, denoted D\) and VibeVoice\-ASR\[[19](https://arxiv.org/html/2608.05759#bib.bib9)\]\(9B, denoted E\)\.
We use Whisper\[[22](https://arxiv.org/html/2608.05759#bib.bib4)\]\(whisper\-large\-v2\) as the baseline ASR model for both context biasing methods\. The context biasing list is tokenized / embedded using the Whisper tokenizer / Whisper embedding, and the context is encoded using the mBART\-50 encoder\[[28](https://arxiv.org/html/2608.05759#bib.bib10)\]\. We trained both context biasing models on Common voice\[[1](https://arxiv.org/html/2608.05759#bib.bib11)\]and only the newly added parameters of the mBART\-50 encoder and the context\-attention layers \(if present\) were adapted\.
Qwen3\-ASR was trained in the supervised finetuning stage with ”context biasing data\. \[…\] the model learns to utilize the context tokens inside the system prompt as background knowledge, allowing users to obtain customized ASR results”\[[23](https://arxiv.org/html/2608.05759#bib.bib5)\]\. Qwen3\-Omni is promoted as ”a single multimodal model that for the first time maintains state\-of\-the\-art performance across text, image, audio, and video without any degradation relative to single\-modal counterparts”\[[32](https://arxiv.org/html/2608.05759#bib.bib6)\]\. When using VibeVoice\-ASR, users can ”supply customized context \- ranging from hotword lists to background descriptions \- significantly enhancing the model’s ability to recognize domain\-specific terminology”\[[19](https://arxiv.org/html/2608.05759#bib.bib9)\]\.
During decoding of the test sets \(see Section[IV\-B](https://arxiv.org/html/2608.05759#S4.SS2)\), the context biasing list / prompt contains the rare words belonging to the utterance which is currently decoded\. Optionally, we add up to 250 distractors chosen randomly from the other rare words of the testset and / or remove the relevant context\. The context biasing methods are order\-agnostic with respect to the context biasing list\. This is not the case for the speech LLMs\. We found that they are sensitive with respect to the order in which the words from the context biasing list are placed in the prompt\. In particular, the speech LLMs perform better if a word is at the beginning of the prompt\. To ensure a fair comparison, we sort the words in the prompt alphabetically for all speech LLMs\.
TABLE I:Results: BWER/UWER/WER in % of the different models on the context biasing text sets\.NNis the number of distractors\. Numbers in bold: Best performance for the corresponding test set, metric and number of distractors \(only when is context present\)\.TestsetContext / NApproachWhisper large\-v2 \(1\.5B\)\+ Context biasing \(A\)Whisper large\-v2 \(1\.5B\)\+ Context biasing \(B\)Qwen3\-ASR\(1\.7B\) \(C\)Qwen3\-Omni\(30B\) \(D\)VibeVoice\-ASR\(9B\) \(E\)Earnings\-21✗25021,99/13,03/14,2528,98/13,94/15,9919,99/13,10/14,0426,29/17,25/18,4822,62/12,84/14,18✗10019,99/12,85/13,8225,60/13,70/15,3325,32/13,56/15,1728,06/18,88/20,1421,76/12,76/13,99✗1019,07/12,70/13,5719,87/12,70/13,6821,59/13,36/14,4830,76/20,38/21,8022,85/13,70/14,95✗018,73/12,69/13,5218,73/12,69/13,5221,59/13,39/14,5130,81/21,27/22,5724,57/15,46/16,71✓011\.74/12\.48/12\.389\.79/12\.70/12\.3011\.28/12\.73/12\.5313\.12/19\.12/18\.309\.39/12\.17/11\.79✓1011\.74/12\.50/12\.409\.79/12\.73/12\.3311\.28/12\.75/12\.5515\.41/19\.09/18\.5912\.60/12\.08/12\.16✓10011\.86/12\.51/12\.4210\.54/13\.25/12\.8813\.00/12\.79/12\.8217\.07/17\.94/17\.8214\.43/12\.18/12\.48✓25011\.91/12\.57/12\.4811\.23/13\.50/13\.1915\.69/12\.80/13\.2018\.44/16\.68/16\.9316\.38/12\.22/12\.79LibriSpeechtest\-clean✗25025,63/2,92/4,0525,74/3,15/4,2715,55/2,38/3,0412,27/2,16/2,6720,70/2,48/3,39✗10023,44/2,75/3,7823,77/2,86/3,9016,65/2,29/3,0111,61/2,09/2,5620,59/2,55/3,45✗1023,11/2,63/3,6623,11/2,64/3,6616,65/2,23/2,9511,50/2,07/2,5422,34/3,07/4,03✗023,33/2,63/3,6623,33/2,63/3,6617,20/2,24/2,9811,72/2,08/2,5622,45/2,49/3,49✓07\.12/2\.52/2\.754\.60/2\.55/2\.666\.24/2\.09/2\.291\.10/1\.94/1\.902\.96/2\.90/2\.91✓107\.12/2\.52/2\.754\.60/2\.56/2\.675\.59/2\.11/2\.281\.75/1\.93/1\.926\.02/2\.73/2\.89✓1007\.12/2\.62/2\.854\.71/2\.75/2\.858\.21/2\.23/2\.532\.30/2\.04/2\.057\.89/2\.38/2\.65✓2507\.23/2\.69/2\.924\.71/3\.03/3\.1110\.95/3\.05/3\.443\.83/2\.04/2\.139\.86/3\.01/3\.35LibriSpeechtest\-other✗25039,01/6,70/8,6038,92/6,80/8,6933,33/4,09/5,8122,53/3,34/4,4739,19/6,27/8,22✗10038,55/6,23/8,1438,64/6,36/8,2632,69/4,03/5,7223,90/3,44/4,6439,65/6,41/8,37✗1036,81/5,99/7,8037,09/6,08/7,9131,68/3,94/5,5824,91/3,53/4,7939,47/6,44/8,39✗036,90/5,99/7,8236,90/5,99/7,8231,50/3,96/5,5822,99/3,30/4,4641,48/6,68/8,73✓012\.55/5\.66/6\.0710\.44/5\.68/5\.9610\.26/3\.56/3\.953\.57/3\.33/3\.357\.88/5\.66/5\.79✓1012\.45/5\.67/6\.0710\.62/5\.75/6\.0310\.44/3\.62/4\.034\.76/3\.62/3\.6916\.67/5\.90/6\.54✓10012\.45/5\.82/6\.2110\.62/6\.12/6\.3914\.10/3\.79/4\.406\.32/3\.46/3\.6321\.25/5\.71/6\.63✓25012\.64/5\.90/6\.2910\.71/6\.48/6\.7321\.06/3\.96/4\.978\.42/3\.36/3\.6624\.63/5\.95/7\.05Yodas✗25050,07/5,06/5,9452,03/5,03/5,9457,79/6,02/7,0348,88/7,75/8,5559,46/8,09/9,09✗10048,80/5,00/5,8549,73/4,97/5,8458,01/5,91/6,9349,66/7,76/8,5758,71/8,08/9,06✗1048,37/4,96/5,8048,18/4,95/5,7957,43/5,75/6,7551,62/8,11/8,9658,77/8,15/9,14✗048,07/4,95/5,7948,07/4,95/5,7956,80/5,70/6,6951,57/7,11/7,9760,19/8,63/9,63✓016\.90/4\.98/5\.225\.73/4\.84/4\.8624\.52/5\.50/5\.875\.08/7\.11/7\.074\.17/7\.74/7\.67✓1017\.06/5\.00/5\.235\.75/4\.84/4\.8620\.78/5\.60/5\.899\.58/7\.71/7\.7411\.66/7\.85/7\.92✓10017\.19/5\.04/5\.276\.18/4\.87/4\.9041\.27/5\.86/6\.5520\.86/7\.49/7\.7521\.37/7\.86/8\.12✓25017\.23/5\.07/5\.316\.69/4\.93/4\.9648\.32/5\.99/6\.8126\.98/7\.58/7\.9627\.92/7\.89/8\.28
### IV\-BData
We evaluate on three test sets: Earnings\-21\[[4](https://arxiv.org/html/2608.05759#bib.bib12)\], LibriSpeech\[[18](https://arxiv.org/html/2608.05759#bib.bib13)\], and Yodas\[[17](https://arxiv.org/html/2608.05759#bib.bib14)\]\.
For Earnings\-21 we extracted rare words from the given annotations: named entity \(of persons\), acronym \(abbreviations\), and domain\-specific special word \(products, events, laws, locations, and organizations\)\.
For LibriSpeech we followed\[[16](https://arxiv.org/html/2608.05759#bib.bib1)\]and used as rare words all words in the reference that fall outside 10% of the most common words of our training data\. Then, we filtered those rare words that occurred in at least two utterances\.
For our Yodas test set, we took the English data of the Yodas data set and applied a similar procedure compared to LibriSpeech: We retained words occurring at least four times but exclusively within one YouTube video \(to filter noise\)\.
This resulted in 637, 726, 821, and 6363 utterances containing at least one rare word each with a total length of 1\.23, 1\.91, 1\.91, and 47\.8 hours for Earnings\-21, LibriSpeech test\-clean, LibriSpeech test\-other, and Yodas, respectively\. In total, there are 251, 339, 353, and 1360 unique rare words, respectively\.
### IV\-CMetrics
The performance of an ASR system is typically measured using the word error rate \(WER\)\. To measure how well a context biasing method is working,\[[16](https://arxiv.org/html/2608.05759#bib.bib1)\]extended this metric to UWER \(unbiased WER measured on words not in the biasing list\) and BWER \(biased WER measured on words in the biasing list\), given a test set together with a corresponding context biasing list\. We evaluate these metrics along with WER to compare different approaches\.
## VResults
The results can be seen in Table[I](https://arxiv.org/html/2608.05759#S4.T1)\. We report BWER, UWER and WER evaluated on the test sets Earnings\-21, LibriSpeech and Yodas\. For each test set we report scores with and without relevant context and optional up to 250 distractors taken from the other context biasing words of the corresponding test set\.
The BWER of context biasing model A improves between 37% and 70% relative for the different test sets when adding context forN=0N=0\. This is a substantial improvement\. The UWER improves slightly up to 6% relative\. Adding distractors increases BWER/UWER only up to 2%/7% relative, in case the correct word is present in the context biasing list, and up to 17%/12% in the other case\.
The BWER of context biasing model B is better compared to context biasing model A\. It improves between 48% and 88% relative when adding context forN=0N=0compared to the baseline performance\. The UWER also improves slightly up to 5% relative\. Adding distractors increases BWER/UWER by up to 17%/19% relative, in case the correct word is present in the context biasing list, and up to 55%/20% in the other case\. Therefore, the performance of model B suffers more when adding distractors compared to model A\. Most of the additional errors stem from new insertion errors\. This is because the model wrongly predicts the added dynamic token\. The largest difference between model A and B is in BWER for Yodas\. We believe this is because of a training\-inference mismatch between the lengths of the shorter Common voice audio samples and the longer Yodas audio samples\.
For the models Qwen3\-ASR \(C\) and Qwen3\-Omni \(D\) the baseline performance \(WER, no context,N=0N=0\) is better on the LibriSpeech \(2\.98%, 2\.56% vs\. 3\.66% and 5\.58%, 4\.46% vs\. 7\.82%\) test sets and worse on the Earnings\-21 \(14\.51%, 22\.57% vs\. 13\.52%\) and Yodas \(6\.69%, 7\.97% vs\. 5\.79%\) test sets compared to Whisper large\-v2\. The model VibeVoice\-ASR \(E\) is only slightly better for LibriSpeech test\-clean \(3\.49% vs\. 3\.66%\) and worse for all other test sets \(16\.71% vs\. 13\.52%, 8\.73% vs\. 7\.82% and 9\.63% vs\. 5\.79%\)\. This suggests that the speech LLMs work well for read speech but they do not generalize as well as Whisper on non\-read speech\. Adding more diverse training data could help\.
The BWER performance of the speech LLMs with context and without distractors improves significantly over the baseline\. On the Earnings\-21 and Yodas test sets, E is the best with 9\.39% and 4\.17%, respectively, and on LibriSpeech D is best with 1\.1% and 3\.57% for test\-clean and test\-other\. However, when 250 distractors are added, the performance drops dramatically \(between 39% and 570% relative\)\. Model C is robust against 10 distractors and actually performs better on LibriSpeech test\-clean and Yodas compared to zero distractors\. However, it has a lower score without distractors compared to models D and E\. For 10 distractors and on Earnings\-21 and Yodas, model B is better than all speech LLMs\. When adding more distractors, the gap widens significantly\.
For the models C, D and E the BWER performance without relevant context does not change significantly when adding distractors\.
TABLE II:Results of context biasing list filtering for each test set: Number of utterances \(Utts\), true positives \(TP\), false positives \(FP\), false negatives \(FN\), average number of context biasing words per utterance of the ground truth \(GT\) and after filtering \(Filt\), precision and recall\.Test setUttsTPFPFNAvg GTAvg FiltPrec\. \(%\)Rec\. \(%\)Earnings\-216378131569541\.43\.734\.193\.8LibriSpeech test\-clean726922162111\.31\.585\.198\.8LibriSpeech test\-other8211071723331\.32\.259\.797\.0Yodas636361844173901\.01\.093\.794\.1TABLE III:Results: BWER/UWER/WER in % of the different models on the context biasing text sets*after*filtering the context biasing list\.TestsetC / NApproachQwen3\-ASR\(1\.7B\) \(C\)Qwen3\-Omni\(30B\) \(D\)VibeVoice\-ASR\(9B\) \(E\)Earnings\-21✓012\.49/12\.82/12\.7715\.35/19\.56/18\.9810\.77/12\.45/12\.22✓1012\.54/12\.78/12\.7515\.12/19\.59/18\.9811\.00/12\.46/12\.26✓10011\.63/12\.78/12\.6314\.66/19\.32/18\.6810\.94/12\.16/11\.99✓25011\.97/12\.92/12\.7914\.72/19\.30/18\.6712\.08/13\.08/12\.95LibriSpeechtest\-clean✓06\.57/2\.12/2\.341\.86/1\.91/1\.913\.50/2\.90/2\.93✓106\.35/2\.12/2\.331\.53/1\.91/1\.893\.07/2\.89/2\.90✓1006\.35/2\.14/2\.351\.31/1\.90/1\.873\.61/2\.92/2\.95✓2506\.02/2\.13/2\.321\.31/1\.96/1\.923\.72/2\.94/2\.98LibriSpeechtest\-other✓010\.90/3\.54/3\.985\.13/3\.25/3\.368\.79/5\.64/5\.83✓1010\.81/3\.58/4\.004\.95/3\.27/3\.379\.07/5\.73/5\.93✓10010\.35/3\.60/3\.995\.22/3\.32/3\.4310\.26/5\.81/6\.07✓25010\.62/3\.53/3\.955\.77/3\.43/3\.5710\.53/5\.86/6\.13Yodas✓025\.92/5\.51/5\.918\.61/7\.29/7\.318\.17/7\.80/7\.81✓1025\.73/5\.51/5\.918\.46/7\.04/7\.078\.08/7\.80/7\.81✓10025\.45/5\.49/5\.888\.66/7\.21/7\.248\.30/7\.79/7\.80✓25025\.72/5\.52/5\.928\.71/7\.09/7\.128\.71/7\.81/7\.82Since speech LLMs are sensitive to an increase in distractor count, we filtered the context biassing list\. This was done by prompting Qwen3\-Omni for each audio sample and each word in the context biasing list to predict if the word is present in the audio sample or not\. The results can be seen in Table[II](https://arxiv.org/html/2608.05759#S5.T2)\. With recall between 93\.8% and 98\.8% the model performs well in determining whether a word is present in the audio sample\. For our use case, high recall is more important than precision because only in case a relevant word is present in the prompt, it can improve BWER\. On the other hand, even though the precision is not as high as recall, the average number of context biasing words per utterance after filtering is small \(1\.0\-3\.7\)\.
Afterwards, we gave the filtered context biasing list to the speech LLMs\. The results can be seen in Table[III](https://arxiv.org/html/2608.05759#S5.T3)\. The scores without relevant context did not change significantly; therefore, we omit them\. We see that with filtering there is no dramatic decrease in BWER performance because the speech LLMs receive only a few biasing words\. However, in contrast to before, the BWER performance without distractors is worse than model B on Earnings\-21 and Yodas \(10\.77% vs\. 9\.79% and 8\.17% vs\. 5\.73%\)\.
### V\-ALimitations
The main practical drawback of the speech LLMs is that they require the context to be filtered to avoid dramatic degradation with large lists\. This filtering step is computationally expensive since an additional pass over each audio–word pair is necessary, and a reliable model capable of judging word presence is needed\.
At the same time, speech LLMs are considerably more flexible than the context biasing methods\. Their context is not restricted to a list of words: background descriptions and other free\-form prompts can all be supplied\. Moreover, they can exploit semantic context rather than only surface word matches\. For example, given cues such as Eastern Asia, Pacific Rim, or Indo\-China, a speech LLM can favor Far East over the acoustically similar forest, a form of disambiguation the word\-level biasing methods cannot perform\. Our evaluation isolates the word\-list setting to keep the comparison controlled and therefore does not measure these broader capabilities\.
Finally, the models differ substantially in scale\. While models B and C are similar in size, model B performs better overall\. Even though models D and E are much larger \(30B and 9B\), they perform worse on Earnings\-21 and Yodas\.
## VIConclusion
We compared two Whisper\-based context biasing methods \(A and B\) against three speech LLMs \- Qwen3\-ASR, Qwen3\-Omni, and VibeVoice\-ASR \- for the recognition of rare and new words, evaluating on read \(LibriSpeech\) and non\-read \(Earnings\-21, Yodas\) speech in terms of BWER, UWER, and WER\. The context biasing methods reliably reduce BWER \- up to 70% relative for method A and up to 88% for method B \- while leaving UWER essentially unchanged\. They remain reliable across distractor counts, since irrelevant entries are largely ignored\. Method B attains lower BWER than method A when no distractors are present, but is more sensitive to their addition, with most of the additional errors arising from insertions of a wrongly predicted dynamic token\.
The speech LLMs behave differently\. On read speech they are strong, with Qwen3\-Omni reaching the best BWER on both LibriSpeech conditions and VibeVoice\-ASR the best on Earnings\-21 and Yodas in the distractor\-free setting\. However, they generalize less well to non\-read speech, where even their unbiased baselines trail Whisper, and their biasing behavior is sensitive to prompt composition: BWER degrades sharply \(between 39% and 570% relative\) as distractors accumulate, and it further depends on the order in which words appear in the prompt\. When only a few distractors are present, method B already outperforms all three speech LLMs on Earnings\-21 and Yodas, and the gap widens as the list grows\.
Filtering the biasing list with an auxiliary model \(here Qwen3\-Omni\) recovers much of this loss by reducing each prompt to a few likely\-relevant words at high recall, but it does not close the gap: after filtering, the speech LLMs still trail method B on the non\-read test sets\. Overall, dedicated context biasing methods remain the more robust choice when a clean word list can be supplied and resilience to noisy or long lists matters, whereas speech LLMs offer a more flexible interface at the cost of prompt sensitivity and, in practice, an additional filtering stage\.
## VIIAcknowledgment
The projects on which this research is based were funded by the Horizon research and innovation program of the European Union under grant agreement No 101135798 \(Meetween\) and 101213369 \(DVPS\), and the KIT Campus Transfer GmbH \(KCT\) staff in accordance with the collaboration with Carnegie – AI\. The authors gratefully acknowledge the support\.
## VIIIUse of generative AI tools
Generative AI tools were used in a limited capacity during the preparation of this work\. Specifically, AI\-assisted code completion was employed to support software development tasks\. Language model suggestions were used to refine the clarity and style of the written text\. Additionally, generative AI tools assisted in the enhancement of figures\. All substantive intellectual contributions, including the research design, methodology, analysis, and conclusions, are entirely the authors’ own\.
## References
- \[1\]R\. Ardila, M\. Branson, K\. Davis, M\. Henretty, M\. Kohler, J\. Meyer, R\. Morais, L\. Saunders, F\. M\. Tyers, and G\. Weber\(2019\)Common voice: a massively\-multilingual speech corpus\.arXiv preprint arXiv:1912\.06670\.Cited by:[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p2.1)\.
- \[2\]A\. Bruguier, R\. Prabhavalkar, G\. Pundak, and T\. N\. Sainath\(2019\)Phoebe: pronunciation\-aware contextualization for end\-to\-end speech recognition\.InIEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[3\]Y\. Chu, J\. Xu, X\. Zhou, Q\. Yang, S\. Zhang, Z\. Yan, C\. Zhou, and J\. Zhou\(2023\)Qwen\-audio: advancing universal audio understanding via unified large\-scale audio\-language models\.arXiv preprint arXiv:2311\.07919\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1)\.
- \[4\]M\. Del Rio, N\. Delworth, R\. Westerman, M\. Huang, N\. Bhandari, J\. Palakapilly, Q\. McNamara, J\. Dong, P\. Zelasko, and M\. Jetté\(2021\)Earnings\-21: a practical benchmark for asr in the wild\.arXiv preprint arXiv:2104\.11348\.Cited by:[§IV\-B](https://arxiv.org/html/2608.05759#S4.SS2.p1.1)\.
- \[5\]S\. Dingliwal, M\. Sunkara, S\. Ronanki, J\. Farris, K\. Kirchhoff, and S\. Bodapati\(2023\)Personalization of ctc speech recognition models\.In2022 IEEE Spoken Language Technology Workshop \(SLT\),pp\. 302–309\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[6\]X\. Gong, A\. Lv, Z\. Wang, and Y\. Qian\(2024\)Contextual biasing speech recognition in speech\-enhanced large language model\.\.InINTERSPEECH,Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1)\.
- \[7\]M\. Han, L\. Dong, Z\. Liang, M\. Cai, S\. Zhou, Z\. Ma, and B\. Xu\(2022\)Improving end\-to\-end contextual speech recognition with fine\-grained contextual knowledge selection\.InICASSP 2022\-2022 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 8532–8536\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[8\]S\. Hu, L\. Zhou, S\. Liu, S\. Chen, L\. Meng, H\. Hao, J\. Pan, X\. Liu, J\. Li, S\. Sivasankaran,et al\.\(2024\)Wavllm: towards robust and adaptive speech large language model\.InFindings of the Association for Computational Linguistics: EMNLP 2024,pp\. 4552–4572\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1)\.
- \[9\]K\. Huang, A\. Zhang, Z\. Yang, P\. Guo, B\. Mu, T\. Xu, and L\. Xie\(2023\)Contextualized end\-to\-end speech recognition with contextual phrase prediction network\.InProc\. Interspeech 2023,pp\. 4933–4937\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[10\]R\. Huang, O\. Abdel\-hamid, X\. Li, and G\. Evermann\(2020\)Class lm and word mapping for contextual biasing in end\-to\-end asr\.Interspeech 2020\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[11\]C\. Huber, J\. Hussain, S\. Stüker, and A\. Waibel\(2021\)Instant one\-shot word\-learning for context\-specific neural sequence\-to\-sequence speech recognition\.In2021 IEEE Automatic Speech Recognition and Understanding Workshop \(ASRU\),pp\. 1–7\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1),[§III](https://arxiv.org/html/2608.05759#S3.p4.4)\.
- \[12\]M\. Jain, G\. Keren, J\. Mahadeokar, G\. Zweig, F\. Metze, and Y\. Saraf\(2020\)Contextual rnn\-t for open domain asr\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[13\]A\. Kannan, Y\. Wu, P\. Nguyen, T\. N\. Sainath, Z\. Chen, and R\. Prabhavalkar\(2018\)An analysis of incorporating an external language model into a sequence\-to\-sequence model\.In2018 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 1–5828\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[14\]A\. Kojima\(2022\)A study of biasing technical terms in medical speech recognition using weighted finite\-state transducer\.Acoustical Science and Technology43\(1\),pp\. 66–68\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[15\]E\. Lakomkin, C\. Wu, Y\. Fathullah, O\. Kalinli, M\. L\. Seltzer, and C\. Fuegen\(2024\)End\-to\-end speech recognition contextualization with large language models\.InICASSP 2024\-2024 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 12406–12410\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1)\.
- \[16\]D\. Le, M\. Jain, G\. Keren, S\. Kim, Y\. Shi, J\. Mahadeokar, J\. Chan, Y\. Shangguan, C\. Fuegen, O\. Kalinli,et al\.\(2021\)Contextualized streaming end\-to\-end speech recognition with trie\-based deep biasing and shallow fusion\.arXiv preprint arXiv:2104\.02194\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1),[§IV\-B](https://arxiv.org/html/2608.05759#S4.SS2.p3.1),[§IV\-C](https://arxiv.org/html/2608.05759#S4.SS3.p1.1)\.
- \[17\]X\. Li, S\. Takamichi, T\. Saeki, W\. Chen, S\. Shiota, and S\. Watanabe\(2023\)Yodas: youtube\-oriented dataset for audio and speech\.In2023 IEEE Automatic Speech Recognition and Understanding Workshop \(ASRU\),pp\. 1–8\.Cited by:[§IV\-B](https://arxiv.org/html/2608.05759#S4.SS2.p1.1)\.
- \[18\]V\. Panayotov, G\. Chen, D\. Povey, and S\. Khudanpur\(2015\)Librispeech: an asr corpus based on public domain audio books\.In2015 IEEE international conference on acoustics, speech and signal processing \(ICASSP\),pp\. 5206–5210\.Cited by:[§IV\-B](https://arxiv.org/html/2608.05759#S4.SS2.p1.1)\.
- \[19\]Z\. Peng, J\. Yu, Y\. Chang, Z\. Wang, L\. Dong, Y\. Hao, Y\. Tu, C\. Yang, W\. Wang, S\. Xu,et al\.\(2026\)VIBEVOICE\-asr technical report\.arXiv preprint arXiv:2601\.18184\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p1.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p3.1)\.
- \[20\]N\. Pham, T\. Nguyen, J\. Niehues, M\. Müller, S\. Stüker, and A\. Waibel\(2019\)Very deep self\-attention networks for end\-to\-end speech recognition\.arXiv preprint arXiv:1904\.13377\.Cited by:[§I](https://arxiv.org/html/2608.05759#S1.p1.1)\.
- \[21\]G\. Pundak, T\. N\. Sainath, R\. Prabhavalkar, A\. Kannan, and D\. Zhao\(2018\)Deep context: end\-to\-end contextual speech recognition\.In2018 IEEE spoken language technology workshop \(SLT\),pp\. 418–425\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[22\]A\. Radford, J\. W\. Kim, T\. Xu, G\. Brockman, C\. McLeavey, and I\. Sutskever\(2023\)Robust speech recognition via large\-scale weak supervision\.InInternational conference on machine learning,Cited by:[§I](https://arxiv.org/html/2608.05759#S1.p1.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p2.1)\.
- \[23\]X\. Shi, X\. Wang, Z\. Guo, Y\. Wang, P\. Zhang, X\. Zhang, Z\. Guo, H\. Hao, Y\. Xi, B\. Yang, J\. Xu, J\. Zhou, and J\. Lin\(2026\)Qwen3\-asr technical report\.arXiv preprint arXiv:2601\.21337\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p1.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p3.1)\.
- \[24\]A\. Sriram, H\. Jun, S\. Satheesh, and A\. Coates\(2018\)Cold fusion: training seq2seq models together with language models\.Interspeech 2018\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[25\]Y\. Sudo, Y\. Fujita, A\. Kojima, T\. Mizumoto, and L\. Liu\(2025\)OWSM\-biasing: contextualizing open whisper\-style speech models for automatic speech recognition with dynamic vocabulary\.arXiv preprint arXiv:2506\.09448\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1),[§II](https://arxiv.org/html/2608.05759#S2.p2.1),[§III](https://arxiv.org/html/2608.05759#S3.p4.4)\.
- \[26\]Y\. Sudo, M\. Shakeel, Y\. Fukumoto, Y\. Peng, and S\. Watanabe\(2024\)Contextualized automatic speech recognition with attention\-based bias phrase boosted beam search\.InICASSP 2024\-2024 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 10896–10900\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[27\]C\. Tang, W\. Yu, G\. Sun, X\. Chen, T\. Tan, W\. Li, L\. Lu, Z\. Ma, and C\. Zhang\(2024\)Salmonn: towards generic hearing abilities for large language models\.InInternational Conference on Learning Representations,Vol\.2024,pp\. 16607–16629\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1)\.
- \[28\]Y\. Tang, C\. Tran, X\. Li, P\. Chen, N\. Goyal, V\. Chaudhary, J\. Gu, and A\. Fan\(2020\)Multilingual translation with extensible multilingual pretraining and finetuning\.arXiv preprint arXiv:2008\.00401\.Cited by:[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p2.1)\.
- \[29\]A\. Vaswani\(2017\)Attention is all you need\.Advances in Neural Information Processing Systems\.Cited by:[§I](https://arxiv.org/html/2608.05759#S1.p1.1)\.
- \[30\]I\. Williams, A\. Kannan, P\. S\. Aleksic, D\. Rybach, and T\. N\. Sainath\(2018\)Contextual speech recognition in end\-to\-end neural network systems using beam search\.\.InInterspeech,pp\. 2227–2231\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[31\]C\. Xiao, Z\. Hou, D\. Garcia\-Romero, and K\. J\. Han\(2025\)Contextual asr with retrieval augmented large language model\.InICASSP 2025\-2025 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 1–5\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[32\]J\. Xu, Z\. Guo, H\. Hu, Y\. Chu, X\. Wang, J\. He, Y\. Wang, X\. Shi, T\. He, X\. Zhu,et al\.\(2025\)Qwen3\-omni technical report\.arXiv preprint arXiv:2509\.17765\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p2.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p1.1),[§IV\-A](https://arxiv.org/html/2608.05759#S4.SS1.p3.1)\.
- \[33\]X\. Yang, W\. Kang, Z\. Yao, Y\. Yang, L\. Guo, F\. Kuang, L\. Lin, and D\. Povey\(2024\)PromptASR for contextualized asr with controllable style\.InICASSP 2024\-2024 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 10536–10540\.Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.
- \[34\]F\. Yu, H\. Wang, X\. Shi, and S\. Zhang\(2024\)LCB\-net: long\-context biasing for audio\-visual speech recognition\.InICASSP 2024\-2024 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),Cited by:[§II](https://arxiv.org/html/2608.05759#S2.p1.1)\.Similar Articles
Contrastive Training with LLM-generated Near-Misses for Robust Code-Switching Speech Recognition
Proposes a POI-aware contrastive training framework using LLM-generated near-misses to improve ASR robustness at code-switching regions, achieving consistent error reductions on two benchmarks.
PTC-Bias: Phoneme-Level Temporal Competition for Bias Retrieval and Post-Decoding Correction in Speech LLMs
PTC-Bias is a two-stage framework for speech large language models that uses phoneme-level temporal competition to improve rare-word recognition by efficiently retrieving and correcting bias words, with experiments showing significant gains on LibriSpeech.
COALA: Robust Contextualized Speech-augmented Language Modeling for ASR via Contrastive Regularizer and Biasing Score Estimation
COALA is a robust framework for contextual biasing in automatic speech recognition (ASR) that uses a contrastive regularizer and biasing score estimation to improve recognition of domain-specific entities from large biasing lists. Experiments on LibriSpeech show consistent superior performance.
How Context Attribution Handles What the Model Already Knows
This paper introduces an evaluation protocol with four new metrics and a benchmark dataset to assess context attribution methods for LLMs, showing they fail when context overlaps with training data.
Reference-Based Bias Detection in LLMs via Relative Representations of Hidden States
This paper proposes a reference-based method for detecting bias in large language models by analyzing relative representations of hidden states across model variants, introducing Representational Bias Shift (ΔB) that efficiently correlates with output-level bias changes.