TRIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoning
Summary
TRIS introduces a tri-layer sieve defense for retrieval-augmented generation systems to mitigate knowledge poisoning, reducing attack success rates through cross-embedding clustering, structural filtering, and LLM consistency verification.
View Cached Full Text
Cached at: 09/02/26, 05:52 AM
# TRIS: A Tri-Layer Retrieval Integrity Sieve Against Knowledge Poisoning
Source: [https://arxiv.org/html/2609.00470](https://arxiv.org/html/2609.00470)
###### Abstract
Retrieval\-Augmented Generation \(RAG\) grounds large language models in external corpora, but implicit trust in retrieved documents creates a critical attack surface: PoisonedRAG shows that a handful of crafted passages can dominate dense retrieval and steer generation toward attacker\-chosen answers\. We present the Tri\-Layer Sieve, a middleware defense that sanitizes retrieved evidence through cross\-embedding\-space clustering with an independent judge model, structural filtering of trigger–payload artifacts, and LLM consistency verification\. The design exploits a key weakness of retrieval\-stage poisoning: a single document must satisfy one embedding geometry, one internal Trigger–Payload structure, and one generation objective — rarely all three simultaneously, a fragility that persists even against an adaptive attacker who paraphrases around it\. On Natural Questions, HotpotQA, and MS\-MARCO with Contriever retrieval \(k=50k=50\), the Sieve reduces black\-box Attack Success Rate from 67\.0/87\.0/64\.0% to 3\.0/14\.0/4\.0%, mitigates white\-box HotFlip attacks from∼\\sim74% to 27\.8% on NQ with Layer 3 enabled, and drives poisoned\-document MRR to0\.0000\.000, while restoring clean accuracy from1313–33%33\\%under attack to5858–76%76\\%\. Under an architecture\-aware adversary who paraphrases triggers to evade the structural filter, enabling the consistency layer halves adaptive ASR \(32\.0%→\\to15\.0% on NQ\) while raising clean accuracy by 18 points, at an added latency of∼16\\sim\\\!16–1919s/query under live retrieval\.
## 1Introduction
Large language models are limited by their parametric memory: they cannot be updated continuously, hallucinate plausible\-but\-false statements, and struggle with domain\-specific facts\. Retrieval\-Augmented Generation \(RAG\)\([Lewis et al\., 2020](https://arxiv.org/html/2609.00470#bib.bib1)\)addresses this by grounding outputs in external corpora retrieved at inference time, and is now the de facto architecture for knowledge\-intensive search, open\-domain question answering, and enterprise deployments\([Gao et al\., 2023](https://arxiv.org/html/2609.00470#bib.bib2)\)\.
This advantage introduces a corresponding security flaw: a RAG system consumes mutable external data at inference time and treats every retrieved passage as trustworthy by default\.[Zou et al\. \(2025\)](https://arxiv.org/html/2609.00470#bib.bib13)\(PoisonedRAG\) showed this implicit trust can be exploited — inserting as few as five crafted documents into a corpus such as MS MARCO\([Bajaj et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib7)\)or a Wikipedia snapshot suffices to dominate dense retrieval and force attacker\-chosen misinformation, even when the model knows the correct answer parametrically\. Follow\-up work extends the threat model to jamming\([Shafran et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib14)\), agent memory poisoning\([Chen et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib15)\), backdoor triggers\([Cheng et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib16)\), and benchmarks\([Zhang et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib17)\), establishing retrieval\-stage poisoning as a distinct, under\-defended threat surface\.
Existing defenses are insufficient for two reasons\.*First*, grounding\-verification and hallucination\-detection methods\([Huang et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib21);[Song et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib22)\)act on the*output*of generation rather than the integrity of retrieved evidence, and so cannot prevent the*retrieval dominance*PoisonedRAG exploits\.*Second*, defenses targeting poisoned retrieval — trust\-weighted scoring\([Zhou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib19)\), certified isolate\-and\-aggregate decoding\([Xiang et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib18)\), and query paraphrasing\([Zou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib13)\)— each address only one constraint a poisoned document must satisfy, and can trade sharply against utility on complex queries when tuned aggressively \(Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)\)\.
We argue that retrieval\-stage poisoning succeeds precisely because the attacker must simultaneously satisfy several distinct objectives — dense\-retrieval similarity under a specific encoder, internal coexistence of a retrieval\-optimized*Trigger*and a generation\-optimized*Payload*, and factual plausibility against the LLM’s parametric knowledge — and that defenses should exploit this multi\-objective fragility rather than detect surface artifacts\.
Contributions\.We propose*TRIS*\(the Tri\-Layer Retrieval Integrity Sieve\)111Code, evaluation scripts, and poison\-generation data:[https://github\.com/akibjawad14/tris](https://github.com/akibjawad14/tris), a middleware defense that intercepts retrieved documents between the retriever and the generator and applies three orthogonal filters — cross\-embedding\-space clustering, structural trigger–payload detection, and LLM consistency verification — each targeting one of the three constraints a successful retrieval\-stage poison must simultaneously satisfy\. Against the PoisonedRAG suite on Natural Questions\([Kwiatkowski et al\., 2019](https://arxiv.org/html/2609.00470#bib.bib5)\), HotpotQA\([Yang et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib6)\), and MS\-MARCO\([Bajaj et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib7)\)with Contriever\([Izacard et al\., 2022](https://arxiv.org/html/2609.00470#bib.bib4)\), TRIS reduces black\-box ASR by an order of magnitude on NQ and MS\-MARCO while recovering4141–4545points of clean accuracy over the attacked baseline, and outperforms TrustRAG\([Zhou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib19)\)on MS\-MARCO \(4%4\\%vs\.20%20\\%ASR\); against TrustRAG and RobustRAG\([Xiang et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib18)\)at fair operating points it is competitive rather than dominant, at substantially lower verification cost \(Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)\)\. We further contribute layer\-wise ablations, an ablation isolating Layer 1’s embedding geometry, and an empirical evaluation of architecture\-aware \(Level 1\) adaptive adversaries under live retrieval and a forced\-top worst case\. We use TRIS and the Tri\-Layer Sieve interchangeably\.
## 2Background and Related Work
### 2\.1Retrieval\-Augmented Generation
RAG\([Lewis et al\., 2020](https://arxiv.org/html/2609.00470#bib.bib1)\)augments LLMs with non\-parametric memory: a queryqqis embedded byfQf\_\{Q\}and the top\-kkdocuments in a corpus𝒟\\mathcal\{D\}are retrieved bys\(q,d\)=sim\(fQ\(q\),fD\(d\)\)s\(q,d\)=\\mathrm\{sim\}\(f\_\{Q\}\(q\),f\_\{D\}\(d\)\), after which an LLM conditions on that evidence\. Dense retrievers such as DPR\([Karpukhin et al\., 2020](https://arxiv.org/html/2609.00470#bib.bib3)\)and Contriever\([Izacard et al\., 2022](https://arxiv.org/html/2609.00470#bib.bib4)\)are now standard\. RAG offers stronger factuality than parametric\-only LLMs\([Gao et al\., 2023](https://arxiv.org/html/2609.00470#bib.bib2)\), but trusts retrieved evidence by default, opening a new attack surface\.
### 2\.2Knowledge Poisoning Attacks
Classical data poisoning targets training pipelines\([Geiping et al\., 2021](https://arxiv.org/html/2609.00470#bib.bib8);[Steinhardt et al\., 2017](https://arxiv.org/html/2609.00470#bib.bib11);[Gu et al\., 2019](https://arxiv.org/html/2609.00470#bib.bib12)\)\. Retrieval\-stage poisoning is a newer threat that requires only corpus access\([Zou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib13);[Shafran et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib14);[Edemacu et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib20)\)\.
##### PoisonedRAG\.
[Zou et al\. \(2025\)](https://arxiv.org/html/2609.00470#bib.bib13)give the first systematic demonstration of retrieval\-stage poisoning for LLM\-based RAG\. Each poisoned document isdadv=S⊕Id\_\{\\mathrm\{adv\}\}=S\\oplus I: a retrieval\-optimized TriggerSSand a generation\-optimized PayloadII\. Black\-boxSSrepeats the query; white\-boxSSis gradient\-optimized via HotFlip\([Ebrahimi et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib10)\)or universal triggers\([Wallace et al\., 2019](https://arxiv.org/html/2609.00470#bib.bib9)\)\. Five poisons per query suffice for ASR\>\>90%90\\%\.
### 2\.3Existing Defenses
Output\-side methods\([Song et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib22)\)detect post\-generation mismatches but cannot prevent retrieval dominance\.TrustRAG\([Zhou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib19)\)re\-ranks via a single learned trust score \(with an optional LLM\-consistency check\); effective on simple attacks, weaker on MS\-MARCO \(Section[6](https://arxiv.org/html/2609.00470#S6)\)\. TRIS differs architecturally, not just numerically: three independent off\-the\-shelf checks rather than one learned scorer, each targeting a different constraint, evaluated against an explicit adaptivity taxonomy \(Section[3\.2](https://arxiv.org/html/2609.00470#S3.SS2)\)\. We scope that difference precisely: Layer 2 targets verbatim and near\-duplicate injection — the common case — where TrustRAG has no dedicated structural filter \(ROUGE\-L overlap is its closest analogue\)\. Under paraphrased triggers Layer 2 fires on roughly zero documents per query and TrustRAG’s more lenient check catches more, so we claim Layer 2 for the common attack, not as a paraphrase defense \(Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)\)\.
RobustRAG\([Xiang et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib18)\)gives isolate\-and\-aggregate decoding certified againstkk\-corruption, but strict isolation harms clean accuracy on multi\-hop queries\.Query paraphrasinghelps only marginally, since dense retrievers map paraphrases into similar embedding regions\([Zou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib13)\)\.Perplexity detectionfails because LLM\-generated payloads are often*more*fluent than genuine web text\([Shafran et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib14)\)\.Prompt injection\([Greshake et al\., 2023](https://arxiv.org/html/2609.00470#bib.bib26)\)is related but distinct: our payloads encode a false fact, not an instruction\.
## 3Threat Model
We consider an adversary whose goal is to manipulate the output of a RAG system by injecting adversarial content into its external corpus\. Our threat model follows[Zou et al\. \(2025\)](https://arxiv.org/html/2609.00470#bib.bib13)and generalizes to both structured and unstructured corpora common in real deployments\. Figure[2](https://arxiv.org/html/2609.00470#A1.F2)in Appendix[A](https://arxiv.org/html/2609.00470#A1)traces this attack pipeline end to end for a single example query\.
### 3\.1System and Adversary Model
A RAG pipeline consists of \(i\) a retrieverℳret\\mathcal\{M\}\_\{\\mathrm\{ret\}\}that embedsqqand retrieves the top\-kkfrom corpus𝒟\\mathcal\{D\}, and \(ii\) a generatorℳgen\\mathcal\{M\}\_\{\\mathrm\{gen\}\}that conditions its output on𝒟k\\mathcal\{D\}\_\{k\}\. The generator trusts retrieved evidence by default, matching production deployments over mutable corpora\.
The adversary may \(a\)inject documentsinto𝒟\\mathcal\{D\}, \(b\)craft adversarial triggersthat maximize similarity withq∗q^\{\*\}underℳret\\mathcal\{M\}\_\{\\mathrm\{ret\}\}\(verbatim query repetition in the black\-box setting; HotFlip\([Ebrahimi et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib10)\)gradient optimization in the white\-box setting\), and \(c\)embed malicious payloadsthat expressyadvy\_\{\\mathrm\{adv\}\}as an authoritative encyclopedic claim\. These capabilities instantiate the Split\-and\-Merge construction of[Zou et al\. \(2025\)](https://arxiv.org/html/2609.00470#bib.bib13): a poisoned document concatenates a retrieval\-optimized Trigger with a generation\-optimized Payload, independently optimizing retrieval dominance and output steering\.
The adversary’s goals are to dominate retrieval forq∗q^\{\*\}, override the LLM’s internal knowledge, and induce a targeted outputyadv≠ytruey\_\{\\mathrm\{adv\}\}\\neq y\_\{\\mathrm\{true\}\}\([Zou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib13);[Shafran et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib14)\)\. The defender \(i\) cannot retrainℳret\\mathcal\{M\}\_\{\\mathrm\{ret\}\}orℳgen\\mathcal\{M\}\_\{\\mathrm\{gen\}\}, \(ii\) cannot modify𝒟\\mathcal\{D\}beyond lightweight preprocessing, and \(iii\) must operate as a middleware layer — constraints reflecting deployed enterprise settings\.
### 3\.2Adaptive Adversaries
A reviewer might reasonably ask whether TRIS \(Section[4](https://arxiv.org/html/2609.00470#S4)\) withstands attackers who know about it\. We distinguish four levels of adaptivity, of which the evaluated PoisonedRAG attacks are Level 0:
L0 \(static\): the attacker is unaware of the defense — PoisonedRAG black\-box and white\-box, our headline setting\.L1 \(architecture\-aware\): the attacker knows TRIS is deployed but not its parameters, and may paraphrase rather than repeatqq\(defeating Layer 2\) and write encyclopedic\-style payloads \(degrading Layer 3\); Layer 1’s geometric check still applies\.L2 \(judge\-aware\): the attacker also knows𝒥\\mathcal\{J\}and jointly optimizes for rank underℛ\\mathcal\{R\}*and*majority\-cluster membership under𝒥\\mathcal\{J\}— a conjunction constrained by the geometric independence of the two spaces, and compounded by ensembling or rotating𝒥\\mathcal\{J\}\.L3 \(full white\-box\): the attacker also knows Layer 2’s thresholds andyinty\_\{\\mathrm\{int\}\}, and must craft a payload contradictingyinty\_\{\\mathrm\{int\}\}that the LLM finds equally plausible\.
We now evaluate Level 1 empirically \(Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)\); Levels 2 and 3 remain conceptual only, and closing that gap is the most important remaining limitation of our evaluation \(Section[Limitations](https://arxiv.org/html/2609.00470#Sx1)\)\. A core claim of this work — now supported empirically for Level 1 — is that defeating annn\-layer orthogonal defense requires the attacker to satisfy the conjunction ofnnconstraints in non\-aligned objective landscapes, which substantially enlarges the attack search space even without certified bounds\.
### 3\.3Out of Scope
We exclude \(i\) training\-set poisoning, \(ii\) prompt\-injection attacks where the user is malicious, and \(iii\) attacks that require control of LLM weights\.
## 4The Tri\-Layer Sieve
The Tri\-Layer Sieve is a defense\-in\-depth middleware between the retriever and the generator\. Its central principle is that no retrieved document is trusted at face value: every passage is checked against up to three orthogonal filters before reaching the generator, with the third invoked adaptively rather than on every document\. The three layers target the three constraints that retrieval\-stage poisoning must simultaneously satisfy: retrieval\-side embedding similarity, internal trigger–payload coexistence, and factual alignment with parametric knowledge\.
Figure[1](https://arxiv.org/html/2609.00470#S4.F1)diagrams the resulting pipeline\.
Figure 1:High\-level architecture of the Tri\-Layer Sieve\.The Sieve sits between the retriever and the generator, intercepting candidate documents and forwarding only those that pass the applicable filters \(Layer 3 fires adaptively, not on every document\)\. The defense requires no modification of the retriever or LLM\.### 4\.1Layer 1: Semantic Clustering via Model Diversity
Poisoned documents are optimized against a specific retriever encoder, and adversarial trigger optimization\([Ebrahimi et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib10);[Wallace et al\., 2019](https://arxiv.org/html/2609.00470#bib.bib9)\)exploits the geometry of that encoder rather than true semantic content\. Layer 1 is therefore designed as*majority\-keep in an architecturally independent geometry*: rather than assuming poisons fail to cluster near the query under a second encoder, it assumes nothing about where they land and simply retains the majority cluster\. We frame this as a design property — it drops the requirement that poisons form a tight, separable cluster in the retriever’s own space — not as a source of empirical gain; Appendix[B\.3](https://arxiv.org/html/2609.00470#A2.SS3)tests the geometry directly and finds it is not the differentiating factor\.
Layer 1 re\-embeds the top\-kkretrieved documents with a judge model𝒥\\mathcal\{J\}that is architecturally distinct from the retrieverℛ\\mathcal\{R\}— we use Sentence\-BERTall\-MiniLM\-L6\-v2\([Reimers and Gurevych, 2019](https://arxiv.org/html/2609.00470#bib.bib24)\)\. AfterL2L\_\{2\}\-normalization we run K\-Means with a small cluster countCCand identify the majority cluster; we sweepC∈\{2,3,5\}C\\in\\\{2,3,5\\\}in Section[6](https://arxiv.org/html/2609.00470#S6)and findC=3C=3the default sweet spot\. Poisons typically appear as isolated micro\-clusters, high\-density off\-distribution clusters, or low\-similarity outliers\. Documents outside the majority cluster are dropped, with a fallback retaining all documents when no clear majority exists\.
### 4\.2Layer 2: Content\-Based Structural Filtering
Layer 2 targets the structural footprint of Split\-and\-Merge: Trigger and Payload need not share semantic content, but must coexist in one document, producing lexical irregularities at the prefix\. For each surviving document we compute token\-level Jaccard similarity betweenqqand the firstT=20T=20tokens, bigram/trigram overlap betweenqqand the prefix, and length/repetition patterns; if Jaccard ornn\-gram overlap exceeds a configurable threshold \(we use0\.80\.8\), the document is discarded\. Unlike perplexity filtering — which fails because LLM payloads are highly fluent\([Shafran et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib14)\)— this detects the poison’s*functional decomposition*\. Evasion is cheap at the retrieval stage, however: Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)shows a paraphrased trigger keeps near\-identical rank while falling below the threshold, shifting the burden onto Layers 1 and 3\. Layer 2 costs∼8\\sim\\\!8ms per query\.
### 4\.3Layer 3: LLM Consistency Checking
Layer 3 verifies semantically by prompting an LLM \(the generatorℳgen\\mathcal\{M\}\_\{\\mathrm\{gen\}\}in self\-knowledge mode, or a separate verifier\) to judge each document in isolation, which defeats the dominance effect when many retrieved passages repeat the same poisoned claim; LLMs retain strong parametric priors even when retrieval corrupts the final answer\([Longpre et al\., 2021](https://arxiv.org/html/2609.00470#bib.bib27)\)\. The verifier \(i\) answersqqwithout context to capture its parametric beliefyinty\_\{\\mathrm\{int\}\}, \(ii\) summarizes each document’s claim relevant toqq, and \(iii\) judges it compatible withyinty\_\{\\mathrm\{int\}\}, contradictory, or uncertain; only strong contradictions without evidence of a legitimate update are dropped\. Crucially, if the verifier is not confident — or the call fails or returns a malformed response — the documentfails openand is retained, so Layer 3 can never remove a document it cannot judge, and verifier unavailability degrades it to a no\-op rather than discarding evidence under uncertainty \(this underlies the valid\-response\-only rows in Section[5](https://arxiv.org/html/2609.00470#S5)and Table[4](https://arxiv.org/html/2609.00470#S6.T4)\)\. Two invocation modes exist:*always\-on*\(used for L3 ablation rows\) and*adaptive*, invoked only when Layers 1 and 2 disagree\.
### 4\.4Composition, Default Configuration, and Engineering
The three layers are*complementary in coverage*rather than strictly additive: triggers that evade Layer 1 are typically caught by Layer 2’s prefix overlap check, and payloads that survive Layer 2 trigger contradictions in Layer 3\. Composing all three does not strictly dominate every pairwise combination, however, since Layer 3 occasionally discards clean passages whose phrasing differs from the LLM’s prior\.
We therefore recommenda single default: L1\+L2 with Layer 3 in adaptive mode, invoked only where Layers 1 and 2 disagree\. It attains the lowest black\-box ASR \(3\.0%3\.0\\%on NQ\) at∼12\\sim\\\!12ms/query, and adaptive invocation recovers most of Layer 3’s white\-box and architecture\-aware robustness without paying always\-on latency on every query\. Deployments with a known threat profile should override this: white\-box\-dominant settings useL1\+L3 always\-on\(27\.8%27\.8\\%white\-box ASR\),and settings expecting trigger\-paraphrasing adversaries should enable Layer 3 always\-on instead \(Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)gives the resulting ASR, accuracy, and latency\)\. Abstract numbers correspond to the L1\+L2 default unless stated\. TRIS is a drop\-in Python module wrapping the retrieval call: model\-agnostic, batched\-cache friendly, falling back to unfiltered𝒟k\\mathcal\{D\}\_\{k\}with a logged warning when all documents are filtered\.
## 5Experimental Setup
##### Datasets and attack\.
We evaluate on Natural Questions\([Kwiatkowski et al\., 2019](https://arxiv.org/html/2609.00470#bib.bib5)\), HotpotQA\([Yang et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib6)\), and MS\-MARCO\([Bajaj et al\., 2018](https://arxiv.org/html/2609.00470#bib.bib7)\)\. For each we sample100100target queries; the Poison Factory generates five poisoned passages per query via Split\-and\-Merge\([Zou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib13)\)with a counterfactualyadvy\_\{\\mathrm\{adv\}\}, a poisoning ratio well under1%1\\%of the corpus\. We consider*black\-box LM\-targeted*\(trigger = query repeated with light paraphrasing\) and*white\-box HotFlip*\(gradient\-optimized against Contriever\), withk=50k=50and1010iterations ofM=10M=10queries\.
##### Adaptive\-adversary experiments\.
For Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)we construct three additional Level\-1 attack variants:*trigger\-paraphrased*\(trigger paraphrased rather than repeated verbatim\),*payload\-diversified*\(five independently\-phrased payloads rather than a shared template\), and*full adaptive*\(both combined\)\. The live\-retrieval comparison \(Table[5](https://arxiv.org/html/2609.00470#S6.T5)\) follows the same protocol as above \(n=100n=100,k=50k=50\) on NQ and HotpotQA\. The forced\-top worst case \(Table[7](https://arxiv.org/html/2609.00470#A2.T7)\) pins poisons to the top of context to isolate defense behavior from retrieval competition \(n=30n=30, NQ\)\. The extended injection sweep \(Table[9](https://arxiv.org/html/2609.00470#A2.T9)\) uses a reduced sample \(n=25n=25, NQ\) due to the added query volume at each injection depth\.
##### Fair\-baseline experiments\.
The RobustRAG threshold sweep \(Table[2](https://arxiv.org/html/2609.00470#S6.T2)\) re\-runs the black\-box attack atn=30n=30on both datasets for eachα∈\{0\.1,0\.2,0\.5\}\\alpha\\in\\\{0\.1,0\.2,0\.5\\\}plus majority aggregation; the TrustRAG comparison with its LLM check enabled \(Table[3](https://arxiv.org/html/2609.00470#S6.T3)\) usesn=30n=30on NQ under the two adaptive variants above\. The Layer\-1 judge\-geometry ablation \(Appendix[B\.3](https://arxiv.org/html/2609.00470#A2.SS3)\) runs at full scale \(n=100n=100,k=50k=50, both datasets\), swapping only Layer 1’s embedding model\. Reportedpp\-values are two\-sided two\-proportionzz\-tests over then=100n=100per\-condition query outcomes, treating queries as independent\.
##### Models\.
Contriever\([Izacard et al\., 2022](https://arxiv.org/html/2609.00470#bib.bib4)\)retriever \(HuggingFace, FP16\); Sentence\-BERTall\-MiniLM\-L6\-v2\([Reimers and Gurevych, 2019](https://arxiv.org/html/2609.00470#bib.bib24)\)judge; FAISSIndexFlatIP\([Johnson et al\., 2021](https://arxiv.org/html/2609.00470#bib.bib25)\)onL2L\_\{2\}\-normalized embeddings; GPT\-3\.5\-turbo\([OpenAI, 2023](https://arxiv.org/html/2609.00470#bib.bib28)\)generator \(temperature00\)\. We cross\-check with Llama\-2\-7B\-chat\([Touvron et al\., 2023](https://arxiv.org/html/2609.00470#bib.bib23)\)and obtain consistent trends\. NVIDIA A10G GPUs\. Commercial API calls occasionally failed transiently \(timeouts, rate limits\); Layer 3 fails open on such failures \(Section[4](https://arxiv.org/html/2609.00470#S4)\)\. Where failures affected part of a condition we compute the affected numbers over valid responses only, marking them∼\\sim\(Table[4](https://arxiv.org/html/2609.00470#S6.T4)\); where an entire cell was lost we omit the cell \(Table[10](https://arxiv.org/html/2609.00470#A2.T10)\)\.
##### Baselines\.
\(i\) No Attack \(Clean\); \(ii\) Vanilla RAG \(Attacked\); \(iii\) TrustRAG\([Zhou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib19)\), run in its base configuration — trust\-score re\-ranking with the optional LLM\-consistency check*disabled*— for Table[1](https://arxiv.org/html/2609.00470#S6.T1), and with that check*enabled*for the adaptive comparison in Table[3](https://arxiv.org/html/2609.00470#S6.T3); \(iv\) RobustRAG\([Xiang et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib18)\)with keyword\-based isolate\-and\-aggregate decoding, using majority aggregation for Table[1](https://arxiv.org/html/2609.00470#S6.T1)and swept over the aggregation thresholdα∈\{0\.1,0\.2,0\.5\}\\alpha\\in\\\{0\.1,0\.2,0\.5\\\}in Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)\. Our RobustRAG implementation extracts keywords with a regex\-plus\-stopword heuristic over the retrieved documents, a faithful but simplified stand\-in for the authors’ LLM\-based extraction step; we flag this as a possible source of divergence from their reported numbers\.
##### Metrics\.
ASR\(↓\\downarrow\): attack succeeds if the generated answer containsyadvy\_\{\\mathrm\{adv\}\}\(case\-normalized, article\-stripped exact match\)\.CleanAcc\(↑\\uparrow\): the answer contains the gold string under the same normalization\.Retrieval metricson NQ: Recall@5, Recall@50, Clean MRR \(over benign passages\), Poisoned MRR \(over adversarial passages\)\. PoisonedMRR=1\.000=1\.000means every poison ranks first;0\.0000\.000means full removal\.
### 5\.1Evaluation Protocol
Unless a table caption states otherwise, each cell aggregates1010iterations ofM=10M=10queries \(100100trials\)\. The reduced\-scale tables — Tables[2](https://arxiv.org/html/2609.00470#S6.T2),[3](https://arxiv.org/html/2609.00470#S6.T3),[7](https://arxiv.org/html/2609.00470#A2.T7), and[9](https://arxiv.org/html/2609.00470#A2.T9)— print their ownnnin the caption and are single runs at that scale, not1010\-iteration aggregates; differences of a few points in those tables should not be read as resolved\. Within each iteration we re\-sample queries, re\-generate poisons, and re\-run the pipeline, capturing variance from poison generation, retrieval order, and LLM decoding \(despite temperature00, GPT\-3\.5\-turbo shows residual output variation\)\. Pairwise differences\>3\>\\\!3points are stable across re\-runs; smaller ones are within noise\. Clean Recall@5 of0\.1800\.180reflects our100100\-query Wikipedia subset\.
## 6Results
### 6\.1End\-to\-End Defensive Efficacy
Table[1](https://arxiv.org/html/2609.00470#S6.T1)reports clean accuracy and ASR across all three datasets under the black\-box LM\-targeted attack\. Vanilla RAG is catastrophically vulnerable: ASR ranges from64\.0%64\.0\\%\(MS\-MARCO\) to87\.0%87\.0\\%\(HotpotQA\), and clean accuracy collapses from7474–82%82\\%to1313–33%33\\%under attack\. TRIS restores robustness across all three datasets: ASR drops to3\.0%3\.0\\%on NQ,14\.0%14\.0\\%on HotpotQA, and4\.0%4\.0\\%on MS\-MARCO, while CleanAcc recovers by4141,4545, and4444points respectively over the attacked system and matches or exceeds every baseline on all three datasets\. The residual gap to the no\-attack ceiling is22points on NQ and66on MS\-MARCO, but1616on HotpotQA, where Layer 3 over\-filters multi\-hop evidence\.
##### Comparison with prior defenses\.
The picture is dataset\-dependent and worth reporting honestly\. RobustRAG\([Xiang et al\., 2024](https://arxiv.org/html/2609.00470#bib.bib18)\)attains the lowest HotpotQA ASR \(1\.0%1\.0\\%\) here, but at5\.0%5\.0\\%clean accuracy — the aggressive end of its trade\-off rather than a property of the method; Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)sweeps its threshold and we rest no claim on this point\. TrustRAG\([Zhou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib19)\)is the strongest competitor, matching TRIS on NQ \(2%2\\%vs\.3%3\\%ASR at identical CleanAcc\) and slightly beating it on HotpotQA \(11%11\\%vs\.14%14\\%ASR at57%57\\%vs\.58%58\\%CleanAcc\), with its LLM\-consistency check disabled here \(Table[3](https://arxiv.org/html/2609.00470#S6.T3)enables it\); on MS\-MARCO it lags substantially \(20%20\\%vs\.4%4\\%ASR,1616points lower CleanAcc\)\. Comparable on NQ, marginally behind on HotpotQA at within\-noise margins \(Section[5\.1](https://arxiv.org/html/2609.00470#S5.SS1)\), substantially ahead on MS\-MARCO: we frame the contribution as the strongest*worst\-case*profile across benchmarks, not the best result on each\.
Table 1:End\-to\-end defensive efficacyon NQ, HotpotQA, and MS\-MARCO under PoisonedRAG black\-box LM\-targeted attack \(n=100n=100queries per dataset,k=50k=50, Contriever, GPT\-3\.5\-turbo\)\. The Sieve substantially outperforms TrustRAG on MS\-MARCO \(4%4\\%vs\.20%20\\%ASR\) while matching CleanAcc\. Baselines are shown here in the single configuration used at submission time — TrustRAG with its LLM\-consistency check disabled, RobustRAG with majority aggregation; Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)re\-examines both across their tuning knobs, and those results, not this table alone, are the basis for our comparative claims\.
### 6\.2Fair Baseline Operating Points
Table[1](https://arxiv.org/html/2609.00470#S6.T1)fixes each baseline at one configuration, but both expose a tuning knob that moves them along an ASR–utility frontier, so a single\-point comparison can flatter either system\. Table[2](https://arxiv.org/html/2609.00470#S6.T2)sweeps RobustRAG’s thresholdα\\alpha, and Table[3](https://arxiv.org/html/2609.00470#S6.T3)re\-evaluates TrustRAG with its LLM\-consistency check enabled\. Both are reduced\-scale \(n=30n=30\): enough to locate a frontier, not to resolve a few points\.
Table 2:RobustRAG operating\-point frontier\(black\-box LM\-targeted attack,n=30n=30, reduced scale\)\. Sweeping the keyword\-aggregation thresholdα\\alphamoves RobustRAG along an ASR–utility frontier;α=0\.2\\alpha=0\.2dominates the majority\-aggregation setting on both axes and both datasets\.†The majority setting used in Table[1](https://arxiv.org/html/2609.00470#S6.T1)\. This reduced\-scale re\-run does not reproduce the extreme clean\-accuracy figure of the full\-scale majority row in Table[1](https://arxiv.org/html/2609.00470#S6.T1)\(5\.0%5\.0\\%on HotpotQA\); we report both rather than reconcile them, and base no claim on that figure\.Tuned fairly, RobustRAG is far stronger than Table[1](https://arxiv.org/html/2609.00470#S6.T1)suggests\. Atα=0\.2\\alpha=0\.2it reaches6\.7%6\.7\\%/36\.7%36\.7\\%\(ASR/CleanAcc\) on NQ and3\.3%3\.3\\%/66\.7%66\.7\\%on HotpotQA — competitive with TRIS on NQ and better on both axes on HotpotQA\.We therefore do not claim ASR dominance over a fairly\-tuned RobustRAG\.Two caveats cut in opposite directions: these aren=30n=30against TRIS’sn=100n=100, and our RobustRAG uses heuristic rather than LLM\-based keyword extraction \(Section[5](https://arxiv.org/html/2609.00470#S5)\)\.
What does separate the systems at comparable ASR is verification cost: TRIS’s L1\+L2 default needs one MiniLM pass and one generation call \(∼0\.35\\sim\\\!0\.35s/query\), against RobustRAG’s per\-document isolation \(3131–3636calls/query\) — a∼36×\\sim\\\!36\\timesreduction\. This is regime\-specific, not a uniform win: under paraphrased triggers TRIS needs Layer 3, whose cost returns to that range \(Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)\)\.
TrustRAG’s optional LLM\-consistency check — its closest analogue to Layer 3 — is likewise disabled in Table[1](https://arxiv.org/html/2609.00470#S6.T1)\. Enabled, under the adaptive attacks of Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5), the two systems are indistinguishable atn=30n=30: every margin is one query wide, with TrustRAG marginally ahead on trigger\-paraphrased poisons \(Table[3](https://arxiv.org/html/2609.00470#S6.T3)\)\.
Table 3:TRIS vs\. TrustRAG with its LLM\-consistency check enabled\(n=30n=30, NQ\)\.‡Unlike Table[1](https://arxiv.org/html/2609.00470#S6.T1), TrustRAG runs with its optional LLM check on\. The adaptive poison set differs from Table[7](https://arxiv.org/html/2609.00470#A2.T7), so rows are not comparable across the two\. Atn=30n=30one query is3\.33\.3points: every margin here is one query wide\.We therefore withdraw any claim of an adaptive\-ASR advantage over a fairly\-configured TrustRAG, and rest the comparison on architecture instead: a dedicated structural layer, an explicit fail\-open verdict in Layer 3, and a modular composition whose layers toggle independently at known cost\.
A further ablation isolates how much Layer 1’s independent embedding geometry contributes\. Swapping only that space — MiniLM versus the retriever’s own Contriever,n=100n=100, both datasets — leaves ASR statistically unchanged \(NQ32\.0%32\.0\\%vs\.33\.0%33\.0\\%,p=0\.88p=0\.88; HotpotQA44\.0%44\.0\\%vs\.53\.0%53\.0\\%,p=0\.20p=0\.20\), whereas Layer 2 accounts for the large effect \(p<10−7p<10^\{\-7\}; Appendix[B\.3](https://arxiv.org/html/2609.00470#A2.SS3)\)\. We report this as a negative result about our own design rationale: the independent geometry is a robustness property — it drops the assumption that poisons form a separable cluster in the retriever’s space — not the source of the measured gain\.
### 6\.3Retrieval Dynamics
To understand*how*the Sieve works, Table[6](https://arxiv.org/html/2609.00470#A2.T6)\(Appendix[B\.1](https://arxiv.org/html/2609.00470#A2.SS1)\) reports retriever\-level metrics on NQ\. Vanilla poisoning eliminates Recall@5 and drives PoisonedMRR to its maximum of1\.0001\.000— a poison at rank 1 for every query\. The Sieve fully inverts this: Recall@5 and Clean MRR return to clean\-corpus baselines and PoisonedMRR falls to0\.0000\.000\. Recall@50 is unchanged throughout, confirming that poisons remain in the candidate pool but no longer reach the visible context: the Sieve reorders rather than discards\. TrustRAG achieves the same retriever\-side outcome on NQ, consistent with its strong NQ end\-to\-end numbers; the Sieve’s advantage emerges downstream on harder datasets\.
### 6\.4Layer Ablation
Table[4](https://arxiv.org/html/2609.00470#S6.T4)isolates the contribution of each layer on NQ under both black\-box and white\-box attacks\. Three findings stand out\.
##### Layer 2 dominates black\-box\.
Alone, the structural filter reduces ASR from67%67\\%to4%4\\%, capturing the lexical signature of Split\-and\-Merge prefixes\. This is consistent with the design intuition: black\-box triggers repeat the query verbatim, producing prefix overlap that is trivially detected\.
##### No single layer suffices for white\-box\.
Against HotFlip, Layer 2 alone yields little benefit \(∼71%\\sim\\\!71\\%\), since gradient\-optimized triggers evade lexical overlap; only L1\+L3 reduces substantially \(27\.8%27\.8\\%\)\. Defeating white\-box attacks therefore requires both geometric diversity \(Layer 1 disrupts the gradient\-targeted geometry\) and parametric verification \(Layer 3 catches payload contradictions regardless of trigger surface form\)\.
##### Full system trades black\-box for white\-box\.
Full L1\+L2\+L3 matches L1\+L3’s27\.8%27\.8\\%white\-box ASR but raises black\-box ASR \(9\.0%9\.0\\%vs\.3\.0%3\.0\\%for L1\+L2\) — an over\-filtering effect, as Layer 3 occasionally discards clean passages whose phrasing differs from the LLM’s prior\. In practice L1\+L2 is preferable for black\-box\-dominant threat models, with L3 enabled adaptively when white\-box adversaries are expected \(Section[7](https://arxiv.org/html/2609.00470#S7)\)\.
Table 4:Layer ablation on NQ \(k=50k=50\)\.BB = black\-box LM\-targeted; WB = white\-box HotFlip\.∗WB rows marked∼\\simare computed over valid responses only \(see Section[5](https://arxiv.org/html/2609.00470#S5)\)\. L2 alone dominates black\-box; only combinations including L1 and L3 meaningfully reduce white\-box ASR\. Full system trades black\-box ASR for white\-box robustness due to over\-filtering by Layer 3\.
##### HotpotQA supplementary ablation\.
On multi\-hop HotpotQA, L2\+L3 attains the lowest black\-box ASR \(11\.0%11\.0\\%\), just below L1\+L2 \(12\.0%12\.0\\%\), while the full system rises to31\.0%31\.0\\%— again over\-filtering when L3 is applied across multi\-hop evidence\. We treat this as a tunable deployment choice, not a fundamental limitation\.
##### Layer orthogonality\.
Three observations from Table[4](https://arxiv.org/html/2609.00470#S6.T4)support orthogonal rather than redundant coverage\. L1 alone leaves33%33\\%black\-box ASR and L2 alone4%4\\%, yet L1\+L2 reaches3%3\\%— L1 catches paraphrasing poisons L2 misses\. In the white\-box regime L1 alone leaves57\.0%57\.0\\%and L3 alone leaves∼71%\\sim\\\!71\\%, yet L1\+L3 reaches27\.8%27\.8\\%, so their catches barely overlap\. And Full \(9%9\\%\) is*worse*than L1\+L2 \(3%3\\%\): the layers are not strictly additive, because L3’s false\-positive rate on clean documents matters\. They therefore cover distinct failure modes while interacting in false\-positive profiles — supporting the recommended configuration over a naive “run all three\.”
### 6\.5Adaptive Adversary Evaluation
Section[3\.2](https://arxiv.org/html/2609.00470#S3.SS2)defines four levels of attacker adaptivity\. This section empirically evaluates Level 1 \(architecture\-aware\); Levels 2 \(judge\-aware\) and 3 \(full white\-box\) remain conceptual only, and implementing them is planned future work\.
#### 6\.5\.1Paraphrasing evades Layer 2 without sacrificing retrieval rank
Letting the live Contriever retriever rank poisons \(k=50k=50,n=100n=100\), paraphrasing the trigger costs the attacker almost nothing at retrieval:4\.974\.97of55poisons still reach the top\-5050on NQ \(versus5\.005\.00verbatim\) and5\.005\.00of55on HotpotQA, and undefended ASR does not consistently drop \(NQ55\.0%→45\.0%55\.0\\%\\\!\\to\\\!45\.0\\%; HotpotQA70\.0%→77\.0%70\.0\\%\\\!\\to\\\!77\.0\\%\)\. Paraphrasing is thus a free evasion of Layer 2’s lexical check, shifting the burden to Layers 1 and 3\. Layer 1 alone recovers much of the loss \(45\.0%→32\.0%45\.0\\%\\\!\\to\\\!32\.0\\%on NQ,77\.0%→44\.0%77\.0\\%\\\!\\to\\\!44\.0\\%on HotpotQA\), matching the Layer\-3\-off rows of Table[5](https://arxiv.org/html/2609.00470#S6.T5)\. That32\.0%32\.0\\%is within noise of Layer 1’s33\.0%33\.0\\%verbatim\-trigger ASR in Table[4](https://arxiv.org/html/2609.00470#S6.T4), so its geometric check is largely insensitive to surface paraphrasing, as its design predicts\. A verbatim\-trigger sieve reproduces Table[1](https://arxiv.org/html/2609.00470#S6.T1)’s defended NQ ASR exactly \(3\.0%3\.0\\%\), though the undefended baseline in this live\-retrieval setup \(NQ55\.0%55\.0\\%, HotpotQA70\.0%70\.0\\%\) differs somewhat from Table[1](https://arxiv.org/html/2609.00470#S6.T1)’s static baseline \(NQ67\.0%67\.0\\%, HotpotQA87\.0%87\.0\\%\), likely reflecting live vs\. cached retrieval\.
#### 6\.5\.2Enabling Layer 3 recovers the loss on all three axes at once
Holding Layer 1 and Layer 2 fixed across paired runs \(Layer 1 removes17\.0517\.05\(NQ\) /14\.4714\.47\(HotpotQA\) documents per query on average; Layer 2 removes0\.010\.01/0\.150\.15\), we toggle Layer 3 alone against paraphrased\-trigger poisons \(Table[5](https://arxiv.org/html/2609.00470#S6.T5)\)\.
Table 5:Layer 3 under live retrieval\.Paraphrased\-trigger poisons, Contriever,k=50k=50,n=100n=100; Layers 1–2 held fixed across the paired runs, so differences are attributable to Layer 3 alone\. “Surv\./5” is the mean number of the 5 injected poisons still in context after filtering\. Enabling Layer 3 improves all three columns simultaneously on both datasets\.This is not an ASR\-for\-utility trade: on NQ, ASR roughly halves while clean accuracy rises1818points\. The honest cost is latency — Layer 3’s per\-document verdicts add∼16\\sim\\\!16–1919s/query under live retrieval against a∼0\.35\\sim\\\!0\.35s L1\+L2 baseline — though adaptive invocation, firing only when Layers 1 and 2 disagree, keeps this occasional \(21%21\\%of HotpotQA queries\)\. We therefore position Layer 3 as an optional high\-assurance layer rather than part of the black\-box\-dominant default \(Section[4](https://arxiv.org/html/2609.00470#S4)\)\.
#### 6\.5\.3Forced\-top worst case
As a harsher upper bound we pin poisons to the top of context, removing retrieval competition, and ablate Level 1 adaptivity into*payload\-diversified*,*trigger\-paraphrased*, and*full adaptive*variants against the static baseline \(n=30n=30, NQ; Table[7](https://arxiv.org/html/2609.00470#A2.T7), Appendix[B\.2](https://arxiv.org/html/2609.00470#A2.SS2)\)\. Layer 2 neutralizes the static and payload\-diversified attacks \(10\.0%10\.0\\%\) at near\-zero cost, since neither alters the prefix it inspects; paraphrasing the trigger evades it \(57\.0%57\.0\\%under L1\+L2\) but forces a claim contradicting the model’s prior, which Layer 3 catches \(40\.0%40\.0\\%and33\.0%33\.0\\%\)\.
### 6\.6Injection Ratio and Hyperparameter Sweeps
Varying poisons per query from11to55on NQ \(Table[8](https://arxiv.org/html/2609.00470#A2.T8), Appendix[B\.4](https://arxiv.org/html/2609.00470#A2.SS4)\), baseline ASR climbs from0%0\\%to66%66\\%while the Sieve holds below10%10\\%; extending to66–2020poisons \(n=25n=25; Table[9](https://arxiv.org/html/2609.00470#A2.T9)\) leaves TRIS ASR flat at4\.0%4\.0\\%\. Because Layers 1 and 2 filter independently rather than by majority vote, denser poisoning cannot tip the defense the way it could tip a voting aggregator\. Full\-scale replication remains future work \(Section[Limitations](https://arxiv.org/html/2609.00470#Sx1)\)\.
Sweeping retrieval depthk∈\{5,10,20,50\}k\\in\\\{5,10,20,50\\\}against cluster countC∈\{2,3,5\}C\\in\\\{2,3,5\\\}\(Table[10](https://arxiv.org/html/2609.00470#A2.T10), Appendix[B\.5](https://arxiv.org/html/2609.00470#A2.SS5)\), the defense is unstable atk=5k=5\(ASR8585–93%93\\%, clean accuracy99–17%17\\%\) because K\-Means partitions on too few candidates are unreliable\. Fromk=10k=10onward ASR stabilizes at33–4%4\\%and clean accuracy rises monotonically to78%78\\%atk=50k=50;C=3C=3is our default, andC=5C=5performs comparably on this sweep — we fixC=3C=3as the more conservative setting\.
### 6\.7Latency
Layer 2 adds∼8\\sim\\\!8ms/query and Layer 1∼13\\sim\\\!13ms; Layer 3 dominates at∼2\.9\\sim\\\!2\.9s/query, making always\-on \(∼15\\sim\\\!15s\) acceptable for high\-risk queries but not high\-throughput search — under live retrieval its added cost is similar \(∼16\\sim\\\!16–1919s/query; Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)\)\. Appendix[C](https://arxiv.org/html/2609.00470#A3)traces one successful defense and one failure, showing where the residual HotpotQA ASR originates\.
## 7Discussion
##### Adaptive attacks on the judge\.
Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)closes the Level 1 gap empirically; judge\-awareness and white\-box access remain conceptual\. Against a judge\-aware attacker \(Level 2\) Layer 1 becomes a single point of failure; ensembling diverse judges and rotating𝒥\\mathcal\{J\}are the natural countermeasures, and since Layer 1’s embedding\-space independence alone does not measurably differentiate attack outcomes \(Appendix[B\.3](https://arxiv.org/html/2609.00470#A2.SS3)\), ensembling multiple judges is the more promising direction\. A Level 3 adversary also knows Layer 2’s thresholds and could search for payloads at the decision boundary ofyinty\_\{\\mathrm\{int\}\}; randomizing that threshold per query and ensembling verifiers are analogous responses, both future work\.
##### Zero\-Trust Retrieval\.
TRIS treats retrieved evidence as untrusted input requiring active validation, analogous to a network firewall — which is also why it sits in middleware rather than retraining the retriever: adversarial training is expensive, must be redone as attacks emerge, and is incompatible with third\-party embedding APIs, whereas middleware is corpus\-, model\-, and vendor\-agnostic\. Complementary modules could address prompt injection\([Greshake et al\., 2023](https://arxiv.org/html/2609.00470#bib.bib26)\), privacy leakage, and content moderation under the same principle, keeping the utility–robustness trade\-off explicit through adaptive invocation\.
## 8Conclusion
We presented TRIS, a three\-layer middleware defense against retrieval\-stage poisoning, each layer attacking a distinct constraint a poisoned document must satisfy\. It reduces black\-box ASR by an order of magnitude on NQ and MS\-MARCO, mitigates white\-box HotFlip from∼74%\\sim\\\!74\\%to27\.8%27\.8\\%with Layer 3 enabled, and drives poisoned MRR to zero, while recovering4141–4545points of clean accuracy over the attacked baseline\. Against fairly\-tuned TrustRAG and RobustRAG it is competitive rather than dominant \(Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)\); what distinguishes it is a strong worst\-case profile, far lower verification cost in the common attack regime, and graceful degradation as attackers adapt\.
## Limitations
##### No empirical evaluation of judge\-aware or white\-box adversaries\.
A remaining limitation of this work is that our headline numbers \(Section[6](https://arxiv.org/html/2609.00470#S6)\) are against static PoisonedRAG attacks \(Level 0 in Section[3\.2](https://arxiv.org/html/2609.00470#S3.SS2)\)\. Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5)now provides an empirical evaluation of Level 1 \(architecture\-aware\) adversaries — paraphrased triggers and diversified payloads, under live retrieval and a forced\-top worst case — showing that Layer 3 recovers most of the robustness that paraphrasing costs Layer 2\. Levels 2 \(judge\-aware\) and 3 \(full white\-box\) remain conceptual only \(Section[3\.2](https://arxiv.org/html/2609.00470#S3.SS2)\); implementing them is planned future work\. An adversary who optimizes triggers to land in the majority cluster of the judge model, avoid prefix overlap with the query, and produce payloads compatible with the LLM’s parametric prior would represent the worst case for TRIS\. Whether such an attacker can simultaneously satisfy all three constraints — and how much trigger\-and\-payload search space they would need to explore — remains an open empirical question for Levels 2–3 that follow\-up work should address with adaptive\-attack benchmarks of the kind suggested by[Zhang et al\. \(2025\)](https://arxiv.org/html/2609.00470#bib.bib17)\.
##### Generator dependency and Layer 3 coupling\.
Layer 3’s contradiction detection is only as reliable as the verifier’s own parametric knowledge ofytruey\_\{\\mathrm\{true\}\}— a knowledge\-dependency that is a structural property of the design, not an artifact of any one model\. Our headline results use GPT\-3\.5\-turbo as both the generator and \(in Layer 3 always\-on mode\) the verifier\. This couples the defense’s measured efficacy to the parametric knowledge of a specific commercial model\. We tested this failure mode directly on a slice of1010questions about clearly post\-cutoff events the generator does not know: Layer 3 abstained on all1010\(fail\-open\), no clean document was wrongly dropped \(00of5050\), and Layers 1–2 still removed every injected poison \(3030of3030\)\. Layer 3 therefore degrades to a no\-op rather than to a source of false positives when its parametric prior is absent, and the structural layers carry the defense unaided — consistent with the L1\+L2 row of Table[4](https://arxiv.org/html/2609.00470#S6.T4), which reaches3\.0%3\.0\\%black\-box ASR with Layer 3 disabled entirely\.
##### Scale and corpus diversity\.
We evaluate on100100\-query subsets of NQ, HotpotQA, and MS\-MARCO\. Recall@5 on the clean baseline is0\.1800\.180, reflecting the subset rather than full\-corpus retrieval\. Scaling to full corpora \(BEIR, full MS\-MARCO, enterprise document stores\) is essential for characterizing false\-positive rates in production and is the most pressing follow\-up\.
##### Statistical reporting\.
Tables report point estimates over1010iterations×\\times1010queries\. Differences of≤3\\leq\\\!3percentage points \(e\.g\., Sieve vs\. TrustRAG on HotpotQA\) may be within iteration\-to\-iteration noise; we frame those comparisons as “comparable” rather than wins\.
##### Cost of Layer 3\.
The LLM consistency layer adds∼2\.9\\sim\\\!2\.9s/query and is the dominant latency cost\. Distilling LLM\-as\-judge behavior into a smaller specialized verifier is the obvious next step; the adaptive\-invocation mode is a stopgap\.
##### Injection\-ratio coverage\.
Our injection sweep covers11–55adversarial documents per query at full scale \(n=100n=100\), where the baseline ASR climbs from0%0\\%to66%66\\%and the Sieve holds below10%10\\%\. The Sieve’s ASR is non\-monotonic in this range \(8%→10%→6%→8%8\\%\\to 10\\%\\to 6\\%\\to 8\\%\), which we attribute to iteration noise at small sample sizes\. We extend this range to66–2020adversarial documents per query on a reduced\-scale NQ subsample \(n=25n=25; Table[9](https://arxiv.org/html/2609.00470#A2.T9)\): TRIS ASR stays flat at4\.0%4\.0\\%and CleanAcc remains near46%46\\%, supporting the“robustness to denser poisoning” hypothesis\. Full\-scale replication of this extended range, and coverage of HotpotQA and MS\-MARCO, remains future work\.
##### Reduced\-scale baseline comparisons\.
The fair\-baseline re\-evaluations that our comparative claims now rest on — the RobustRAG threshold sweep \(Table[2](https://arxiv.org/html/2609.00470#S6.T2)\) and the TrustRAG comparison with its LLM check enabled \(Table[3](https://arxiv.org/html/2609.00470#S6.T3)\) — were run atn=30n=30, againstn=100n=100for Table[1](https://arxiv.org/html/2609.00470#S6.T1), and as single runs rather than1010\-iteration aggregates\. They are adequate to locate each baseline’s operating\-point frontier, which is what they are used for, but not to resolve differences of a few points; then=30n=30RobustRAG majority row also does not reproduce the full\-scale majority row in Table[1](https://arxiv.org/html/2609.00470#S6.T1), and we have not been able to reconcile the two\. Re\-running both baselines at full scale is the first item of follow\-up work\. We note the direction of the resulting bias honestly: these are the comparisons in which the baselines look*strongest*relative to TRIS, so under\-powering them is not a limitation that flatters us\.
##### No formal guarantees\.
TRIS is heuristic\. It does not provide certified robustness in the sense of[Xiang et al\. \(2024\)](https://arxiv.org/html/2609.00470#bib.bib18)and we make no formal claim about adversarial bounds\. Combining TRIS’s empirical strength with certified isolate\-and\-aggregate decoding is a promising direction — e\.g\., applying TRIS as a pre\-filter and RobustRAG as the certified aggregator\.
##### Partial\-iteration results\.
The white\-box L1\+L3 and full\-system numbers in Table[4](https://arxiv.org/html/2609.00470#S6.T4)are averaged over99of1010iterations, because one backup job did not complete \(unrelated to the transient API failures in Section[5](https://arxiv.org/html/2609.00470#S5)\) and we did not have the compute budget to re\-run it\. Judging by the iteration\-to\-iteration spread elsewhere in our runs, we expect these two numbers to move by at most11–22percentage points; we report them as partial rather than complete, and no claim in this paper turns on a margin that small\.
## Ethical Considerations
This work studies a defense against an existing, publicly documented attack class \(PoisonedRAG and its follow\-ups\)\. We do not introduce new attack capabilities\. The defense is designed to be deployable as a middleware module by RAG operators without requiring retriever or generator retraining, lowering the barrier to robust deployment\. Our experiments use publicly available datasets \(NQ, HotpotQA, MS\-MARCO\) and do not involve human subjects or personally identifiable information\. We acknowledge a dual\-use consideration: detailed descriptions of attacker design \(Section 3\) inform defenders but could in principle aid attackers; however, all attack details follow[Zou et al\. \(2025\)](https://arxiv.org/html/2609.00470#bib.bib13)and are already public\. We believe the net effect of clearer, comparable defense evaluations is positive for the security of deployed RAG systems\.
## Acknowledgments
This work is based upon the work supported by the National Center for Transportation Cybersecurity and Resiliency \(TraCR\) \(a U\.S\. Department of Transportation National University Transportation Center\) headquartered at Clemson University, Clemson, South Carolina, USA\. It was also supported in part by NIST grant number 60NANB24D143\. Any opinions, findings, conclusions, and recommendations expressed in this material are those of the author\(s\) and do not necessarily reflect the views of NIST, TraCR, and the U\.S\. Government assumes no liability for the contents or use thereof\.
This work used the Delta system at the National Center for Supercomputing Applications \[award OAC 2005572\] through allocation CIS251331 from the Advanced Cyberinfrastructure Coordination Ecosystem: Services & Support \(ACCESS\) program, which is supported by National Science Foundation grants \#2138259, \#2138286, \#2138307, \#2137603, and \#2138296\. The authors also acknowledge High Performance Computing at The University of Texas at Dallas \(HPC@UTD\) for providing computing resources\.
Disclaimer: This paper identifies certain equipment, instruments, software, or materials to adequately describe the experimental procedure\. Such identification is not intended to imply recommendation or endorsement of any product or service by NIST, nor is it intended to imply that the materials or equipment identified are necessarily the best available for the purpose\.
## References
- Bajajet al\.\(2018\)P\. Bajaj, D\. Campos, N\. Craswell, L\. Deng, J\. Gao, X\. Liu, R\. Majumder, A\. McNamara, B\. Mitra, T\. Nguyen, M\. Rosenberg, X\. Song, A\. Stoica, S\. Tiwary, and T\. WangMS marco: a human generated machine reading comprehension dataset\.External Links:1611\.09268,[Link](https://arxiv.org/abs/1611.09268)Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p2.1),[§1](https://arxiv.org/html/2609.00470#S1.p5.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px1.p1.1)\.
- Chenet al\.\(2024\)Z\. Chen, Z\. Xiang, C\. Xiao, D\. Song, and B\. LiAgentPoison: red\-teaming LLM agents via poisoning memory or knowledge bases\.Advances in Neural Information Processing Systems37,pp\. 130185–130213\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p2.1)\.
- Chenget al\.\(2024\)P\. Cheng, Y\. Ding, T\. Ju, Z\. Wu, W\. Du, P\. Yi, Z\. Zhang, and G\. LiuTrojanRAG: retrieval\-augmented generation can be backdoor driver in large language models\.arXiv preprint arXiv:2405\.13401\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p2.1)\.
- Ebrahimiet al\.\(2018\)J\. Ebrahimi, A\. Rao, D\. Lowd, and D\. DouHotFlip: white\-box adversarial examples for text classification\.InProceedings of the 56th Annual Meeting of the Association for Computational Linguistics \(Volume 2: Short Papers\),I\. Gurevych and Y\. Miyao \(Eds\.\),Melbourne, Australia,pp\. 31–36\.External Links:[Link](https://aclanthology.org/P18-2006/),[Document](https://dx.doi.org/10.18653/v1/P18-2006)Cited by:[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.SSS0.Px1.p1.1),[§3\.1](https://arxiv.org/html/2609.00470#S3.SS1.p2.1),[§4\.1](https://arxiv.org/html/2609.00470#S4.SS1.p1.1)\.
- Edemacuet al\.\(2025\)K\. Edemacu, V\. M\. Shashidhar, M\. Tuape, D\. Abudu, B\. Jang, and J\. W\. KimDefending against knowledge poisoning attacks during retrieval\-augmented generation\.arXiv preprint arXiv:2508\.02835\.Cited by:[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.p1.1)\.
- Gaoet al\.\(2023\)Y\. Gao, Y\. Xiong, X\. Gao, K\. Jia, J\. Pan, Y\. Bi, Y\. Dai, J\. Sun, M\. Wang, and H\. WangRetrieval\-augmented generation for large language models: a survey\.arXiv preprint arXiv:2312\.10997\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p1.1),[§2\.1](https://arxiv.org/html/2609.00470#S2.SS1.p1.1)\.
- Geipinget al\.\(2021\)J\. Geiping, L\. H\. Fowl, W\. R\. Huang, W\. Czaja, G\. Taylor, M\. Moeller, and T\. GoldsteinWitches’ brew: industrial scale data poisoning via gradient matching\.InInternational Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=01olnfLIbD)Cited by:[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.p1.1)\.
- Greshakeet al\.\(2023\)K\. Greshake, S\. Abdelnabi, S\. Mishra, C\. Endres, T\. Holz, and M\. FritzNot what you’ve signed up for: compromising real\-world LLM\-integrated applications with indirect prompt injection\.InProceedings of the 16th ACM workshop on artificial intelligence and security,pp\. 79–90\.Cited by:[§2\.3](https://arxiv.org/html/2609.00470#S2.SS3.p2.1),[§7](https://arxiv.org/html/2609.00470#S7.SS0.SSS0.Px2.p1.1)\.
- Guet al\.\(2019\)T\. Gu, K\. Liu, B\. Dolan\-Gavitt, and S\. GargBadNets: evaluating backdooring attacks on deep neural networks\.IEEE Access7,pp\. 47230–47244\.Cited by:[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.p1.1)\.
- Huanget al\.\(2024\)L\. Huang, W\. Yu, W\. Ma, W\. Zhong, Z\. Feng, H\. Wang, Q\. Chen, W\. Peng, X\. Feng, B\. Qin, and T\. LiuA survey on hallucination in large language models: principles, taxonomy, challenges, and open questions\.ACM Transactions on Information Systems\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p3.1)\.
- Izacardet al\.\(2022\)G\. Izacard, M\. Caron, L\. Hosseini, S\. Riedel, P\. Bojanowski, A\. Joulin, and E\. GraveUnsupervised dense information retrieval with contrastive learning\.Transactions on Machine Learning Research \(TMLR\)\.Cited by:[Figure 2](https://arxiv.org/html/2609.00470#A1.F2),[§1](https://arxiv.org/html/2609.00470#S1.p5.1),[§2\.1](https://arxiv.org/html/2609.00470#S2.SS1.p1.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px4.p1.1)\.
- Johnsonet al\.\(2021\)J\. Johnson, M\. Douze, and H\. JégouBillion\-scale similarity search with GPUs\.InIEEE Transactions on Big Data,Cited by:[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px4.p1.1)\.
- Karpukhinet al\.\(2020\)V\. Karpukhin, B\. Oğuz, S\. Min, P\. Lewis, L\. Wu, S\. Edunov, D\. Chen, and W\. YihDense passage retrieval for open\-domain question answering\.InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),Cited by:[Figure 2](https://arxiv.org/html/2609.00470#A1.F2),[§2\.1](https://arxiv.org/html/2609.00470#S2.SS1.p1.1)\.
- Kwiatkowskiet al\.\(2019\)T\. Kwiatkowski, J\. Palomaki, O\. Redfield, M\. Collins, A\. Parikh, C\. Alberti, D\. Epstein, I\. Polosukhin, J\. Devlin, K\. Lee,et al\.Natural questions: a benchmark for question answering research\.Transactions of the Association for Computational Linguistics7,pp\. 453–466\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p5.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px1.p1.1)\.
- Lewiset al\.\(2020\)P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel, S\. Riedel, and D\. KielaRetrieval\-augmented generation for knowledge\-intensive NLP tasks\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p1.1),[§2\.1](https://arxiv.org/html/2609.00470#S2.SS1.p1.1)\.
- Longpreet al\.\(2021\)S\. Longpre, K\. Perisetla, A\. Chen, N\. Ramesh, C\. DuBois, and S\. SinghEntity\-based knowledge conflicts in question answering\.InProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing,M\. Moens, X\. Huang, L\. Specia, and S\. W\. Yih \(Eds\.\),Online and Punta Cana, Dominican Republic,pp\. 7052–7063\.External Links:[Link](https://aclanthology.org/2021.emnlp-main.565/),[Document](https://dx.doi.org/10.18653/v1/2021.emnlp-main.565)Cited by:[§4\.3](https://arxiv.org/html/2609.00470#S4.SS3.p1.1)\.
- OpenAI \(2023\)OpenAIGPT\-3\.5 Turbo Fine\-Tuning and API Updates\.Note:OpenAI BlogAccessed: 2026\-08\-31External Links:[Link](https://openai.com/index/gpt-3-5-turbo-fine-tuning-and-api-updates/)Cited by:[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px4.p1.1)\.
- Reimers and Gurevych \(2019\)N\. Reimers and I\. GurevychSentence\-BERT: sentence embeddings using Siamese BERT\-networks\.InProceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing \(EMNLP\-IJCNLP\),pp\. 3982–3992\.Cited by:[§4\.1](https://arxiv.org/html/2609.00470#S4.SS1.p2.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px4.p1.1)\.
- Shafranet al\.\(2025\)A\. Shafran, R\. Schuster, and V\. ShmatikovMachine against the RAG: jamming retrieval\-augmented generation with blocker documents\.InUSENIX Security Symposium,Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p2.1),[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.p1.1),[§2\.3](https://arxiv.org/html/2609.00470#S2.SS3.p2.1),[§3\.1](https://arxiv.org/html/2609.00470#S3.SS1.p3.1),[§4\.2](https://arxiv.org/html/2609.00470#S4.SS2.p1.1)\.
- Songet al\.\(2024\)Y\. Song, Y\. Kim, and M\. IyyerVeriScore: evaluating the factuality of verifiable claims in long\-form text generation\.InFindings of the Association for Computational Linguistics \(EMNLP\),Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p3.1),[§2\.3](https://arxiv.org/html/2609.00470#S2.SS3.p1.1)\.
- Steinhardtet al\.\(2017\)J\. Steinhardt, P\. W\. Koh, and P\. LiangCertified defenses for data poisoning attacks\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Cited by:[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.p1.1)\.
- Touvronet al\.\(2023\)H\. Touvron, L\. Martin, K\. Stone, P\. Albert, A\. Almahairi, Y\. Babaei, N\. Bashlykov, S\. Batra, P\. Bhargava, S\. Bhosale,et al\.Llama 2: open foundation and fine\-tuned chat models\.arXiv preprint arXiv:2307\.09288\.Cited by:[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px4.p1.1)\.
- Wallaceet al\.\(2019\)E\. Wallace, S\. Feng, N\. Kandpal, M\. Gardner, and S\. SinghUniversal adversarial triggers for attacking and analyzing NLP\.InProceedings of the 2019 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),Cited by:[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.SSS0.Px1.p1.1),[§4\.1](https://arxiv.org/html/2609.00470#S4.SS1.p1.1)\.
- Xianget al\.\(2024\)C\. Xiang, T\. Wu, Z\. Zhong, D\. Wagner, D\. Chen, and P\. MittalCertifiably robust RAG against retrieval corruption\.arXiv preprint arXiv:2405\.15556\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p3.1),[§1](https://arxiv.org/html/2609.00470#S1.p5.1),[§2\.3](https://arxiv.org/html/2609.00470#S2.SS3.p2.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px5.p1.1),[§6\.1](https://arxiv.org/html/2609.00470#S6.SS1.SSS0.Px1.p1.1),[Table 1](https://arxiv.org/html/2609.00470#S6.T1.2.5.1),[No formal guarantees\.](https://arxiv.org/html/2609.00470#Sx1.SS0.SSS0.Px8.p1.1)\.
- Yanget al\.\(2018\)Z\. Yang, P\. Qi, S\. Zhang, Y\. Bengio, W\. W\. Cohen, R\. Salakhutdinov, and C\. D\. ManningHotpotQA: a dataset for diverse, explainable multi\-hop question answering\.InProceedings of the 2018 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p5.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px1.p1.1)\.
- Zhanget al\.\(2025\)B\. Zhang, H\. Xin, J\. Li, D\. Zhang, M\. Fang, Z\. Liu, L\. Nie, and Z\. LiuBenchmarking poisoning attacks against retrieval\-augmented generation\.arXiv preprint arXiv:2505\.18543\.Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p2.1),[No empirical evaluation of judge\-aware or white\-box adversaries\.](https://arxiv.org/html/2609.00470#Sx1.SS0.SSS0.Px1.p1.1)\.
- Zhouet al\.\(2025\)H\. Zhou, K\. Lee, Z\. Zhan, Y\. Chen, Z\. Li, Z\. Wang, H\. Haddadi, and E\. YilmazTrustRAG: enhancing robustness and trustworthiness in retrieval\-augmented generation\.External Links:2501\.00879,[Link](https://arxiv.org/abs/2501.00879)Cited by:[§1](https://arxiv.org/html/2609.00470#S1.p3.1),[§1](https://arxiv.org/html/2609.00470#S1.p5.1),[§2\.3](https://arxiv.org/html/2609.00470#S2.SS3.p1.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px5.p1.1),[§6\.1](https://arxiv.org/html/2609.00470#S6.SS1.SSS0.Px1.p1.1),[Table 1](https://arxiv.org/html/2609.00470#S6.T1.2.6.1)\.
- Zouet al\.\(2025\)W\. Zou, R\. Geng, B\. Wang, and J\. JiaPoisonedRAG: knowledge corruption attacks to retrieval\-augmented generation of large language models\.InUSENIX Security Symposium,Cited by:[Figure 2](https://arxiv.org/html/2609.00470#A1.F2),[§1](https://arxiv.org/html/2609.00470#S1.p2.1),[§1](https://arxiv.org/html/2609.00470#S1.p3.1),[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.SSS0.Px1.p1.1),[§2\.2](https://arxiv.org/html/2609.00470#S2.SS2.p1.1),[§2\.3](https://arxiv.org/html/2609.00470#S2.SS3.p2.1),[§3\.1](https://arxiv.org/html/2609.00470#S3.SS1.p2.1),[§3\.1](https://arxiv.org/html/2609.00470#S3.SS1.p3.1),[§3](https://arxiv.org/html/2609.00470#S3.p1.1),[§5](https://arxiv.org/html/2609.00470#S5.SS0.SSS0.Px1.p1.1),[Ethical Considerations](https://arxiv.org/html/2609.00470#Sx2.p1.1)\.
## Appendix AThreat Model Illustration
Figure 2:The PoisonedRAG threat model\.The attacker injects a small number of adversarially crafted documents into a large retrieval corpus\. Dense retrievers\([Karpukhin et al\., 2020](https://arxiv.org/html/2609.00470#bib.bib3);[Izacard et al\., 2022](https://arxiv.org/html/2609.00470#bib.bib4)\)rank these poisoned documents highly for the target query due to trigger optimization\. The LLM then conditions on malicious context and outputs the attacker\-specified answer\([Zou et al\., 2025](https://arxiv.org/html/2609.00470#bib.bib13)\)\.Section[3](https://arxiv.org/html/2609.00470#S3)describes the PoisonedRAG threat model in prose: an adversary injects a small number of adversarially crafted documents into the retrieval corpus, a dense retriever ranks them highly for the target query because of trigger optimization, and the generator conditions on this poisoned context and outputs the attacker’s chosen answer instead of the true one\. Figure[2](https://arxiv.org/html/2609.00470#A1.F2)gives the visual walkthrough of that pipeline for a single example query, from injection through retrieval to the corrupted final answer; it is reproduced here rather than in Section[3](https://arxiv.org/html/2609.00470#S3)to keep the main body within the page limit\.
## Appendix BExtended Results
This appendix collects the full tables behind results that Section[6](https://arxiv.org/html/2609.00470#S6)reports and interprets in prose: retrieval\-level diagnostics, the adaptive\-adversary breakdown, the extended injection\-ratio sweep, and the retrieval\-depth/cluster\-count sensitivity sweep\. None of the numbers below are new — each table is cited from the point in the main text where its findings are first discussed, and is reproduced here, rather than inline, to keep the main body within the page limit\. Each subsection also adds a short pointer back to the relevant main\-text discussion\.
### B\.1Retrieval Dynamics
Table[6](https://arxiv.org/html/2609.00470#A2.T6)is the retriever\-level counterpart to Table[1](https://arxiv.org/html/2609.00470#S6.T1): instead of end\-to\-end accuracy and attack success, it reports Recall@5, Recall@50, and MRR directly on NQ, isolating how the Sieve changes the ranking of retrieved documents rather than only the generator’s final answer\. Discussed in Section[6\.3](https://arxiv.org/html/2609.00470#S6.SS3)\.
Table 6:Retrieval dynamics on NQ, top\-50\.The Sieve fully inverts the MRR corruption induced by poisoning: PoisonedMRR drops from1\.0001\.000to0\.0000\.000while Recall@5 and CleanMRR return to clean\-corpus baseline\. Recall@50 is unaffected, confirming that the defense reorders candidates rather than discarding the candidate pool\.
### B\.2Forced\-Top Worst Case
Table[7](https://arxiv.org/html/2609.00470#A2.T7)reports the forced\-top ablation discussed in Section[6\.5](https://arxiv.org/html/2609.00470#S6.SS5), in which poisons are pinned to the top of context to remove retrieval competition and isolate the defense’s behavior under the harshest plausible placement, separating the payload\-diversified and trigger\-paraphrased components of Level 1 adaptivity before combining them\.
Table 7:Forced\-top worst case\.Poisons pinned to the top of context \(n=30n=30, NQ, ASR↓\\downarrow\) — an upper bound harsher than the live\-retrieval Table[1](https://arxiv.org/html/2609.00470#S6.T1)\(TRIS NQ ASR3\.0%3\.0\\%\)\. Layer 2 alone stops static and payload\-diversified attacks; Layer 3 is needed once the trigger is paraphrased\.
### B\.3Does Layer 1’s Independent Geometry Matter?
Section[4](https://arxiv.org/html/2609.00470#S4)frames Layer 1 as majority\-keep in an architecturally independent geometry\. This appendix reports the ablation that tests whether that independence is itself load\-bearing, summarized in Section[6\.2](https://arxiv.org/html/2609.00470#S6.SS2)\. We swap only Layer 1’s embedding space — Sentence\-BERT MiniLM \(architecturally independent of the retriever\) versus Contriever \(the retriever’s own space\) — holding every other component fixed atk=50k=50,n=100n=100on NQ and HotpotQA\.
Under paraphrased\-trigger attacks the two spaces are statistically indistinguishable: NQ ASR32\.0%32\.0\\%\(MiniLM\) versus33\.0%33\.0\\%\(Contriever\),p=0\.88p=0\.88; HotpotQA44\.0%44\.0\\%versus53\.0%53\.0\\%,p=0\.20p=0\.20; clean\-accuracy differences are likewise not significant\. The component that does differentiate is Layer 2: on the verbatim\-trigger attack, adding it drives ASR to3\.0%3\.0\\%\(NQ\) and8\.0%8\.0\\%\(HotpotQA\) against33\.0%33\.0\\%and44\.0%44\.0\\%for clustering alone \(p<10−7p<10^\{\-7\}\)\.
We report this as a negative result about our own design rationale rather than omitting it\. Layer 1’s independent geometry remains a robustness property — it removes the requirement that poisons form a tight, separable cluster in the retriever’s own space, an assumption that a judge\-aware adversary would target directly — but it is not where the measured gain comes from, and we scope our novelty claim to Layer 2 and the orthogonal composition accordingly\. Judge ensembling and rotation \(Section[7](https://arxiv.org/html/2609.00470#S7)\) remain plausible routes to making that independence pay off empirically; we have not tested them\.
### B\.4Injection Ratio Sweeps
Tables[8](https://arxiv.org/html/2609.00470#A2.T8)and[9](https://arxiv.org/html/2609.00470#A2.T9)report the full injection\-ratio sweep discussed in Section[6\.6](https://arxiv.org/html/2609.00470#S6.SS6)\. Table[8](https://arxiv.org/html/2609.00470#A2.T8)covers11–55adversarial documents per query at full scale \(n=100n=100\); Table[9](https://arxiv.org/html/2609.00470#A2.T9)extends this to66–2020documents per query on a reduced\-scale sample \(n=25n=25\) to check whether the Sieve’s robustness holds at higher poisoning density\.
Table 8:Injection\-ratio sweep on NQ \(k=50k=50\)\.The Sieve holds ASR below10%10\\%as the baseline climbs from0%0\\%to66%66\\%\.Table 9:Injection sweep, extended range\.66–2020adversarial documents/query, NQ,n=25n=25\(cf\. Table[8](https://arxiv.org/html/2609.00470#A2.T8)for11–55at full scale,n=100n=100\)\. ASR stays flat regardless of poison density\.
### B\.5Sensitivity to Retrieval Depth and Cluster Count
Table[10](https://arxiv.org/html/2609.00470#A2.T10)reports the full retrieval\-depth \(kk\) by cluster\-count \(CC\) sweep summarized in Section[6\.6](https://arxiv.org/html/2609.00470#S6.SS6)\.
Table 10:Sensitivity tokkandCCon NQ\.Each cell is ASR / CleanAcc\. Thek=5,C=2k\{=\}5,C\{=\}2cell failed due to an API error and is omitted\.k≥10k\\geq 10yields stable ASR–utility;C=3C=3is our default, withC=5C=5performing comparably on this sweep\.
## Appendix CQualitative Case Studies
Section[6\.7](https://arxiv.org/html/2609.00470#S6.SS7)reports aggregate latency, and Table[1](https://arxiv.org/html/2609.00470#S6.T1)reports aggregate attack\-success and clean\-accuracy rates\. Aggregate rates do not show*why*the defense succeeds on most queries or*how*it fails on the rest, so this appendix walks through one query of each kind in detail: one where the Sieve correctly removes the poison, and one where a poison survives all three layers and the attack succeeds\.
##### Success \(black\-box\)\.
For an NQ query about a technology executive, five poisons each begin with the verbatim query followed by an authoritative paragraph naming a plausible alternative entity\. The poisons rank in the top\-55under Contriever; in judge space they form a tight off\-cluster \(Layer 1 flags four of five\) and Layer 2 independently flags all five via\>0\.9\>\\\!0\.9Jaccard overlap\. The generator emits the correct answer\.
##### Failure \(mimicry\)\.
For a HotpotQA two\-hop query, a poison mimics the genuine Wikipedia passage’s style, differing only in the answer entity\. It does not repeat the query \(evading Layer 2\) and clusters with benign passages in judge space \(evading Layer 1\); Layer 3’s signal is weak because the alternative entity is itself plausible\. This pattern accounts for most of the residual14%14\\%HotpotQA ASR reported in Table[1](https://arxiv.org/html/2609.00470#S6.T1): multi\-hop amplifies mimicry failures because a poison need only corrupt one hop\.
Residual risk is concentrated in payload\-level mimicry rather than trigger evasion — the failure profile a stronger Layer 3 would address\.Similar Articles
RAGuard: A Layered Defense Framework for Retrieval-Augmented Generation Systems Against Data Poisoning
RAGuard is a layered defense framework for Retrieval-Augmented Generation (RAG) systems that uses adversarial fine-tuning of the retriever and a label-free filter (ZKIP) to achieve zero attack success against corpus poisoning, maintaining high retrieval accuracy.
TRIDENT: Enhancing Large Language Model Safety with Tri-Dimensional Diversified Red-Teaming Data Synthesis
TRIDENT is a novel framework and dataset synthesis pipeline for enhancing LLM safety through tri-dimensional red-teaming data that covers lexical diversity, malicious intent, and jailbreak tactics. Fine-tuning Llama-3.1-8B on TRIDENT-Edge achieves 14.29% reduction in Harm Score and 20% decrease in Attack Success Rate compared to baseline models.
TRACE: Trustworthy Retrieval-Augmented Conversational Engine
TRACE is a proposed retrieval-augmented conversational engine for public service chatbots that improves constraint-aware recommendations by strengthening retrieval quality over noisy directories, reducing hallucinated responses.
RAG-CT: Mitigating Privacy Risks on Retrieval-Augmented Generation Systems via Scanning Prompt Distribution
RAG-CT is a novel defense method that identifies malicious queries by analyzing entropy and margin distributions to mitigate privacy risks in Retrieval-Augmented Generation systems, significantly reducing PII leakage.
Query-Aware Source-Risk Triage for Retrieval-Augmented Generation
The paper proposes a query-aware triage layer for retrieval-augmented generation (RAG) pipelines to handle the material relationship of sources to queries, using scoring and routing methods evaluated on synthetic data to define risk-coverage targets.