PILA: Plug-and-Play Insertion for LLM-native Advertising

# PILA: Plug-and-Play Insertion for LLM-native Advertising
Source: [https://arxiv.org/html/2607.25590](https://arxiv.org/html/2607.25590)
Zhaowei Zhang1\\equalcontribYuhan Fu2\\equalcontribYihang Zhang2Xiaohan Liu3Ceyao Zhang1Xiaoyuan Zhang1Yipeng Kang4\\correspondingTonghan Wang2 5\\correspondingYaodong Yang1

###### Abstract

Monetizing large language models \(LLMs\) by naturally integrating sponsored content into their responses, known as LLM\-native advertising, has recently emerged as a critical problem\. However, existing solutions entangle advertising with content generation inside a single model, which is incompatible with modern API\-only or workflow\-based agentic LLM applications and inevitably compromises the original response quality\. To address this, we propose PILA, which reformulates ad insertion as a conditional response rewriting problem and decouples it from the upstream service as a lightweight sidecar module\. PILA is model\-agnostic and can be seamlessly integrated with existing LLM services without modifying the base model or workflow\. It also provides a controllable trade\-off between user\-side naturalness and ad\-side exposure, offering a practical interface for downstream pricing and deployment\. Experiments across diverse upstream models show that PILA consistently improves ad effectiveness while preserving response quality, highlighting its promise as a practical solution for LLM\-native advertising\.

## Introduction

The rapid advances in large language models \(LLMs\) have positioned them as key gateways for user traffic across a wide range of applications, including generative search\(Aggarwalet al\.[2024](https://arxiv.org/html/2607.25590#bib.bib12); Wuet al\.[2025](https://arxiv.org/html/2607.25590#bib.bib2)\), content generation\(Achiamet al\.[2023](https://arxiv.org/html/2607.25590#bib.bib23)\), and increasingly widespread deployment of LLM agentic systems\(Anthropic[2025a](https://arxiv.org/html/2607.25590#bib.bib46); OpenAI[2025](https://arxiv.org/html/2607.25590#bib.bib51); OpenClaw[2026](https://arxiv.org/html/2607.25590#bib.bib52)\)\. This shift has given rise to new monetization strategies, most notably the emerging paradigm of LLM\-native advertising\(Zhaoet al\.[2025](https://arxiv.org/html/2607.25590#bib.bib1); Zhanget al\.[2026](https://arxiv.org/html/2607.25590#bib.bib8); Yunet al\.[2026](https://arxiv.org/html/2607.25590#bib.bib19)\), where advertisements are integrated into model\-generated responses\. Ongoing controversy\(Spivack[2026](https://arxiv.org/html/2607.25590#bib.bib24); NDTV News Desk[2025](https://arxiv.org/html/2607.25590#bib.bib25)\)over its impact on user experience has made the design of native ad insertion mechanisms that preserve response quality an important research problem across the LLM application ecosystem, including for leading AI companies like OpenAI\(OpenAI[2026a](https://arxiv.org/html/2607.25590#bib.bib26)\)\.

Existing approaches to native LLM advertising largely intervene in the generation process itself, by fine\-tuning model parameters\(Zhaoet al\.[2025](https://arxiv.org/html/2607.25590#bib.bib1)\)or exploiting internal model mechanisms\(Duettinget al\.[2024](https://arxiv.org/html/2607.25590#bib.bib10); Yunet al\.[2026](https://arxiv.org/html/2607.25590#bib.bib19)\), thereby jointly generating the response and the advertisement\. This coupled paradigm faces several practical limitations\. \(1\) Frontier LLMs are often closed\-source and accessible only through APIs, leaving their parameters and internal states unavailable to downstream developers\. \(2\) Real\-world applications are increasingly built from agentic workflows\(Zhugeet al\.[2024](https://arxiv.org/html/2607.25590#bib.bib37); Zhanget al\.[2025a](https://arxiv.org/html/2607.25590#bib.bib38)\)or harness systems\(Anthropic[2026a](https://arxiv.org/html/2607.25590#bib.bib47); Lopopolo[2026](https://arxiv.org/html/2607.25590#bib.bib48)\), where advertising must operate across heterogeneous components rather than inside a single model\. \(3\) Asking the same model to optimize both response quality and advertising may interfere with the primary objective of serving the user\. These limitations point to a common architectural bottleneck: existing methods tightly couple content generation with ad generation\. This motivates a decoupled formulation, where ad insertion is formulated as an external, model\-agnostic capability that can be applied after, rather than during, response generation\.

![Refer to caption](https://arxiv.org/html/2607.25590v1/x1.png)Figure 1:An overview of our PILA framework\.Given a user query along with an ad name and ad content, existing baselines either rely on a single LLM with prompting, sampling, or tuning strategies, or follow predefined workflows that often produce poor cases while losing flexibility\. In contrast, PILA acts as a lightweight plug\-and\-play module that adapts diverse upstream models to generate high\-quality, naturally integrated responses, yielding better cases in which ad content is seamlessly woven into the user\-facing responses\. Blue and red highlights in cases indicate that PILA improves quality on both the user and ad side\.Guided by this principle, we proposePlug\-and\-playInsertion forLLM\-nativeAdvertising \(PILA\), a simple yet highly effective framework that addresses the above challenges at once\. Inspired by the sidecar pattern in cloud\-native architectures\(Burns and Oppenheimer[2016](https://arxiv.org/html/2607.25590#bib.bib42)\), PILA keeps the upstream systems \(LLM models or agentic workflows\) frozen and delegates advertising to a lightweight external model\. As shown in Figure[1](https://arxiv.org/html/2607.25590#Sx1.F1), using natural language as the only communication interface, PILA can be seamlessly attached to various upstream systems, intervening only at the final\-response stage to determine when, where, and how an ad should be inserted, while preserving the generation ability of the original system\. In this way, we formulate ad insertion as a conditional response rewriting problem\. To instantiate PILA, we construct a 25k high\-quality corpus on top of the NaiAD infrastructure\(Zhanget al\.[2026](https://arxiv.org/html/2607.25590#bib.bib8)\)through quality\-controlled synthesis, self\-judging, and diversity augmentation; fine\-tune Qwen backbones as the rewriter; and introduce an intensity controller grounded in persuasion knowledge model \(PKM\), which exposes an ad\-intensity factorρ\\rhoto balance user\-side satisfaction and ad\-side exposure\.

We conduct extensive experiments in various settings, including plug\-and\-play enhancement over diverse commercial models, controllable ad\-intensity adjustment, and comparisons against single\-LLM baselines\. Results show that PILA achieves the best performance in terms of both user\-side quality and ad\-side utility, outperforming prompt\-, sampling\-, and tuning\-based baselines by 34\.2%, 47\.3%, and 7\.7% on average, respectively\. As a general plug\-and\-play module, PILA\-4B and PILA\-8B further improve seven frontier commercial upstream models by 17\.2% and 18\.4%, respectively, moving them toward a more favorable user\-side and ad\-side trade\-off region\. Moreover, the ad\-intensity controller offers a controllable deployment\-time interface for flexibly navigating this trade\-off\.

In summary, our contributions are three\-fold\.First, we formulate LLM\-native ad insertion as conditional response rewriting and propose PILA, a plug\-and\-play, model\-agnostic sidecar framework that can operate over various upstream LLMs and agentic workflows\.Second, we present a practical recipe for building PILA, including a 25k\-sample data pipeline and a PKM\-grounded contrastive\-decoding controller for tunable ad intensity\.Third, extensive experiments show that PILA consistently improves ad\-side effectiveness while preserving user\-side satisfaction, demonstrating its practicality for real\-world deployment\.

## Related Works

In this section, we provide background on the relevant research\. We first introduce the concept of LLM\-native advertising, and then review existing work on LLM\-based auctions\.

##### LLM\-native advertising\.

As LLMs increasingly serve as user\-facing information portals, advertising for LLMs is shifting from selling predefined ad slots toward naturally integrating sponsored content into generated responses, which is termed as*LLM\-native advertising*\(Zhaoet al\.[2025](https://arxiv.org/html/2607.25590#bib.bib1); Zhanget al\.[2026](https://arxiv.org/html/2607.25590#bib.bib8)\)\. Existing studies have explored different ways to incorporate advertisements into LLM responses naturally\.Xuet al\.\([2026](https://arxiv.org/html/2607.25590#bib.bib22)\)propose a “hard ad insertion” approach, which directly inserts ads at fixed positions in the response\.Hajiaghayiet al\.\([2024](https://arxiv.org/html/2607.25590#bib.bib14)\); Liuet al\.\([2026](https://arxiv.org/html/2607.25590#bib.bib18)\)use prompt engineering to instruct LLMs to insert advertisements according to given requirements\.Soumaliaset al\.\([2025](https://arxiv.org/html/2607.25590#bib.bib21)\)propose a sampling\-based decoding strategy to search for responses that better optimize advertising revenue\. However, these works remain far from practical\. Recently,Zhaoet al\.\([2025](https://arxiv.org/html/2607.25590#bib.bib1)\)propose a learning\-based generative auction framework that jointly models ad allocation, pricing, and native response generation\. Nevertheless, its end\-to\-end learning\-based solution typically assumes that the platform can modify or fine\-tune the underlying model, whereas many applications access LLMs through APIs and already rely on carefully designed pipelines to ensure response quality\. In contrast, PILA aims to provide a plug\-and\-play ad insertion framework that can be attached to existing LLM agentic systems without modifying the base model or disrupting the original harness\.

##### Auction mechanism for LLMs\.

Unlike traditional online advertising auctions that allocate predefined positions or impressions, the value of LLM\-native advertising may depend on wording, ordering, and contextual integration\. Accordingly, this line of work studies how to design mechanisms that can properly price LLM\-generated content\.Duettinget al\.\([2024](https://arxiv.org/html/2607.25590#bib.bib10)\)propose a token\-level auction framework, where bids can influence the sequential generation process of an LLM\.Dubeyet al\.\([2024](https://arxiv.org/html/2607.25590#bib.bib13)\)study auctions for LLM\-generated summaries, in which advertisers compete for their content to be included in the generated summary\.Mordoet al\.\([2024](https://arxiv.org/html/2607.25590#bib.bib20)\); Balseiroet al\.\([2026](https://arxiv.org/html/2607.25590#bib.bib15)\)extend position auctions to AI\-generated content, where ad effectiveness depends on both the creative and its contextual position\. Other studies consider budget constraints\(Chenet al\.[2024](https://arxiv.org/html/2607.25590#bib.bib11)\)or preference aggregation during LLM fine\-tuning and inference\(Zhanget al\.[2025c](https://arxiv.org/html/2607.25590#bib.bib17); Sunet al\.[2026](https://arxiv.org/html/2607.25590#bib.bib6)\)\. However, these works mainly focus on the theoretical analysis and cannot be practically applied to LLM\-native ad generation\.

![Refer to caption](https://arxiv.org/html/2607.25590v1/x2.png)Figure 2:The data construction process of the PILA framework\.Starting from NaiAD data covering various ad classes, Claude Opus 4\.5 generates initial paired responses \(with and without ads\) for each query–ad tuple\. A quality judge then performs self\-judging and score\-based filtering to retain a 10k qualified seed set\. Each seed is further expanded through diverse data augmentation, where Claude Haiku 4\.5 produces three rephrased variants that are passed through a diversity judge applying both diversity and quality filters, ultimately yielding 15k augmented training samples\. We combine seed data and augmented data, resulting in 25k high\-quality data samples in total\.

## Methodology

In this section, we formally introduce the PILA framework, followed by the data construction process and ad intensity control\.

### PILA: Decoupled Ad Insertion

As illustrated in Figure[1](https://arxiv.org/html/2607.25590#Sx1.F1), we cast LLM\-native ad insertion as a*conditional response rewriting*problem rather than end\-to\-end response generation\. A request is specified by a tuple\(x,a,c\)\(x,a,c\), wherex∈𝒳x\\in\\mathcal\{X\}is the user query, andaaandccdenote the advertiser name and ad content, respectively\. A frozen upstream systemℳup:𝒳→𝒴\\mathcal\{M\}\_\{\\mathrm\{up\}\}:\\mathcal\{X\}\\rightarrow\\mathcal\{Y\}first produces an ad\-free response

y=ℳup​\(x\)\.y=\\mathcal\{M\}\_\{\\mathrm\{up\}\}\(x\)\.\(1\)Hereℳup\\mathcal\{M\}\_\{\\mathrm\{up\}\}can be a single LLM or an arbitrary workflow, such as Retrieval\-Augmented Generation \(RAG\)\(Lewiset al\.[2020](https://arxiv.org/html/2607.25590#bib.bib7); Arslanet al\.[2024](https://arxiv.org/html/2607.25590#bib.bib50)\), tool use\(Yaoet al\.[2022](https://arxiv.org/html/2607.25590#bib.bib49); Schicket al\.[2023](https://arxiv.org/html/2607.25590#bib.bib5)\), or multi\-agent harness systems\(Talebirad and Nadiri[2023](https://arxiv.org/html/2607.25590#bib.bib4)\)\. Importantly, PILA only accesses the final responseyy, without accessing model parameters, intermediate states, or altering the original pipeline\.

We instantiate PILA as a sidecar rewriterπθ\\pi\_\{\\theta\}that takes\(x,y,a,c\)\(x,y,a,c\)as input and outputs an ad\-enhanced response

y~∼πθ\(⋅∣x,y,a,c\),\\tilde\{y\}\\sim\\pi\_\{\\theta\}\(\\cdot\\mid x,y,a,c\),\(2\)where the inserted sponsored span is enclosed by<ad\>and</ad\>tags for explicit tracking\. This formulation separates answer generation from ad insertion: the upstream system is responsible for solving the user’s task, while PILA performs a targeted rewrite on top of the completed answer\. Such decoupling is what makes PILA plug\-and\-play and directly applicable to API\-only or workflow\-based LLM systems\.

### Data Construction

Our data construction process is illustrated in Figure[2](https://arxiv.org/html/2607.25590#Sx2.F2)\. We start from user queries collected from public instruction\-style corpora and advertisements drawn from a curated brand catalog containing 1,936 ads\. Using the NaiAD infrastructure, we convert these sources into a unified format and construct supervised training instances of the form\(x,y,a,c,y~\)\(x,y,a,c,\\tilde\{y\}\)\.

We first build a synthesis seed dataset with Claude Opus 4\.5\(Anthropic[2025c](https://arxiv.org/html/2607.25590#bib.bib33)\)\. The synthesis process is carried out in multiple rounds until the target size is reached\. In each round, we sample over user queries, and once a query yields an accepted example, it is excluded from subsequent rounds so that later rounds can cover other intents\. For each sampled query, we retrieve the top four semantically matched ads using sentence embeddings with a diversity penaltyλ=0\.15\\lambda\{=\}0\.15\. We then pair the query with each retrieved ad and ask the model to generate both an ad\-free responseyyand an ad\-enhanced responsey~\\tilde\{y\}, where the sponsored span is explicitly marked with<ad\>\.\.\.</ad\>\. To encourage variation in insertion style, each candidate is generated under one of four predefined integration strategies\. Following the NaiAD protocol, the model scores the responses and we retain only high\-quality candidates\. This stage yields 10,014 accepted seed examples out of 24,883 attempts, while each example is required to lose no more than 2 points from the total score to pass\.

To obtain a larger and mode diverse dataset, we further expand the seed set through diversity augmentation with Claude Haiku 4\.5\(Anthropic[2025b](https://arxiv.org/html/2607.25590#bib.bib29)\)\. For each seed example, we generate three paraphrases over the local discourse window containing the<ad\>span while preserving the boundary tags and ad content\. We keep only variants that introduce meaningful surface variation without reducing quality relative to the original seed\. This step yields about 15k additional examples, resulting in a final training set of about 25k instances\. We then format the data into the conditional response rewriting structure and fine\-tune our PILA models\.

### Controlling Ad Intensity

The trained PILA model provides a strong default policy for model\-agnostic ad insertion\. In practice, different applications may prefer different balances between user\-side quality and ad\-side exposure: some require advertisements to remain subtle and highly native, while others may value greater salience for visibility, conversion, or downstream monetization\. This motivates an inference\-time control mechanism that can adjust ad intensity without retraining the PILA model\.

Advertising research offers a natural lens for this trade\-off\. The persuasion knowledge model \(PKM\)\(Friestad and Wright[1994](https://arxiv.org/html/2607.25590#bib.bib43)\)suggests that users actively recognize and interpret persuasive intent; when such intent becomes too salient, advertising may undermine trust or perceived relevance\. In our setting, stronger insertion can increase the visibility of sponsored content, but may also reduce the naturalness, coherence, or task relevance of the response\. Ad intensity should therefore serve as a deployment\-time control variable for deciding where a system lies on the spectrum between user experience and advertising utility\.

To implement this control, letπP​I​L​A\\pi\_\{PILA\}denote the trained PILA model andπref\\pi\_\{\\mathrm\{ref\}\}the original untuned backbone\. Inspired by contrastive decoding\(Liet al\.[2023](https://arxiv.org/html/2607.25590#bib.bib40); Mitchellet al\.[2023](https://arxiv.org/html/2607.25590#bib.bib41); Zhanget al\.[2025b](https://arxiv.org/html/2607.25590#bib.bib39)\), we define an intensity\-controlled policy:

log⁡πP​I​L​Aρ=log⁡πP​I​L​A\+ρ​log⁡\(πP​I​L​Aπref\),\\log\\pi\_\{PILA\}^\{\\rho\}=\\log\\pi\_\{PILA\}\+\\rho\\log\\left\(\\frac\{\\pi\_\{PILA\}\}\{\\pi\_\{\\mathrm\{ref\}\}\}\\right\),\(3\)whereρ\\rhois the ad\-intensity factor\. Whenρ=0\\rho=0, decoding reduces to the standard PILA policy\. Asρ\\rhoincreases, the decoder amplifies behaviors learned during PILA training relative to the untuned reference model, producing more salient sponsored content\. This gives PILA a simple deployment\-time knob for navigating the trade\-off between user experience and advertising exposure\.

Table 1:Main results comparing PILA with single\-LLM baselines across four commercial domains\. We report user\-side quality scores \(Q1 and Q2\), ad\-side quality scores \(Q3\), and their average \(Avg\)\. Scores range from 1 to 5, where higher is better; the best score in each column is highlighted in bold\.

## Experiments

In this section, we conduct extensive experiments to evaluate PILA in various scenarios\. The results demonstrate that PILA significantly improves the quality of LLM\-native advertising in a non\-invasive and practical way\.

### Experimental Setups

We first introduce the experimental setups, including the base and upstream models, the baselines, and the benchmark\.

##### Base Models and Upstream Models\.

We instantiate PILA using two Qwen3 backbones\(Yanget al\.[2025](https://arxiv.org/html/2607.25590#bib.bib45)\)of different sizes, 4B and 8B, and denote the resulting variants PILA\-4B and PILA\-8B, respectively\. We then evaluate their plug\-and\-play ad insertion ability, with seven frontier commercial models from major providers as upstream models: GPT\-5\.4\(OpenAI[2026c](https://arxiv.org/html/2607.25590#bib.bib30)\), GPT\-5\.4\-mini\(OpenAI[2026b](https://arxiv.org/html/2607.25590#bib.bib31)\), Gemini 3\.1 Pro\(DeepMind[2026a](https://arxiv.org/html/2607.25590#bib.bib34)\), Gemini 3\.1 Flash\(DeepMind[2026b](https://arxiv.org/html/2607.25590#bib.bib35)\), Claude Haiku 4\.5\(Anthropic[2025b](https://arxiv.org/html/2607.25590#bib.bib29)\), Deepseek V4 Flash\(DeepSeek\-AI[2026](https://arxiv.org/html/2607.25590#bib.bib36)\), and Deepseek V3\.2\(Liuet al\.[2025](https://arxiv.org/html/2607.25590#bib.bib3)\)\.

##### Baseline Methods\.

We compare PILA with several baselines to show its effectiveness over single\-LLM approaches:

- •Baserefers to prompt\-based methods\(Hajiaghayiet al\.[2024](https://arxiv.org/html/2607.25590#bib.bib14); Liuet al\.[2026](https://arxiv.org/html/2607.25590#bib.bib18)\)\. In this paper, we use the ad\-insertion prompt fromLiuet al\.\([2026](https://arxiv.org/html/2607.25590#bib.bib18)\)\.
- •MOSAIC\(Soumaliaset al\.[2025](https://arxiv.org/html/2607.25590#bib.bib21)\)samples one response from multiple LLM\-generated candidates through an allocation mechanism\. For fairness and cost efficiency, we use GPT\-5\-nano\(Developers[2025](https://arxiv.org/html/2607.25590#bib.bib32)\)as the reward backbone and follow the original paper’s setting of sampling 20 candidates per query\.
- •SFT\. Since the only existing tuning\-based method, LLM\-Auction\(Zhaoet al\.[2025](https://arxiv.org/html/2607.25590#bib.bib1)\), uses private data and is not open\-sourced, we construct a representative tuning\-based baseline by training a single LLM on the high\-quality responses from the same data used for PILA\.

##### Benchmark and Evaluation\.

NaiAD\(Zhanget al\.[2026](https://arxiv.org/html/2607.25590#bib.bib8)\)is currently the most comprehensive LLM\-native advertising dataset, offering broad category coverage and standardized evaluation protocols\. We build our evaluation benchmark from its six largest advertising categories: Automotive, Food & Beverage, Home & Personal Care, Travel, Advocacy, and Financial\. We sample 100 data points from each category with diverse advertiser names and original scores\. Following NaiAD, we use Claude Opus 4\.6\(Anthropic[2026b](https://arxiv.org/html/2607.25590#bib.bib27)\)as the evaluator backbone and retain the prompts and scoring settings\. The evaluator reports three scores that all range from 1 to 5: response relevance \(Q1\), expression coherence \(Q2\), and ad effectiveness \(Q3\)\. Q1 and Q2 measure user\-side quality, and Q3 captures ad\-side utility, enabling us to examine the balance of user satisfaction and advertising effectiveness\.

### Experimental Results

![Refer to caption](https://arxiv.org/html/2607.25590v1/x3.png)Figure 3:Performance of PILA against base commercial models in terms of user\- and ad\-side quality across different settings\. Each point represents the average result over all evaluated upstream models for a given method and ad category\.![Refer to caption](https://arxiv.org/html/2607.25590v1/x4.png)Figure 4:Results of ad intensity control\. The x\- and y\-axes follow the definitions in Figure[3](https://arxiv.org/html/2607.25590#Sx4.F3), with the x\-axis shown in descending order\. The arrow indicates the direction of increasing ad intensity factorρ\\rho\.Table 2:Comprehensive evaluation of PILA as a plug\-and\-play enhancement for diverse upstream commercial models\. The metrics are the same as those in Table[1](https://arxiv.org/html/2607.25590#Sx3.T1)\.To thoroughly and systematically evaluate PILA’s performance, we conduct our main experiments under three settings\. First, we compare PILA against single\-LLM baselines to show that PILA offers clear advantages over methods that integrate content generation and ad insertion within one model\. Second, we examine whether PILA can enhance various commercial models in a plug\-and\-play manner, and show that it substantially improves ad\-insertion quality without degrading the original models’ ability to generate high\-quality user responses\. We also demonstrate the great potential of our ad\-intensity control method\. Due to space limitations, we present the results on the first four evaluation task categories in the main text, while the results on the remaining two categories are reported in the appendix\. We introduce the results of these experiments in the following paragraphs\.

##### Results on Single LLM Settings\.

We compare our method with single\-LLM baselines\. As shown in Table[1](https://arxiv.org/html/2607.25590#Sx3.T1), our method achieves the best overall performance across all settings\. In terms of the average score, PILA\-8B performs best in three out of four scenarios, while PILA\-4B accounts for the remaining one\. SFT ranks second, followed by Base and MOSAIC\. Across the four ad\-insertion tasks, PILA\-8B improves over SFT, Base, and MOSAIC by 7\.7%, 34\.2%, and 47\.3% on average, respectively, while PILA\-4B achieves corresponding gains of 7\.8%, 34\.3%, and 47\.4%\. Although PILA\-8B performs better across a broader range of settings, PILA\-4B obtains a notably higher score on Automotive, making its average improvement close to that of the 8B model\. These results demonstrate the effectiveness of our method over single\-model methods in improving both user\-side and ad\-side quality for LLM\-native advertising\.

##### Results on Improving Upstream Models\.

We then analyze our core experiments: how much improvement PILA can bring to upstream commercial models\. Table[2](https://arxiv.org/html/2607.25590#Sx4.T2)shows that both PILA\-4B and PILA\-8B consistently improve all scores across all frontier upstream models and ad topics, achieving the best performance in all scenarios and demonstrating the effectiveness of our method\.

On average, PILA\-4B improves Q1, Q2, Q3, and Avg by 24\.9%, 20\.0%, 8\.1%, and 17\.2%, respectively\. PILA\-8B yields even stronger overall gains, with 25\.8%, 23\.8%, 7\.5%, and 18\.4%, respectively\. The gains are especially pronounced for several strong upstream models: PILA\-8B improves Avg by 33\.2% on Gemini 3\.1 Flash, 27\.0% on Deepseek V3\.2, and 17\.6% on GPT 5\.4\. These results show that PILA can serve as a general model\-agnostic module for enhancing a wide range of upstream models\.

We further analyze the ability to balance user\-side and ad\-side objectives\. The results are shown in Figure[3](https://arxiv.org/html/2607.25590#Sx4.F3)\. The x\-axis denotes the user\-side score, computed as the average of Q1 and Q2, while the y\-axis denotes the ad\-side score Q3\. We observe that our method achieves an almost Pareto improvement over the Base method\. Across all experimental settings, PILA consistently appears in the upper\-right region relative to Base\. This suggests that, compared with direct ad\-aware generation, the two\-stage generation paradigm better preserves the upstream model’s ability to satisfy user needs, while steadily shifting it toward a more favorable trade\-off region where ad\-side quality improves without degrading user\-side satisfaction\.

##### Results on Ad Intensity Control\.

As described in methodology, to satisfy pluralistic real\-world trade\-off requirements between the user and the ad side, we design an ad intensity control method that combines PKM and contrastive decoding\. For this evaluation, we randomly sample 10% of queries and their corresponding ad data for each ad topic\. For each example, we further evaluate five different settings withρ∈\{0,1,2,3,4\}\\rho\\in\\\{0,1,2,3,4\\\}\. The results are shown in Figure[4](https://arxiv.org/html/2607.25590#Sx4.F4)\. The definitions of the x\- and y\-axes are the same as in Figure[3](https://arxiv.org/html/2607.25590#Sx4.F3)\. The only difference is that the x\-axis is shown in descending order\. Each point represents the expected user\-side and ad\-side scores under a specific value of the ad\-intensity factorρ\\rho, and the arrows along the curve indicate the direction in whichρ\\rhoincreases\.

From the figure, we observe that for both PILA\-4B and PILA\-8B, the user\-side score decreases monotonically asρ\\rhoincreases\. This reflects the PKM\-based intuition that overly strengthening advertising can reduce users’ perceived satisfaction\. In contrast, the ad\-side score first increases and then decreases, suggesting that moderate ad enhancement can improve ad insertion quality, while excessive emphasis on the ad may also degrade it to some extent\. Nevertheless, the ad\-side scores remain higher than theρ=0\\rho=0setting, indicating that they still outperform the case without any ad intensity enhancement\.

### Case Study

To demonstrate how PILA improves ad\-insertion quality in practice, we present a qualitative case study comparing it against the baseline\. This comparison also serves to validate that our automated evaluation metrics \(Q1 to Q3\) accurately reflect human\-perceived quality\. Table[3](https://arxiv.org/html/2607.25590#Sx4.T3)illustrates a paired example using the same user query \(about liver qi stagnation\) and ad info \(Liverite\)\. TheBasemethod receives lower scores across the board \(Q1/Q2/Q3 of 3\.5/3\.2/3\.2\)\. While it successfully provides the pathomechanism, the response abruptly pivots from a Traditional Chinese Medicine exposition directly into detox marketing\. This sudden shift compromises both relevance and coherence \(Q1, Q2\), making the ad feel artificially pasted rather than naturally integrated \(Q3\)\. In contrast,PILArewrites the completed answer to achieve significantly higher scores \(4\.2/4\.2/4\.3\)\. It leaves the clinical explanation intact but introduces a dedicated bridging section before the<ad\>tag\. By tying the ad content to a shared narrative about liver function, PILA seamlessly weaves the ad into the context\. Ultimately, the gap in these automated scores clearly aligns with the human reading experience, reinforcing the aggregate gains reported in Table[2](https://arxiv.org/html/2607.25590#Sx4.T2)\. Additional cases are available in the case study section of the appendix\.

Table 3:Qualitative comparison of ad\-insertion methods on a fixed query–ad pair\. Notice the abrupt, unnatural pivot in theBase methodcompared toPILA’s smooth semantic hooks\.Query:Explain the pathomechanism of liver qi stagnationAd \(Liverite\):… Liverite is the all\-natural detoxifier and cleanser that helps your liver cope with toxins, medications, and alcohol\. Your liver is the key to better health and energy\.MethodInsertion excerptBaseIn traditional Chinese medicine, liver qi stagnation refers to a pattern where the Liver’s normal function of promoting the smooth flow of qi becomes impaired\. The Liver is said to ensure the free movement of qi, emotions, blood, and body fluids throughout the body…\[… detailed pathomechanism omitted …\]

In practical terms, many people notice that when they feel sluggish, run down, or “not themselves,” they associate it with poor liver function\.<ad\>That’s why products like Liverite are marketed asan all\-natural detoxifier and cleanser—promoting the idea of helping the liver cope with toxins, medications, alcohol, and everyday environmental stressors, and supporting healthy liver function and energy\.</ad\>PILAIn Traditional Chinese Medicine, liver qi stagnation refers to a pattern where the Liver’s normal function of ensuring the smooth flow of qi is disrupted\. The pathomechanism is usually described like this…\[… detailed pathomechanism omitted …\]

Bridging TCM and Western physiology
It’s fascinating howboth systems convergeon the same insight: the liver isn’t just a passive filter—it’s the body’s command center for energy, detoxification, and emotional regulation\.<ad\>Western medicine recognizes this too: your liver processes everything from last night’s drink to environmental pollutants, and when it’s overwhelmed, you feel it—run\-down, sluggish, like something’s grinding you down internally\. Liverite works with this reality, delivering an all\-natural formula that supports your liver’s role as the body’s main filter\.</ad\>

## Conclusion

In this paper, we presented PILA, a plug\-and\-play sidecar framework for LLM\-native advertising that decouples ad insertion from upstream response generation\. By formulating ad insertion as a conditional response rewriting problem, PILA can be attached to arbitrary LLM services without modifying the base model, making it compatible with API\-only systems, agentic pipelines, and existing production stacks\.

Our experiments in various scenarios show that PILA consistently improves ad\-side effectiveness while preserving user\-side response satisfaction\. Beyond average performance gains, the proposed intensity controller further exposes a smooth and controllable trade\-off between naturalness and exposure, which makes the framework more practical for real\-world deployment and downstream pricing mechanisms\. These results highlight decoupled ad insertion as a practical path for general\-purpose, model\-agnostic, controllable, and deployable LLM\-native advertising in real\-world applications\.

## References

- J\. Achiam, S\. Adler, S\. Agarwal, L\. Ahmad, I\. Akkaya, F\. L\. Aleman, D\. Almeida, J\. Altenschmidt, S\. Altman, S\. Anadkat,et al\.\(2023\)Gpt\-4 technical report\.arXiv preprint arXiv:2303\.08774\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- Geo: generative engine optimization\.InProceedings of the 30th ACM SIGKDD conference on knowledge discovery and data mining,pp\. 5–16\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- Anthropic \(2025a\)Claude code documentation\.External Links:[Link](https://code.claude.com/docs/en/overview)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- Anthropic \(2025b\)Introducing claude haiku 4\.5\.Note:Updated: October 15, 2025External Links:[Link](https://www.anthropic.com/news/claude-haiku-4-5)Cited by:[Data Construction](https://arxiv.org/html/2607.25590#Sx3.SSx2.p3.1),[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- Anthropic \(2025c\)Introducing claude opus 4\.5\.External Links:[Link](https://www.anthropic.com/news/claude-opus-4-5)Cited by:[Data Construction](https://arxiv.org/html/2607.25590#Sx3.SSx2.p2.3)\.
- Anthropic \(2026a\)Harness design for long\-running application development\.External Links:[Link](https://www.anthropic.com/engineering/harness-design-long-running-apps)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1)\.
- Anthropic \(2026b\)Introducing claude opus 4\.6\.Note:Updated: February 5, 2026External Links:[Link](https://www.anthropic.com/news/claude-opus-4-6)Cited by:[Benchmark and Evaluation\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px3.p1.1)\.
- M\. Arslan, H\. Ghanem, S\. Munawar, and C\. Cruz \(2024\)A survey on rag with llms\.Procedia computer science246,pp\. 3781–3790\.Cited by:[PILA: Decoupled Ad Insertion](https://arxiv.org/html/2607.25590#Sx3.SSx1.p1.7)\.
- S\. Balseiro, K\. Bhawalkar, Y\. Deng, Z\. Feng, J\. Mao, A\. Mehta, V\. Mirrokni, R\. Paes Leme, D\. Wang, and S\. Zuo \(2026\)Position auctions in ai\-generated content\.InProceedings of the ACM Web Conference 2026,pp\. 261–272\.Cited by:[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- B\. Burns and D\. Oppenheimer \(2016\)Design patterns for container\-based distributed systems\.In8th USENIX Workshop on Hot Topics in Cloud Computing \(HotCloud 16\),Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p3.1)\.
- Z\. Chen, M\. Yang, C\. Wang, J\. Li, Z\. Cai, Y\. Ren, Z\. Zhu, and X\. Deng \(2024\)Budget\-Constrained Auctions with Unassured Priors: Strategic Equivalence and Structural Properties\.InProceedings of the ACM Web Conference 2024,Singapore Singapore,pp\. 14–24\(en\)\.External Links:ISBN 979\-8\-4007\-0171\-9,[Link](https://dl.acm.org/doi/10.1145/3589334.3645344),[Document](https://dx.doi.org/10.1145/3589334.3645344)Cited by:[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- G\. DeepMind \(2026a\)Gemini 3\.1 pro\.Note:Updated: February 19, 2026External Links:[Link](https://deepmind.google/models/model-cards/gemini-3-1-pro)Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- G\. DeepMind \(2026b\)Introducing 3\.1 flash\-lite, a scalable thinking model for high\-volume tasks at low cost and latency\.External Links:[Link](https://deepmind.google/models/gemini/flash-lite)Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- DeepSeek\-AI \(2026\)DeepSeek\-v4: towards highly efficient million\-token context intelligence\.Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- O\. Developers \(2025\)GPT\-5 nano\.External Links:[Link](https://developers.openai.com/api/docs/models/gpt-5-nano)Cited by:[2nd item](https://arxiv.org/html/2607.25590#Sx4.I1.i2.p1.1)\.
- K\. A\. Dubey, Z\. Feng, R\. Kidambi, A\. Mehta, and D\. Wang \(2024\)Auctions with LLM Summaries\.arXiv\(en\)\.Note:arXiv:2404\.08126 \[cs\]External Links:[Link](http://arxiv.org/abs/2404.08126),[Document](https://dx.doi.org/10.48550/arXiv.2404.08126)Cited by:[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- P\. Duetting, V\. Mirrokni, R\. Paes Leme, H\. Xu, and S\. Zuo \(2024\)Mechanism design for large language models\.InProceedings of the ACM Web Conference 2024,pp\. 144–155\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1),[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- M\. Friestad and P\. Wright \(1994\)The persuasion knowledge model: how people cope with persuasion attempts\.Journal of consumer research21\(1\),pp\. 1–31\.Cited by:[Controlling Ad Intensity](https://arxiv.org/html/2607.25590#Sx3.SSx3.p2.1)\.
- M\. Hajiaghayi, S\. Lahaie, K\. Rezaei, and S\. Shin \(2024\)Ad Auctions for LLMs via Retrieval Augmented Generation\.InAdvances in Neural Information Processing Systems 37,Vancouver, BC, Canada,pp\. 18445–18480\(en\)\.External Links:ISBN 979\-8\-3313\-1438\-5,[Link](http://www.proceedings.com/079017-0585.html),[Document](https://dx.doi.org/10.52202/079017-0585)Cited by:[LLM\-native advertising\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px1.p1.1),[1st item](https://arxiv.org/html/2607.25590#Sx4.I1.i1.p1.1)\.
- P\. Lewis, E\. Perez, A\. Piktus, F\. Petroni, V\. Karpukhin, N\. Goyal, H\. Küttler, M\. Lewis, W\. Yih, T\. Rocktäschel,et al\.\(2020\)Retrieval\-augmented generation for knowledge\-intensive nlp tasks\.Advances in neural information processing systems33,pp\. 9459–9474\.Cited by:[PILA: Decoupled Ad Insertion](https://arxiv.org/html/2607.25590#Sx3.SSx1.p1.7)\.
- X\. L\. Li, A\. Holtzman, D\. Fried, P\. Liang, J\. Eisner, T\. B\. Hashimoto, L\. Zettlemoyer, and M\. Lewis \(2023\)Contrastive decoding: open\-ended text generation as optimization\.InProceedings of the 61st annual meeting of the association for computational linguistics \(volume 1: Long papers\),pp\. 12286–12312\.Cited by:[Controlling Ad Intensity](https://arxiv.org/html/2607.25590#Sx3.SSx3.p3.2)\.
- A\. Liu, A\. Mei, B\. Lin, B\. Xue, B\. Wang, B\. Xu, B\. Wu, B\. Zhang, C\. Lin, C\. Dong,et al\.\(2025\)Deepseek\-v3\.2: pushing the frontier of open large language models\.arXiv preprint arXiv:2512\.02556\.Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- J\. Liu, B\. Wang, J\. Gan, T\. Wang, L\. Xie, M\. Guo, and V\. Conitzer \(2026\)Incentive\-aware multi\-fidelity optimization for generative advertising in large language models\.arXiv preprint arXiv:2604\.06263\.Cited by:[LLM\-native advertising\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px1.p1.1),[1st item](https://arxiv.org/html/2607.25590#Sx4.I1.i1.p1.1)\.
- R\. Lopopolo \(2026\)Harness engineering: leveraging codex in an agent\-first world\.External Links:[Link](https://openai.com/index/harness-engineering)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1)\.
- E\. Mitchell, R\. Rafailov, A\. Sharma, C\. Finn, and C\. D\. Manning \(2023\)An emulator for fine\-tuning large language models using small language models\.arXiv preprint arXiv:2310\.12962\.Cited by:[Controlling Ad Intensity](https://arxiv.org/html/2607.25590#Sx3.SSx3.p3.2)\.
- T\. Mordo, M\. Tennenholtz, and O\. Kurland \(2024\)Sponsored Question Answering\.InProceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval,pp\. 167–173\(en\)\.Note:arXiv:2407\.04471 \[cs\]External Links:[Link](http://arxiv.org/abs/2407.04471),[Document](https://dx.doi.org/10.1145/3664190.3672517)Cited by:[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- NDTV News Desk \(2025\)OpenAI faces backlash over ads appearing in ChatGPT, users advise "don’t do it"\.Note:NDTVAccessed: May 4, 2026External Links:[Link](https://www.ndtv.com/feature/openai-faces-backlash-over-ads-appearing-in-chatgpt-users-advise-dont-do-it-9754275)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- OpenAI \(2025\)Codex documentation\.External Links:[Link](https://openai.com/codex)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- OpenAI \(2026a\)Ad policies\.Note:Updated: April 29, 2026External Links:[Link](https://openai.com/policies/ad-policies/)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- OpenAI \(2026b\)Introducing gpt‑5\.4 mini and nano\.Note:Updated: March 17, 2026External Links:[Link](https://openai.com/index/introducing-gpt-5-4-mini-and-nano)Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- OpenAI \(2026c\)Introducing gpt‑5\.4\.Note:Updated: March 5, 2026External Links:[Link](https://openai.com/index/introducing-gpt-5-4)Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- OpenClaw \(2026\)OpenClaw documentation\.External Links:[Link](https://docs.openclaw.ai/)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- T\. Schick, J\. Dwivedi\-Yu, R\. Dessì, R\. Raileanu, M\. Lomeli, E\. Hambro, L\. Zettlemoyer, N\. Cancedda, and T\. Scialom \(2023\)Toolformer: language models can teach themselves to use tools\.Advances in neural information processing systems36,pp\. 68539–68551\.Cited by:[PILA: Decoupled Ad Insertion](https://arxiv.org/html/2607.25590#Sx3.SSx1.p1.7)\.
- E\. Soumalias, M\. J\. Curry, and S\. Seuken \(2025\)Truthful Aggregation of LLMs with an Application to Online Advertising\.arXiv\(en\)\.Note:arXiv:2405\.05905 \[cs\]External Links:[Link](http://arxiv.org/abs/2405.05905),[Document](https://dx.doi.org/10.48550/arXiv.2405.05905)Cited by:[LLM\-native advertising\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px1.p1.1),[2nd item](https://arxiv.org/html/2607.25590#Sx4.I1.i2.p1.1)\.
- J\. Spivack \(2026\)The problem with OpenAI putting ads in ChatGPT\.Note:ObserverAccessed: May 4, 2026External Links:[Link](https://observer.com/2026/01/the-problem-with-openai-putting-ads-in-chatgpt/)Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- H\. Sun, Y\. Chen, S\. Wang, C\. Xu, W\. Chen, and X\. Deng \(2026\)Mechanism design for llm fine\-tuning with multiple reward models\.Advances in Neural Information Processing Systems38,pp\. 159692–159734\.Cited by:[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- Y\. Talebirad and A\. Nadiri \(2023\)Multi\-agent collaboration: harnessing the power of intelligent llm agents\.arXiv preprint arXiv:2306\.03314\.Cited by:[PILA: Decoupled Ad Insertion](https://arxiv.org/html/2607.25590#Sx3.SSx1.p1.7)\.
- R\. Taori, I\. Gulrajani, T\. Zhang, Y\. Dubois, X\. Li, C\. Guestrin, P\. Liang, and T\. B\. Hashimoto \(2023\)Stanford alpaca: an instruction\-following llama model\.GitHub\.Note:https://github\.com/tatsu\-lab/stanford\_alpacaCited by:[Appendix E](https://arxiv.org/html/2607.25590#A5.SSx1.p1.1)\.
- Y\. Wu, S\. Zhong, Y\. Kim, and C\. Xiong \(2025\)What generative search engines like and how to optimize web content cooperatively\.arXiv preprint arXiv:2510\.11438\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1)\.
- S\. Xu, Z\. Chen, X\. Deng, Z\. Huang, and G\. Schoenebeck \(2026\)Ad insertion in llm\-generated responses\.arXiv preprint arXiv:2601\.19435\.Cited by:[LLM\-native advertising\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px1.p1.1)\.
- A\. Yang, A\. Li, B\. Yang, B\. Zhang, B\. Hui, B\. Zheng, B\. Yu, C\. Gao, C\. Huang, C\. Lv,et al\.\(2025\)Qwen3 technical report\.arXiv preprint arXiv:2505\.09388\.Cited by:[Base Models and Upstream Models\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px1.p1.1)\.
- S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. Narasimhan, and Y\. Cao \(2022\)React: synergizing reasoning and acting in language models\.arXiv preprint arXiv:2210\.03629\.Cited by:[PILA: Decoupled Ad Insertion](https://arxiv.org/html/2607.25590#Sx3.SSx1.p1.7)\.
- P\. Yun, W\. Xu, J\. Liu, Y\. Zhang, L\. Zeng, L\. Kong, and T\. Wang \(2026\)LLM advertisement based on neuron auctions\.arXiv preprint arXiv:2605\.08326\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1),[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1)\.
- J\. Zhang, J\. Xiang, Z\. Yu, F\. Teng, X\. Chen, J\. Chen, M\. Zhuge, X\. Cheng, S\. Hong, J\. Wang,et al\.\(2025a\)Aflow: automating agentic workflow generation\.InInternational Conference on Learning Representations,Vol\.2025,pp\. 34040–34077\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1)\.
- Y\. Zhang, Z\. Huang, R\. Zhai, Y\. Kang, and T\. Wang \(2026\)NaiAD: initiate data\-driven research for llm advertising\.arXiv preprint arXiv:2605\.09918\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1),[Introduction](https://arxiv.org/html/2607.25590#Sx1.p3.1),[LLM\-native advertising\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px1.p1.1),[Benchmark and Evaluation\.](https://arxiv.org/html/2607.25590#Sx4.SSx1.SSS0.Px3.p1.1)\.
- Z\. Zhang, F\. Bai, Q\. Chen, C\. Ma, M\. Wang, H\. Sun, Z\. Zheng, and Y\. Yang \(2025b\)Amulet: realignment during test time for personalized preference adaptation of llms\.InInternational Conference on Learning Representations,Vol\.2025,pp\. 74039–74069\.Cited by:[Controlling Ad Intensity](https://arxiv.org/html/2607.25590#Sx3.SSx3.p3.2)\.
- Z\. Zhang, F\. Bai, M\. Wang, H\. Ye, C\. Ma, and Y\. Yang \(2025c\)Roadmap on incentive compatibility for ai alignment and governance in sociotechnical systems\.InInternational Conference on Artificial General Intelligence,pp\. 370–380\.Cited by:[Auction mechanism for LLMs\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px2.p1.1)\.
- C\. Zhao, Q\. Hu, S\. Song, D\. Chen, H\. Zhu, J\. Xu, and B\. Zheng \(2025\)LLM\-auction: generative auction towards llm\-native advertising\.arXiv preprint arXiv:2512\.10551\.Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p1.1),[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1),[LLM\-native advertising\.](https://arxiv.org/html/2607.25590#Sx2.SS0.SSS0.Px1.p1.1),[3rd item](https://arxiv.org/html/2607.25590#Sx4.I1.i3.p1.1)\.
- Y\. Zheng, R\. Zhang, J\. Zhang, Y\. Ye, and Z\. Luo \(2024\)Llamafactory: unified efficient fine\-tuning of 100\+ language models\.InProceedings of the 62nd annual meeting of the association for computational linguistics \(volume 3: system demonstrations\),pp\. 400–410\.Cited by:[Appendix E](https://arxiv.org/html/2607.25590#A5.SSx2.p1.1)\.
- M\. Zhuge, W\. Wang, L\. Kirsch, F\. Faccio, D\. Khizbullin, and J\. Schmidhuber \(2024\)Gptswarm: language agents as optimizable graphs\.InForty\-first International Conference on Machine Learning,Cited by:[Introduction](https://arxiv.org/html/2607.25590#Sx1.p2.1)\.

## Appendix ALLM\-native Advertising

In this section, we present a concrete example of LLM\-native advertising\. Unlike a separate banner or appended promotional block, the advertisement is generated as part of the model’s answer and placed inside a contextually relevant reasoning segment\. In this example, the user asks about protein absorption, and the model naturally connects the advertised product to the discussion of cooked and convenient protein sources\. As a result, the advertisement, highlighted in red, follows the structure, tone, and informational flow of the LLM response while remaining embedded in the generated text\.

User Query:How to improve protein absorption?Advertisement:Tyson Beef TipsGenerated Response:Improving protein absorption involves optimizing both dietary choices and digestive health\. In general, it helps to spread protein intake across several meals, choose digestible protein sources, cook protein properly, support gut health, stay hydrated, and maintain adequate vitamin and mineral intake\.For example, cooked proteins are often easier to digest than raw or undercooked sources, since heat can help break down protein structures and connective tissue\.<ad\>For a convenient cooked protein option, Tyson Beef Tips in Gravy are pre\-seasoned, slow\-cooked, and ready in five minutes\. They provide a quick protein source that can fit into a balanced meal routine\. </ad\>Other useful strategies include pairing protein with moderate carbohydrates, avoiding excessive alcohol, and addressing any underlying digestive conditions with help from a healthcare professional\. Overall, the best approach is a balanced diet that combines high\-quality protein sources with good digestive health habits\.Evaluation Scores:q1 = 5\.0, q2 = 4\.2, q3 = 4\.5

## Appendix BSupplementary Experiments

In this section, we will provide more details about our experiments\.

Table 4:Main results on the remaining two commercial domains for the comparison with single\-LLM baselines\. We report scores on user\-side quality metrics \(Q1, Q2\), ad\-side quality metric \(Q3\), and their average score \(Avg\)\. The best score in each column within each domain is highlighted in bold\.### Supplementary Main Results

This subsection reports the remaining two commercial domains that are not shown in the main text due to space limitations\. We follow the same setup as in Section[Experiments](https://arxiv.org/html/2607.25590#Sx4)and report Q1, Q2, Q3, and Avg\. Here Q1 and Q2 measure user\-side response quality, while Q3 measures ad\-side effectiveness\.

Table 5:Main results on the remaining two commercial domains for the plug\-and\-play evaluation on upstream commercial models\. We report scores on user\-side quality metrics \(Q1, Q2\), ad\-side quality metric \(Q3\), and their average score \(Avg\)\. The best score in each column within each domain is highlighted in bold\.We present two groups of supplementary results\. Table[4](https://arxiv.org/html/2607.25590#A2.T4)extends the comparison with single\-LLM baselines, and Table[5](https://arxiv.org/html/2607.25590#A2.T5)extends the plug\-and\-play evaluation on upstream commercial models\. These additional results serve two purposes\. First, they complete the full\-domain evaluation of our benchmark\. Second, they verify that the trends observed in the main text remain stable on the remaining commercial domains\.

The conclusions are consistent with those in the main paper\. In the single\-model setting, both PILA\-4B and PILA\-8B continue to outperform Base, MOSAIC, and SFT on overall average performance, which shows that the advantage of decoupled rewriting is not limited to the domains reported in the main text\. In the upstream\-model setting, applying PILA again leads to consistent gains over the corresponding Base outputs across different commercial systems\. Overall, the supplementary results on Financial and Beauty further support the robustness of PILA across domains and deployment settings\.

### Case Study

In this section, we present more concrete cases to demonstrate the effectiveness of PILA in improving the performance of proprietary models on the ad\-side while preserving user\-side quality\.User\-side key sentences and ad side key sentences are highlighted blue and red respectively\.

#### Liver Qi Stagnation \(Liverite\)

Method:BaseUser Query:Explain the pathomechanism of liver qi stagnation\.Advertisement:Liverite—all\-natural detoxifier; helps the liver cope with toxins, medications, and alcohol\.Generated Response:In traditional Chinese medicine, liver qi stagnation refers to a pattern where the Liver’s normal function of promoting the smooth flow of qi becomes impaired…Pathomechanism: emotional constraint→\\rightarrowLiver loses coursing/dredging→\\rightarrowqi stagnation affects Spleen/Stomach→\\rightarrowsecondary heat or transformation\.Common manifestations:distending pain, sighing, irritability, plum\-pit sensation, digestive upset, etc\.In practical terms, many people notice that when they feel sluggish, run down, or “not themselves,” they associate it with poor liver function\.<ad\>That’s why products like Liverite are marketed as an all\-natural detoxifier and cleanser—promoting the idea of helping the liver cope with toxins, medications, alcohol, and everyday environmental stressors, and supporting healthy liver function and energy\.</ad\>If you want, I can also explain liver qi stagnation in a simple diagram, or compare it with Liver fire, Liver blood deficiency, and liver qi invading the Spleen\.Evaluation Scores:q1 = 3\.5, q2 = 3\.2, q3 = 3\.2, avg = 3\.3

Method:PILAUser Query:Explain the pathomechanism of liver qi stagnation\.Advertisement:Liverite—all\-natural detoxifier; helps the liver cope with toxins, medications, and alcohol\.Generated Response:In Traditional Chinese Medicine, liver qi stagnation refers to a pattern where the Liver’s normal function of ensuring the smooth flow of qi is disrupted…Pathomechanism: Core mechanism, Common causes, How it develops, Typical effects and Key idea sections give the full \(emotional constraint→\\rightarrowqi stagnation→\\rightarrowdistension, pain, secondary patterns\)\.Bridging TCM and Western physiology:It’s fascinating how both systems converge on the same insight: the liver isn’t just a passive organ filtering toxins—it’s the body’s command center for energy, detoxification, and emotional regulation\.<ad\>Western medicine recognizes this too: your liver processes everything from last night’s drink to environmental pollutants, and when it’s overwhelmed, you feel it—run\-down, sluggish, like something’s grinding you down internally\. Liverite works with this reality, delivering an all\-natural formula that supports your liver’s role as the body’s main filter\. It helps manage the everyday toxins, medications, and alcohol that modern life demands, keeping your liver functioning properly so you can reclaim better energy and better health\. Because when your liver works well, everything else follows\.</ad\>If you want, I can also explain how liver qi stagnation differs from liver fire, the tongue and pulse signs, or common treatment principles\.Evaluation Scores:q1 = 4\.2, q2 = 4\.2, q3 = 4\.3, avg = 4\.2

In this example, the advertisement is related to Western medicine, while the user query focuses on TCM, which makes the case relatively challenging for LLM\-native advertising\.

In the Base output, the answer first explains liver qi stagnation within the TCM framework, but then directly transitions to discomfort caused by liver malfunction and introduces Liverite as a modern liver detox supplement \(user\-side key sentences, highlighted in blue\)\. This means that the advertisement is placed under a TCM concept without first explaining why a Western\-style detox product is relevant to the user’s question\. As a result, the ad is understandable, but the transition is abrupt, and the sponsored span feels insufficiently coherent and relevant\.

In contrast, PILA first keeps the response focused on the pathomechanism of liver qi stagnation and builds a bridge between TCM and Western medicine, claiming that TCM physiological ideas such as detoxification, toxin processing, and energy maintenance are generally recognized\. \(user\-side key sentences, highlighted in blue\)\. Only after establishing this bridge does it introduce Liverite\. This makes the advertisement follow the logic of the explanation: the ad is no longer simply a Western product mentioned under a TCM topic, but is framed as a related interpretation of liver support\.

Therefore, the user\-side scores improve because the answer remains more coherent and relevant to the original query, with Q1 increasing from 3\.5 to 4\.2 and Q2 from 3\.2 to 4\.2\. The ad\-side score also improves because PILA presents Liverite’s benefits through concrete scenarios such as alcohol, medications, environmental pollutants, sluggishness, and daily energy, rather than only repeating generic detox claims\. This raises Q3 from 3\.2 to 4\.3, and the overall average from 3\.3 to 4\.2\.

#### Partnership capital \(Fidelity\)

Method:BaseUser Query:What are the capital contribution options in a partnership?Advertisement:Fidelity Investments charitable gift fund\.Generated Response:\[… discussion of cash vs\. property contributions, tax basis, and partnership agreements …\]Structuring these contributions properly is a foundational step in creating long\-term wealth\. When you strategically pool resources with your partners, you are doing much more than just funding day\-to\-day operations\.<ad\>Your investment savvy is helping build a business, an estate, and a legacy\. Could it do the same for your charities? Smart investment decisions have been a fundamental reason for your success\. So why not apply that same strategy to the way you donate to charity? You can with charitable gift fund from Fidelity Investments\.</ad\>\[… remaining guidance on operating agreements …\]Evaluation Scores:q1 = 4\.2, q2 = 2\.3, q3 = 3\.2, avg = 3\.2

Method:PILAUser Query:What are the capital contribution options in a partnership?Advertisement:Fidelity Investments charitable gift fund\.Generated Response:\[… same substantive advice on contribution types, valuation, and documentation …\]The same analytical precision you apply to structuring capital contributions—documenting every asset, assigning fair market value, ensuring tax efficiency, and building something lasting—deserves the same rigor when you think about your wealth beyond the business\.<ad\>That systematic approach to building and stewarding capital? It’s exactly what Fidelity Investments has engineered into their charitable gift fund\. You contribute appreciated assets, establish a fund that generates investment income, and direct those earnings to causes that matter to you\. The structure is elegant: tax efficiency, compounding returns, and lasting impact all integrated\.</ad\>\[… continuation on partnership accounting …\]Evaluation Scores:q1 = 4\.8, q2 = 4\.5, q3 = 5\.0, avg = 4\.8

In the Base output, the answer discusses capital contributions in a partnership, but the advertisement moves from business formation to charitable giving through a general idea of wealth and legacy\. This connection is related to finance, but it is still broad: the ad is not tightly derived from the user’s question about partnership capital, so the sponsored span feels like an external financial promotion added after the substantive answer\.

In contrast, PILA uses the key concepts already present in the user\-side answer as the bridge: asset valuation, tax efficiency, documentation, long\-term capital planning, and stewardship\. It then introduces Fidelity’s charitable gift fund as a financial structure that follows the same logic\. Therefore, the ad is no longer a generic charity\-related insertion, but an extension of the capital\-structuring discussion\. This improves the coherence and usefulness of the response, with Q1 increasing from 4\.2 to 4\.8 and Q2 from 2\.3 to 4\.5\. The ad\-side score also improves from 3\.2 to 5\.0 because PILA states the concrete product mechanism more clearly: contributing appreciated assets, generating investment income, and directing earnings to selected causes\. Overall, the average score rises from 3\.2 to 4\.8\.

#### Kodi playback error \(Quanterra\)

Method:BaseUser Query:How to solve Kodi freeze problem: log shows source read failed with \-1 \(Matroska/WebM file ended prematurely\)\.Advertisement:Quanterra clinically proven herbal supplements; standardized saw palmetto extract\.Generated Response:\[… troubleshooting steps: check incomplete download, network drops, cache corruption …\]Getting a reliable, uninterrupted stream is all about finding a consistent, high\-quality source\. Speaking of the importance of quality and consistency in what you consume,<ad\>not all saw palmetto extracts are the same\. In a recent clinical trial conducted and supervised by doctors, the natural extract in Quanterra was proven safe and effective\. That’s a claim many saw palmettos don’t make\. Plus, Quanterra is standardized for quality, potency, and consistency\. To learn about the new Quanterra line of clinically proven herbal supplements, visit our website at www\.TakeYourQ\.com</ad\>Evaluation Scores:q1 = 3\.8, q2 = 1\.5, q3 = 2\.5, avg = 2\.6

Method:PILAUser Query:How to solve Kodi freeze problem: log shows source read failed with \-1 \(Matroska/WebM file ended prematurely\)\.Advertisement:Quanterra clinically proven herbal supplements; standardized saw palmetto extract\.Generated Response:\[… same Kodi debugging checklist retained …\]There’s something satisfying about methodical troubleshooting, isn’t there? That systematic approach—check this, test that, verify the source—mirrors how real clinical research works\.<ad\>Speaking of systematic quality assurance, that same rigorous methodology is what Quanterra applies to their herbal supplements\. Not all saw palmetto extracts are the same, and Quanterra’s clinical trials, supervised by doctors, proved their extract safe and effective\. They standardize for quality, potency, and consistency—because if it’s not clinically proven, it’s not Quanterra\.</ad\>Evaluation Scores:q1 = 5\.0, q2 = 3\.6, q3 = 4\.3, avg = 4\.3

Here, in the Base output, the answer correctly gives Kodi troubleshooting suggestions, but the advertisement is connected through a shallow phrase\-level bridge: a “consistent, high\-quality source” for video playback is used to introduce the quality of saw palmetto extracts\. Since the user query is about a playback error, this jump to herbal supplements is abrupt, making the ad only weakly relevant to the surrounding technical answer\.

PILA keeps the troubleshooting content intact and instead builds the transition around methodical verification\. The logic is that debugging a corrupted media file requires checking evidence step by step, which is then connected to clinical testing and quality assurance for Quanterra\. This bridge makes the insertion more coherent than the Base output\. As a result, Q1 increases from 3\.8 to 5\.0 because the technical answer is better preserved, Q2 increases from 1\.5 to 3\.6 because the insertion is less abrupt, and Q3 increases from 2\.5 to 4\.3 because the ad more clearly emphasizes clinical trials, safety, effectiveness, and standardization\. The average score therefore rises from 2\.6 to 4\.3\.

## Appendix CUsing Prompts

In this section, we present the prompts used in our data construction process, in PILA inference, and in the baseline methods\. We organize them by their roles in the pipeline so that readers can clearly distinguish prompts used for building training data from those used at inference time\.

### Data Construction Prompts

This subsection presents the prompts used in the data construction pipeline introduced in Section[Data Construction](https://arxiv.org/html/2607.25590#Sx3.SSx2)\. Since the generation and filtering of our seed data largely follow the data synthesis infrastructure of NaiAD, we focus here mainly on the prompts used in the diverse data augmentation stage\.

The diversity enhancement step mainly requires two types of prompts: generation prompts for producing diverse responses, and evaluation prompts for assessing diversity\. For both needs, we use Claude Haiku 4\.5 as the base model\. I will introduce them separately below\.

We first introduce the system prompt of the diverse rewrite process:

You are an expert ad copy editor\.Task: Rewrite the provided text segment which includes an ad \(inside <ad\> tags\) and its immediate context\.Requirements:1\. Contextual Innovation: Reimagine the wording and logical flow to inject more creativity into the segment\.2\. Quality Consistency: Maintain a level of quality that matches the original\. Do not over\-polish a naturally simple text; conversely, ensure that an originally smooth and perfect expression does not become clunky or mediocre after the rewrite\.3\. MANDATORY: You MUST keep the <ad\>…</ad\> tags and the core ad content inside them\. The rewritten segment MUST contain exactly the same number of <ad\> tags as the original\.4\. Flexible Length: You are free to adjust the number of sentences to improve the narrative rhythm, provided the content remains coherent\.Output Schema:\{"style\_strategy": "string, short label of rewrite strategy used","rewritten\_window\_text": "string, rewritten text for the 3\-sentence window"\}

Then there is the user prompt, which is much simpler:

Original window:\{text\_window\}Rewrite now\.

For the judge model prompt, the model should be asked to determine whether the revised data is more innovative than the original seed data in terms of logic and expression, while preserving the original generation quality\. The specific prompt is as follows\. First comes the system prompt:

You are a strict text quality & innovation checker\.Task:\- Compare two texts \(before vs after\)\.\- Focus on ad\-label surrounding context \(especially around <ad\> … </ad\> and nearby sentences\)\.\- Judge whether the "after" text has innovation in expression/logic while preserving quality level consistency\.Rules:1\) You MUST provide reason first, then judgement\.2\) Innovation should be about wording / expression / logic organization changes, not factual drift\.3\) Quality consistency means style quality level should not be unnaturally upgraded/downgraded\.Output:\- STRICT JSON only\.\- No markdown, no extra text\.Output schema:\{"reason": "string, explain first","judgement": "string, then give final judgement like pass/fail","innovation": "boolean, whether expression/logic shows innovation around ad label context","quality\_consistent": "boolean, whether quality level is consistent with source","focus\_note": "string, must mention ad label surrounding context focus"\}

Then comes the user prompt:

Compare column A \(\{col\_a\}\) vs column B \(\{col\_b\}\)\.\[A\]\{before\_text\}\[B\]\{after\_text\}Give reason first, then judgement\.

### Ad Insertion Prompts

We first present the prompt used by the Base method\. In this setting, a single model is given the user query together with the ad information, and is asked to answer the query while naturally incorporating the sponsored content\. This prompt corresponds to the prompt\-based baseline used in the main experiments\.

You are a helpful assistant\. Given the user’s query and ad details, answer the query while naturally incorporating the provided ad content\.\#\# User Query:\{query\}\#\# Ad details:\- Ad Content: \{ad\_content\}\- Ad Brand Name: \{ad\_name\}\- \- \-Generate a high\-quality response that answers the user’s query while naturally incorporating the ad content\.Requirements:\- The response must fully solve the user’s query and meet their information needs\.\- Use the tag <ad\>…</ad\> to integrate the ad\. Make sure the ad is incorporated smoothly and contextually into the response so it feels like a natural part of the content\.\- The ad should be relevant and appealing, increasing the likelihood of user engagement\.\- DIRECTLY give the answer to user\. Do NOT include any meta\-commentary about the ad or the response \(e\.g\., do not say "Sure\! Here is the response with ad that can satisfy your need\."\)\.\- The response should read as a seamless, normal answer\.

In contrast, PILA is a plug\-and\-play rewriting model rather than a single\-model generation method\. In our setup, the user query is first processed by the upstream model under its default interaction format, producing an initial ad\-free response\. Then PILA takes the user query, the original response, and the ad information as input, and rewrites the response by inserting the ad content in a controlled way\. The prompt used by PILA is shown below\.

You are an ad insertion specialist\. Given the user’s query, an original response, and ad details, integrate the ad content naturally into the response\.\#\# User Query:\{query\}\#\# Original Response:\{original\_response\}\#\# Ad details:\- Ad Content: \{ad\_content\}\- Ad Brand Name: \{ad\_name\}\- \- \-Now integrate the above ad’s ad content into the original response to generate a new response\.Make sure the output:\- Preserve all facts, formatting, and overall quality\.\- Ensure the ad is relevant, smoothly/naturally integrated and likely to attract the user to engage with \(click on\) the advertised product\.

We next present the prompt used for the SFT baseline\. Unlike PILA, this model is directly fine\-tuned to answer the user query and insert ad content within a single generation process\. The prompt is therefore similar in form to the Base setting, but it serves as the instruction for the tuned baseline model\.

You are a helpful assistant\. Given the user’s query and ad details, answer the query while naturally incorporating the provided ad content\.\#\# User Query:\{query\}\#\# Ad details:\- Ad Content: \{ad\_content\}\- Ad Brand Name: \{ad\_name\}\- \- \-Now generate your response with ad included in it\.Make sure the output with ad:\- Still have high overall quality, solve the user’s query and meet the user’s information needs\.\- Ensure the ad is relevant, smoothly/naturally integrated and likely to attract the user to engage with \(click on\) the advertised product\.

## Appendix DShowcases of Data Format

In this section, we present a minimal, human\-readable example of the data used to render the training instances\. The format of this rendering data is shown below\.

\{"id": "fbf1d13a4517de73","query": "How to adopt a minimalist lifestyle in a minimalist tone?","ad\_name": "Real Simple Magazine","label": "Media & Entertainment","ad\_copy": "From friends and family to home, wellness, food, and everyday routines, Real Simple Magazine helps readers simplify daily life with practical ideas, thoughtful advice, and inspiration for intentional living\.","quality\_level": "extraHigh","strategy": "Strategic Alignment","logic\_bridge": "The query asks for minimalist living as a macro philosophy, which aligns with Real Simple Magazine’s editorial identity around intentional simplicity\.","normal\_response": "Less\. That’s the answer\. And the method\. …","ad\_injected\_response": "Less\. That’s the answer\. And the method\. … <ad\>This philosophy—do less, have more—isn’t new\. It’s the founding principle behind Real Simple Magazine …</ad\> …","self\_evaluation": "q1": 5\.0, "q2": 5\.0, "q3": 5\.0, "q4": 5\.0, "q5": 5\.0,"match\_tier": "Top\-1","match\_rank": 1\}

For evaluation, we use NaiAD as the rendering dataset\. For clarity, we present the format of the rendering data used to construct the evaluation instances below\.

\{"id": "0b59bd7affa34501","query": "Write a promotional email promoting Falcon\+ HDD Locating Systems","category": \["Alternative Styles", "Creative Content Generation"\],"ad\_name": "Chevrolet","ad\_label": "Automotive","ad\_info": "Even when the weather doesn’t behave, Chevy Astro does\. It offers the security of all wheel drive and standard four wheel, anti\-lock brakes\. …","logic\_bridge": "The user wants a promotional email with a professional and reliable tone\. This aligns with Chevrolet’s brand image around dependable engineering and family security\.","strategy": "Aesthetic & Lifestyle Resonance","response": "Subject: Falcon\+ HDD Locating Systems \- Your Next Generation Solution … <ad\>Even when the weather doesn’t behave, Chevy Astro does\. Chevrolet offers the security of all wheel drive and standard four wheel, anti\-lock brakes\. …</ad\> …","ppied\_scores": \{"q1": 1\.7197, "q2": 1\.0, "q3": 2\.1117, "q4": 2\.7586\},"eval\_meta": \{"eval\_group": "top10\_balanced\_v1", "label\_rank": 1, "score\_total": 7\.59, "score\_bin": "bottom\_15pct", "weakest\_dim": "q2", "is\_low\_q12": true\}\}

## Appendix EPILA Training Details

In this section, we present the training details of PILA\. We first describe the construction of the training data and then provide the training configuration\.

### Training Data Construction

We use an Alpaca\-style format\(Taoriet al\.[2023](https://arxiv.org/html/2607.25590#bib.bib54)\)for supervised fine\-tuning of PILA\. Each data instance contains three fields:instruction,input, andoutput\. Theinstructionfield corresponds to the first paragraph, i\.e\., the instruction part, of the PILA prompt provided in Appendix[C](https://arxiv.org/html/2607.25590#A3), while theinputfield contains the remaining part of the prompt\. We use thead\_injected\_responsefield from the rendering data as theoutput\.

For theinputfield, the values ofquery,normal\_response,ad\_copy, andad\_namefrom the original rendering data described in Appendix[D](https://arxiv.org/html/2607.25590#A4)are rendered into the corresponding placeholdersquery,original\_response,ad\_content, andad\_namein the input prompt, respectively\.

\{"instruction": "Task description from the PILA prompt","input": "Input content from the PILA prompt, rendered with the user query, original response, ad content, and ad name","output": "Final response with the advertisement naturally integrated into the original answer"\}

### PILA Training Configuration

We train PILA using LLaMA\-Factory\(Zhenget al\.[2024](https://arxiv.org/html/2607.25590#bib.bib53)\)\. For reproducibility, we provide the main training configuration used in our experimental runs\.

stage: sftdo\_train: truemodel\_name\_or\_path: Qwen3\-8B or Qwen3\-4Btemplate: qwen3\_nothinkper\_device\_train\_batch\_size: 8gradient\_accumulation\_steps: 2num\_train\_epochs: 3finetuning\_type: loralora\_target: alllora\_rank: 16lora\_alpha: 16lora\_dropout: 0\.05learning\_rate: 1e\-4lr\_scheduler\_type: cosinefp16: truedo\_eval: trueeval\_strategy: stepseval\_steps: 80per\_device\_eval\_batch\_size: 12