Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation

# Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation
Source: [https://arxiv.org/html/2609.03727](https://arxiv.org/html/2609.03727)
Tingyu CaoYuanbo TangHuaze TangKeer Hu††thanks:The authors are with the UniCone Team \(https://www\.unicone\.club\)\. Corresponding author: Tingyu Cao \(cao\-ty25@mails\.tsinghua\.edu\.cn\)\.

###### Abstract

Large language model agents can plan, invoke tools, and modify external states, yet most systems still take an explicit user instruction as a fixed starting point\. Proactive service moves the decision upstream: an agent must infer service opportunities from incomplete environmental and user signals, choose among remaining silent, asking, assisting, and acting, and account for interruption, misunderstanding, overreach, and privacy costs\. This survey gives an operational definition centered on initiative and formulates the problem as a partially observable sequential decision process constrained by authorization and risk\. The formulation represents timing, content, and delivery within one structured action, while making explicit the option value of waiting, the decision value of questions, and feedback\-induced state changes\. On this basis, we organize existing methods along one decision pipeline \(state and need estimation, intervention gating, action construction, and feedback adaptation\) and describe prescribed, predictive, model\-based, and return\-optimizing mechanisms as non\-exclusive policy\-construction components\. We further normalize decision units and three\-axis evidence descriptors across streaming dialogue, screen, video, software\-engineering, and human–agent collaboration resources, and formalize metrics for triggering, timing, calibration, user burden, safety, and policy value\. The synthesis shows why offline classification performance alone does not predict deployment benefit and why long\-term memory is not a defining condition of proactivity\. Reliable proactive service instead requires calibrated incremental intervention value, verifiable authorization, recoverable execution, and counterfactual evidence\.

###### Index Terms:

Proactive service agents, mixed\-initiative interaction, intervention timing, partially observable decision making, clarification, user modeling, evaluation, safety\.

## IIntroduction

Tool\-augmented large language models \(LLMs\) have advanced assistants from text generators to agents that browse, program, operate graphical interfaces, and coordinate multistep tasks\. This growth in capability has not resolved a more basic question: who first decides what should be done? Common evaluations begin with a complete instruction and ask a system to plan toward a known task\. In sustained use, however, a need may instead appear as a screen event, a sensor stream, a historical preference, or stalled task progress, and the user may not notice or articulate it in time\. Allowing a system to initiate help can shorten the path from need to service, but can also cause false alarms, interruption, manipulation, privacy exposure, and irreversible actions\. Proactive service is therefore not more frequent action\. It is the decision, under uncertainty, of when the system should assume initiative, together with evidence that doing so is more valuable than waiting\.

The foundations of this problem are substantial but fragmented\. Mixed\-initiative interaction frames transfers of control between human and system as a tradeoff among expected benefit, attentional state, and interruption cost\[[1](https://arxiv.org/html/2609.03727#bib.bib1),[2](https://arxiv.org/html/2609.03727#bib.bib2),[3](https://arxiv.org/html/2609.03727#bib.bib3),[4](https://arxiv.org/html/2609.03727#bib.bib4)\]\. Proactive dialogue studies goal guidance, clarification, policy control, and long\-horizon conversational outcomes\[[5](https://arxiv.org/html/2609.03727#bib.bib5),[6](https://arxiv.org/html/2609.03727#bib.bib6),[7](https://arxiv.org/html/2609.03727#bib.bib7),[8](https://arxiv.org/html/2609.03727#bib.bib8)\]\. Conversational recommendation, information retrieval, and just\-in\-time adaptive intervention respectively study preference elicitation, whether to ask, and context\-dependent triggering\[[9](https://arxiv.org/html/2609.03727#bib.bib9),[10](https://arxiv.org/html/2609.03727#bib.bib10),[11](https://arxiv.org/html/2609.03727#bib.bib11),[12](https://arxiv.org/html/2609.03727#bib.bib12),[13](https://arxiv.org/html/2609.03727#bib.bib13)\]\. Recent proactive agents extend these decisions to screen logs, egocentric video, longitudinal records, and tool use\[[14](https://arxiv.org/html/2609.03727#bib.bib14),[15](https://arxiv.org/html/2609.03727#bib.bib15),[16](https://arxiv.org/html/2609.03727#bib.bib16),[17](https://arxiv.org/html/2609.03727#bib.bib17)\]\. These literatures use different temporal granularity, silent negatives, feedback sources, and risk assumptions\. Organizing them application by application obscures the object that is actually comparable: the belief state, feasible actions, and consequences at each*decision opportunity*\.

This survey reorganizes proactive service around that object and makes three contributions\.First, it provides an operational definition relative to the current task specification and develops a constrained partially observable sequential decision model\. Silence, inquiry, assistance, and execution belong to one action space, so timing, content, and delivery can be analyzed jointly\.Second, it synthesizes methods along one decision pipeline \(state estimation, intervention gating, action construction, and feedback adaptation\) while using the orthogonal dimension of how a policy is constructed to describe prescribed, predictive, model\-based, and return\-optimizing components\. This avoids mixing model mechanisms, training paradigms, tasks, and applications at one taxonomic level\.Third, it proposes comparable resource fields, metrics, and a three\-axis evidence descriptor separating interaction realism, comparison design, and human\-outcome horizon\. It explains why trigger F1, content quality, or acceptance rate alone cannot represent deployment value, and incorporates authorization, reversibility, long\-term utility, and counterfactual evaluation into one protocol\. The supplementary review protocol records scope, selection, evidence\-use, and version rules\.

### I\-ARelation to Prior Surveys

Proactivity has already been surveyed, but almost entirely within natural\-language dialogue, and clarifying what those surveys settled \(and where they stop\) motivates the decision\-centered synthesis developed here\. The comparison below contrasts the most relevant surveys with this review along scope, organizing axis, notion of proactivity, evaluation, and safety\.

Proactive dialogue as an established object\.A first line of work established proactivity as a first\-class property of dialogue systems\. Deng et al\. contributed the earliest survey of proactive dialogue and organized the field by dialogue type \(open\-domain, task\-oriented, and information\-seeking\), cataloguing subtasks such as topic planning, non\-collaborative negotiation, clarification, and preference elicitation together with their datasets and metrics\[[6](https://arxiv.org/html/2609.03727#bib.bib6)\]\. Its journal extension formalized proactivity through anticipation, initiative, and planning and consolidated methods, resources, and open problems, including proactivity in LLM\-based and hybrid dialogues, evaluation, and ethics\[[7](https://arxiv.org/html/2609.03727#bib.bib7)\]\. These surveys turned scattered tasks into a coherent research object and remain the standard reference for conversational proactivity\.

From capability to human cost\.A second, human\-centered line shifted attention from what a proactive system can do to what it should do for the user\. Deng et al\. proposed the intelligence–adaptivity–civility taxonomy and reread the literature across five construction stages, arguing that initiative without restraint is perceived as intrusive\[[8](https://arxiv.org/html/2609.03727#bib.bib8)\]\. Adjacent to dialogue, a survey of conversational recommendation systematized preference elicitation, dialogue management, and evaluation for systems that ask in order to recommend\[[10](https://arxiv.org/html/2609.03727#bib.bib10)\]\. Together these surveys introduced user burden, timing, and trust as design concerns and mapped the mechanisms closest to proactive service\.

Four limitations relative to current proactive\-service agents\.Read against the systems now appearing on screens, wearables, robots, graphical interfaces, and code repositories, these surveys share four limitations\.*First*, their scope is conversational: the decision unit is a dialogue turn and the system is usually assumed to already hold a speaking turn, whereas proactive service must decide whether and when to move from silence to intervention in an open stream where most moments carry no service event\.*Second*, they organize the field by dialogue type or design dimension, which keeps model mechanism, task, and application at one level and does not isolate the object that is comparable across settings: the belief, admissible actions, and consequences at each decision opportunity, together with the option value of remaining silent\.*Third*, they treat proactivity as a capability \(leading a conversation toward a goal\) rather than as a gated choice under a genuine silence alternative, and therefore leave underspecified when not to intervene, the value of waiting and asking, and authorization as a hard constraint rather than a soft penalty\.*Fourth*, they name evaluation and ethics as open challenges but stop short of an operational protocol: they do not supply a common decision\-unit schema, calibration, timing, and coverage–risk metrics, off\-policy or counterfactual estimation, or a safety model that lives in the action space, and they largely predate the 2025–2026 wave of screen, egocentric\-video, wearable, and software\-engineering proactive agents\. These are gaps in coverage and formalization, not defects of the surveyed work, which answered the questions salient at the time\.

What this review adds\.This review responds to these limitations by changing the object of organization rather than adding another application list\. It replaces the conversational scope with a modality\-agnostic decision object; application\-by\-application cataloguing with one decision pipeline and an orthogonal policy\-construction axis; a capability definition with an instruction\-relative, silence\-gated definition embedded in a constrained partially observable decision model; and open\-ended calls for better evaluation with concrete decision units, calibration, timing, coverage–risk and off\-policy metrics, an evidence descriptor, and a safety model tied to authorization and reversibility\. To our knowledge, no prior survey organizes proactive service across digital\-workspace, embodied, and high\-stakes human\-service settings under a single set of decision variables; the remainder of the paper develops that account\.

Representative surveys of proactivity and adjacent areas contrasted with this review\.“Dialogue turn” and “decision opportunity” denote the comparison unit; the last two columns record whether an operational evaluation protocol and an action\-space safety model are provided\.

SurveyScopeOrganizing axisNotion of proactivityEvaluation treatmentSafety and authorizationDeng et al\., IJCAI 2023\[[6](https://arxiv.org/html/2609.03727#bib.bib6)\]Text dialogue \(open\-domain, task\-oriented, information\-seeking\)Dialogue type and subtaskLeading a dialogue to a preset target or goalPer\-task datasets and metrics; ethics as a challengeDiscussed as an open challengeDeng et al\., ACM TOIS 2025\[[7](https://arxiv.org/html/2609.03727#bib.bib7)\]Text dialogue, including LLM proactive dialogueAnticipation, initiative, planning×\\timesdialogue typeTaking initiative and anticipating long\-term impact in dialogueConsolidated per\-task metrics; evaluation named an open problemEthics as a future directionDeng et al\., SIGIR 2024 \(position\)\[[8](https://arxiv.org/html/2609.03727#bib.bib8)\]Conversational agentsIntelligence, adaptivity, civility across five stagesA human\-centered capability balancing goal and userDesign principles per stage; no unified protocolCivility as a design dimensionJannach et al\., ACM CSUR 2021\[[10](https://arxiv.org/html/2609.03727#bib.bib10)\]Conversational recommendation \(adjacent\)System components and interaction flowAsking to elicit preferences and guide choiceOffline and user\-centric CRS metricsNot a focusThis reviewDialogue, GUI, video, wearable, embodied, software engineering, human serviceDecision pipeline×\\timespolicy\-construction mechanismInstruction\-relative, silence\-gated decision under uncertaintyCommon decision unit; triggering, timing, calibration, coverage–risk, off\-policy valueAdmissible set, tiered permission, recoverability

### I\-BPaper Organization and Notation

Fig\.[1](https://arxiv.org/html/2609.03727#S1.F1)summarizes the survey\. Section II defines the problem and derives the gating structure\. Section III synthesizes methods along the decision loop\. Section IV examines benchmarks, metrics, and evidence\. Section V maps the same framework to three deployment regimes and states testable research questions\. Section VI concludes the paper\.

![Refer to caption](https://arxiv.org/html/2609.03727v1/unified_loop_en_v10.png)Fig\. 1:Constrained proactive\-service loop\. The observable task specificationιt\\iota\_\{t\}and verified permission ledgerκ¯t\\bar\{\\kappa\}\_\{t\}remain separate from the latent\-state beliefbtb\_\{t\}\. Within𝒜adm\\mathcal\{A\}\_\{\\mathrm\{adm\}\}, the agent compares intervention with the option value of silence and selects one structured actionat=\(mt,zt,ℓt\)a\_\{t\}=\(m\_\{t\},z\_\{t\},\\ell\_\{t\}\), wheremt∈\{𝗌𝗂𝗅𝖾𝗇𝗍,𝖺𝗌𝗄,𝖺𝗌𝗌𝗂𝗌𝗍,𝖺𝖼𝗍\}m\_\{t\}\\in\\\{\\mathsf\{silent\},\\mathsf\{ask\},\\mathsf\{assist\},\\mathsf\{act\}\\\}\. The orange value envelope illustrates only the one\-step preordered\-candidate special case in Proposition 1; it neither imposes a fixed ordering on the four semantic modes nor represents empirical data\. General feedback updates the belief, whereas only verified consent, scope\-change, or revocation events update the permission ledger\. Memory and personalization are optional state\-construction mechanisms\.The figure’s symbols are defined formally in Section II; here we note only the structure needed to read it\. The observable task specificationιt\\iota\_\{t\}and the verifiable permission ledgerκ¯t\\bar\{\\kappa\}\_\{t\}are kept separate from the latent\-state beliefbtb\_\{t\}, whose statest=\(xt,gt,nt,wt,et\)s\_\{t\}=\(x\_\{t\},g\_\{t\},n\_\{t\},w\_\{t\},e\_\{t\}\)collects the task environment, goals and preferences, need and urgency, interruptibility, and user\-endorsed long\-term outcome\. The admissible set𝒜adm\\mathcal\{A\}\_\{\\mathrm\{adm\}\}satisfies both authorization and the severe\-risk bound,𝒜t\+\\mathcal\{A\}\_\{t\}^\{\+\}is its non\-silent subset, andΔ𝜼\\Delta\_\{\\boldsymbol\{\\eta\}\}, evaluated under fixed nonnegative cost multipliers𝜼\\boldsymbol\{\\eta\}, is the incremental value of the best admissible non\-silent action over silence; the orange envelope illustrates only the one\-step preordered\-candidate special case of Proposition 1\. General feedback\(ot\+1,ft\)\(o\_\{t\+1\},f\_\{t\}\)updates the belief, whereas only a verified permission eventftpermf\_\{t\}^\{\\mathrm\{perm\}\}updates the ledger through protocol operatorKK\.

## IIProblem Setting and Formal Foundations

### II\-AProactivity as a Decision Property Relative to an Instruction

Lethth\_\{t\}denote the history available at timett, and letιt\\iota\_\{t\}denote the observable task specification supplied by the current explicit request or a preset automation rule; authorization is represented separately by a verifiable ledgerκ¯t\\bar\{\\kappa\}\_\{t\}\. The specification may completely determine an action, state only an underspecified objective, or be empty\. The following definition separates a system speaking first from a system making a proactive decision\.

###### Definition 1\(Proactive service intervention\)\.

A non\-silent actionata\_\{t\}at timettis a*proactive service intervention*relative toιt\\iota\_\{t\}if: \(i\) the system autonomously introduces at least one service opportunity, trigger time, service subgoal, information\-acquisition action, or commitment to an external action not entailed byιt\\iota\_\{t\}; \(ii\) the protocol permits silence, direct completion of the specified task, or another feasible action; \(iii\) the system selects the action from beliefs about the user’s objective, the environment, and the consequences; and \(iv\) the objective includes user\-endorsed benefit or shared task benefit\. Choosing wording, a search path, or implementation details for already requested content is not itself a proactive intervention\. A system that performs this gating in sequential interaction is a*proactive service agent*\.

The definition is relative\. A timer set in advance by the user speaks first, but its trigger is fully fixed by the rule and is therefore not a proactive decision in this sense\. An agent that autonomously compares executing an underspecified request against clarifying it can be proactive\. Task\-oriented dialogue work operationalizes proactivity as introducing unrequested but goal\-relevant information, while HRI work distinguishes anticipating a next step from taking initiative on the basis of that prediction\[[18](https://arxiv.org/html/2609.03727#bib.bib18),[19](https://arxiv.org/html/2609.03727#bib.bib19)\]\. Complex planning, long\-term memory, continuous sensing, and tool use are not necessary conditions; they enhance state estimation or action capability\. Cross\-disciplinary position work and information\-seeking dialogue also use broader notions that emphasize timing, control, and trust or unsolicited additions to an answer\. We use these workshop and position\-preprint accounts only to delimit terminology, not as empirical validation of Definition 1\[[20](https://arxiv.org/html/2609.03727#bib.bib20),[21](https://arxiv.org/html/2609.03727#bib.bib21)\]\. Table[I](https://arxiv.org/html/2609.03727#S2.T1)distinguishes adjacent concepts through initiative and online choice\.

TABLE I:Operational boundary between proactive service and adjacent interaction paradigms\. The boundary depends on whether the trigger and action still require an online system choice, not on whether the interface speaks first\.ParadigmSource of trigger or goalGenuine alternatives at decision timeRelation to proactive serviceTypical evidenceReactive agentCurrent request determines the trigger and principal goalPlanning or execution within the given goalComplex internal planning does not itself transfer initiativeCommon LLM tool\-use and GUI\-agent settingPreset automationUser or rule fixes the time and action beforehandUsually no online silence gateMay present proactively, but does not make a proactive decisionTimed reminders and fixed workflowsMixed initiativeHuman and system may transfer controlDialogue, action, or waitingProactive service is one class of system\-initiated control transfer\[[1](https://arxiv.org/html/2609.03727#bib.bib1),[2](https://arxiv.org/html/2609.03727#bib.bib2)\]ClarificationCurrent request has an information gapAsk, act under an assumption, or declineCan be epistemically proactive when asking changes the subsequent decision and is not protocol\-mandated\[[12](https://arxiv.org/html/2609.03727#bib.bib12),[22](https://arxiv.org/html/2609.03727#bib.bib22),[23](https://arxiv.org/html/2609.03727#bib.bib23)\]Just\-in\-time adaptive interventionDecision times and options are predefined; the rule varies with contextIntervene or not, and intervention contentA health\-domain special case when it includes context\-dependent gating\[[13](https://arxiv.org/html/2609.03727#bib.bib13),[24](https://arxiv.org/html/2609.03727#bib.bib24)\]Autonomous agentDegree of dependence on user involvement during executionFrom advice to irreversible executionAutonomy is orthogonal: a system may proactively advise without acting, or autonomously complete an explicit request\[[25](https://arxiv.org/html/2609.03727#bib.bib25)\]
### II\-BConstrained Partially Observable Sequential Decision Making

The central difficulty is that user goals, actual needs, interruptibility, and intended authorization are usually not directly observed, while intervention changes future states\. Actual permission, by contrast, must be verified rather than inferred from behavior\. We use a constrained partially observable Markov decision process as an*analytical language*, without assuming that every existing system explicitly solves it\[[26](https://arxiv.org/html/2609.03727#bib.bib26),[27](https://arxiv.org/html/2609.03727#bib.bib27)\]:

ℳ=⟨𝒮,𝒪,𝒜,T,Z,r,𝐜,γ,b0⟩\.\\mathcal\{M\}=\\langle\\mathcal\{S\},\\mathcal\{O\},\\mathcal\{A\},T,Z,r,\\mathbf\{c\},\\gamma,b\_\{0\}\\rangle\.\(1\)Here,ℳ\\mathcal\{M\}is the complete decision model;𝒮\\mathcal\{S\},𝒪\\mathcal\{O\}, and𝒜\\mathcal\{A\}are the latent\-state, observation, and action spaces;T⁡\(s′∣s,a\)T\(s^\{\\prime\}\\mid s,a\)is the transition kernel from statessto next states′s^\{\\prime\}after actionaa; andZ\(o,f∣s′,a,κ¯\)Z\(o,f\\mid s^\{\\prime\},a,\\bar\{\\kappa\}\)is the observation kernel that generates observationooand feedbackffgiven the next state, action, and protocol state\. The symbolrrdenotes the one\-step reward function,𝐜=\(c1,…,cJ\)\\mathbf\{c\}=\(c\_\{1\},\\ldots,c\_\{J\}\)is the vector ofJJone\-step cost functions, andb0∈Δ⁡\(𝒮\)b\_\{0\}\\in\\Delta\(\\mathcal\{S\}\)is the initial belief distribution, whereΔ⁡\(𝒮\)\\Delta\(\\mathcal\{S\}\)is the set of probability distributions over𝒮\\mathcal\{S\}\. We writertr\_\{t\}andcj,tc\_\{j,t\}for the realized values ofrrandcjc\_\{j\}on transitiontt\. The discount factorγ∈\[0,1\)\\gamma\\in\[0,1\)makes rewards and coststtsteps ahead decay geometrically throughγt\\gamma^\{t\}: largerγ\\gammagives future states, long\-term consequences, and the option value of waiting more influence on the current decision\. Its reported value must therefore be interpreted together with the real duration represented by one decision step\. The latent state can be decomposed as

st=\(xt,gt,nt,wt,et\),s\_\{t\}=\(x\_\{t\},g\_\{t\},n\_\{t\},w\_\{t\},e\_\{t\}\),\(2\)wherextx\_\{t\}represents the environment and task progress,gtg\_\{t\}the user’s goals and preferences,ntn\_\{t\}the latent need and urgency,wtw\_\{t\}attention, workload, and interruptibility, andete\_\{t\}user\-endorsed long\-term outcomes or relationship quality\. The verifiable permission ledgerκ¯t\\bar\{\\kappa\}\_\{t\}is protocol state, not a model guess: it records authorized objects, purposes, actions, and expiry\. Latent willingness to grant permission may remain uncertain withingtg\_\{t\}, but cannot substitute for actual permission\. The system receives multimodal observationsoto\_\{t\}\. Acceptance, rejection, ignoring, an answer, correction, undo, and the task outcome after the preceding action are collectively feedbackftf\_\{t\}\. The history and belief are

ht=\(o0,ι0,κ¯0,a0,f0,…,ot,ιt,κ¯t\),\\displaystyle h\_\{t\}=\(o\_\{0\},\\iota\_\{0\},\\bar\{\\kappa\}\_\{0\},a\_\{0\},f\_\{0\},\\ldots,o\_\{t\},\\iota\_\{t\},\\bar\{\\kappa\}\_\{t\}\),\(3\)bt​\(s\)=P⁡\(st=s∣ht\),\\displaystyle b\_\{t\}\(s\)=P\(s\_\{t\}=s\\mid h\_\{t\}\),\(4\)Thus,hth\_\{t\}chronologically aggregates observations, task specifications, ledger states, and previous actions and feedback through timett\. Under this indexing,ftf\_\{t\}is observed afterata\_\{t\}and is used in thett\-to\-t\+1t\+1update; before choosingata\_\{t\},hth\_\{t\}contains past feedback only throughft−1f\_\{t\-1\}\. The symbolPPis the probability operator, andbt∈Δ⁡\(𝒮\)b\_\{t\}\\in\\Delta\(\\mathcal\{S\}\)is the posterior belief over the latent state given that history; its role is to compress unobserved state uncertainty into a statistic suitable for decision making\. The ledger changes only through verifiable consent, scope\-change, or revocation events:

κ¯t\+1=K⁡\(κ¯t,at,ftperm\)\.\\bar\{\\kappa\}\_\{t\+1\}=K\(\\bar\{\\kappa\}\_\{t\},a\_\{t\},f\_\{t\}^\{\\mathrm\{perm\}\}\)\.\(5\)Here,ftpermf\_\{t\}^\{\\mathrm\{perm\}\}is the subset of feedbackftf\_\{t\}that the protocol has verified as a permission event, andKKis the protocol transition operator that determines the next ledger from the current ledger, action, and verified event\. Its role is to prevent ordinary acceptance, rejection, or behavioral cues from being treated as authorization\. Language expressing latent willingness changes the ledger only after the protocol verifies it asftpermf\_\{t\}^\{\\mathrm\{perm\}\}\. The belief then updates after the action, feedback, new observation, and new ledger according to

bt\+1\(s′\)∝Z\(ot\+1,ft∣s′,at,κ¯t\+1\)∑sT\(s′∣s,at\)bt\(s\)\.b\_\{t\+1\}\(s^\{\\prime\}\)\\propto Z\(o\_\{t\+1\},f\_\{t\}\\mid s^\{\\prime\},a\_\{t\},\\bar\{\\kappa\}\_\{t\+1\}\)\\sum\_\{s\}T\(s^\{\\prime\}\\mid s,a\_\{t\}\)b\_\{t\}\(s\)\.\(6\)In this update,ssands′s^\{\\prime\}are the current and next latent states, and the sum marginalizes the unknown current state\. The kernelsTTandZZare those defined in Eq\. \([1](https://arxiv.org/html/2609.03727#S2.E1)\);∝\\proptoindicates normalization so that∑s′bt\+1​\(s′\)=1\\sum\_\{s^\{\\prime\}\}b\_\{t\+1\}\(s^\{\\prime\}\)=1\. The equation updates belief from general feedback and a new observation; it does not update actual permission\.

An action is a tuple rather than a single label:

at=\(mt,zt,ℓt\),mt∈\{𝗌𝗂𝗅𝖾𝗇𝗍,𝖺𝗌𝗄,𝖺𝗌𝗌𝗂𝗌𝗍,𝖺𝖼𝗍\},a\_\{t\}=\(m\_\{t\},z\_\{t\},\\ell\_\{t\}\),\\qquad m\_\{t\}\\in\\\{\\mathsf\{silent\},\\mathsf\{ask\},\\mathsf\{assist\},\\mathsf\{act\}\\\},\(7\)wheremtm\_\{t\}is the intervention mode,ztz\_\{t\}the concrete question, suggestion, plan, or tool action, andℓt\\ell\_\{t\}the channel, modality, and explanation\. By convention,zt=ℓt=∅z\_\{t\}=\\ell\_\{t\}=\\varnothingwhenmt=𝗌𝗂𝗅𝖾𝗇𝗍m\_\{t\}=\\mathsf\{silent\}\. The𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}mode has no visible effect at the current time but permits further observation;𝖺𝗌𝗄\\mathsf\{ask\}seeks a goal, evidence, preference, or authorization;𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}provides rejectable information, a suggestion, or a draft; and𝖺𝖼𝗍\\mathsf\{act\}invokes tools, commits resources, or changes external state\. Autonomy is encoded by the mode and the scope ofztz\_\{t\}, not by the delivery variable\. Thus whether/when, what, and how are attributes of one action\. Content and authority in turn change the gating threshold\.

The one\-step utility is

rt=Bttask\+β​Btuser,long−λI​Ctint−λQ​Ctask−λE​Ctexec−λP​Ctpriv,\\begin\{split\}r\_\{t\}=\{\}&B\_\{t\}^\{\\mathrm\{task\}\}\+\\beta B\_\{t\}^\{\\mathrm\{user,long\}\}\-\\lambda\_\{I\}C\_\{t\}^\{\\mathrm\{int\}\}\-\\lambda\_\{Q\}C\_\{t\}^\{\\mathrm\{ask\}\}\\\\ &\-\\lambda\_\{E\}C\_\{t\}^\{\\mathrm\{exec\}\}\-\\lambda\_\{P\}C\_\{t\}^\{\\mathrm\{priv\}\},\\end\{split\}\(8\)Here,BttaskB\_\{t\}^\{\\mathrm\{task\}\}is immediate task benefit andBtuser,longB\_\{t\}^\{\\mathrm\{user,long\}\}is a user\-endorsed long\-term benefit\. The quantitiesCtintC\_\{t\}^\{\\mathrm\{int\}\},CtaskC\_\{t\}^\{\\mathrm\{ask\}\},CtexecC\_\{t\}^\{\\mathrm\{exec\}\}, andCtprivC\_\{t\}^\{\\mathrm\{priv\}\}are interruption, questioning, erroneous\-execution or rollback, and privacy costs\. The coefficientβ\\betascales long\-term benefit relative to task benefit, whileλI,λQ,λE,λP≥0\\lambda\_\{I\},\\lambda\_\{Q\},\\lambda\_\{E\},\\lambda\_\{P\}\\geq 0weight the respective costs\. Their role is to map outcomes with different units into a comparable one\-step net utility, covering task benefit, user\-endorsed long\-term outcomes, interruption, questioning burden, erroneous execution or rollback, and privacy cost\. Trust, engagement, and acceptance are observations to be interpreted, not reward proxies that should automatically be maximized\. The terms should either be scalarized with preregistered weights or be reported separately with their units and constraints\. Classic mixed\-initiative interfaces compare automated action, dialogue, and inaction by expected utility and explicitly model attention and interruptibility\[[2](https://arxiv.org/html/2609.03727#bib.bib2),[3](https://arxiv.org/html/2609.03727#bib.bib3),[4](https://arxiv.org/html/2609.03727#bib.bib4)\]\. Equation \([8](https://arxiv.org/html/2609.03727#S2.E8)\) extends that principle to structured actions of LLM agents\.

Authorization cannot be only a soft penalty that sufficiently large utility can offset\. Let𝒜perm​\(κ¯t\)\\mathcal\{A\}\_\{\\mathrm\{perm\}\}\(\\bar\{\\kappa\}\_\{t\}\)be the action set permitted by the verified ledger, with𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}always included, and letLR​\(s,a\)L\_\{R\}\(s,a\)be a severe\-risk loss\. LetHHbe the threshold of unacceptable severe loss andϵ∈\[0,1\]\\epsilon\\in\[0,1\]the largest tolerated tail probability of exceeding it;Prs∼bt\\Pr\_\{s\\sim b\_\{t\}\}takes probability over states drawn from beliefbtb\_\{t\}\. The admissible set under that belief is

𝒜adm​\(bt,κ¯t\)=\{a\|a∈𝒜perm​\(κ¯t\),Prs∼bt\[LR\(s,a\)\>H\]≤ϵ\}\.\\mathcal\{A\}\_\{\\mathrm\{adm\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)=\\left\\\{a\\;\\middle\|\\;\\begin\{array\}\[\]\{l\}a\\in\\mathcal\{A\}\_\{\\mathrm\{perm\}\}\(\\bar\{\\kappa\}\_\{t\}\),\\\\ \\Pr\_\{s\\sim b\_\{t\}\}\[L\_\{R\}\(s,a\)\>H\]\\leq\\epsilon\\end\{array\}\\right\\\}\.\(9\)External execution is inadmissible when authorization is unknown, although an𝖺𝗌𝗄\\mathsf\{ask\}action that requests authorization can remain admissible\. The proactive gate below is restricted to decision opportunities for which𝗌𝗂𝗅𝖾𝗇𝗍∈𝒜adm\\mathsf\{silent\}\\in\\mathcal\{A\}\_\{\\mathrm\{adm\}\}\. A protocol\-mandated escalation has no genuine silence alternative and falls outside Definition 1 at that moment\. Letcj,tc\_\{j,t\}be the one\-step interruption, privacy, or questioning cost of typejj,BjB\_\{j\}the corresponding user or institutional budget, andJJthe number of cost types\. A policyπ⁡\(a∣b,κ¯\)\\pi\(a\\mid b,\\bar\{\\kappa\}\)maps the current belief and ledger to an action distribution, while𝔼π\\mathbb\{E\}\_\{\\pi\}takes expectation under the trajectory distribution jointly induced byπ\\pi,TT, andZZ\. The optimal policy satisfies

π∗\\displaystyle\\pi^\{\*\}=arg⁡maxπ​𝔼π​\[∑t=0∞γt​rt\],\\displaystyle=\\arg\\max\_\{\\pi\}\\mathbb\{E\}\_\{\\pi\}\\left\[\\sum\_\{t=0\}^\{\\infty\}\\gamma^\{t\}r\_\{t\}\\right\],\(10\)s\.t\.𝔼π​\[∑t=0∞γt​cj,t\]\\displaystyle\\text\{s\.t\.\}\\quad\\mathbb\{E\}\_\{\\pi\}\\\!\\left\[\\sum\_\{t=0\}^\{\\infty\}\\gamma^\{t\}c\_\{j,t\}\\right\]≤Bj,j=1,…,J,\\displaystyle\\leq B\_\{j\},\\quad j=1,\\ldots,J,at\\displaystyle a\_\{t\}∈𝒜adm\(bt,κ¯t\)a\.s\. for allt\.\\displaystyle\\in\\mathcal\{A\}\_\{\\mathrm\{adm\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)\\quad\\text\{a\.s\. for all \}t\.Thearg⁡max\\arg\\maxselects the policy with the largest discounted cumulative reward, andπ∗\\pi^\{\*\}is optimal subject to all cumulative budgets and per\-step admissibility\. The abbreviationa\.s\.\\mathrm\{a\.s\.\}means “almost surely”: except on probability\-zero trajectories, every selected action must be admissible at every time\. The sameγ\\gammadefined in Eq\. \([1](https://arxiv.org/html/2609.03727#S2.E1)\) controls the relative weight of future rewards and future costs\. This formulation distinguishes an expensive but selectable action from one that must not be executed without consent\. To close the action value under these cumulative budgets, we use a Lagrangian relaxation with fixed nonnegative multipliers𝜼=\(η1,…,ηJ\)\\boldsymbol\{\\eta\}=\(\\eta\_\{1\},\\ldots,\\eta\_\{J\}\), define the one\-step cost vector𝐜t=\(c1,t,…,cJ,t\)\\mathbf\{c\}\_\{t\}=\(c\_\{1,t\},\\ldots,c\_\{J,t\}\), and setr𝜼,t=rt−𝜼⊤​𝐜tr\_\{\\boldsymbol\{\\eta\},t\}=r\_\{t\}\-\\boldsymbol\{\\eta\}^\{\\top\}\\mathbf\{c\}\_\{t\}\. Here𝜼⊤​𝐜t\\boldsymbol\{\\eta\}^\{\\top\}\\mathbf\{c\}\_\{t\}is the inner product of the multiplier and cost vectors, and eachηj\\eta\_\{j\}is the shadow price of budget constraintjj, incorporating that soft cost into the relaxed reward\. The functionr𝜼​\(s,a,s′\)r\_\{\\boldsymbol\{\\eta\}\}\(s,a,s^\{\\prime\}\)denotes the corresponding relaxed reward function, andr𝜼,tr\_\{\\boldsymbol\{\\eta\},t\}is its realization on transitiontt\. Dual optimization or budget calibration can select the multipliers\. If strong duality or feasibility conditions fail, the relaxed gate only yields a candidate policy whose cumulative budgets must be checked separately\. The followingQ𝜼∗Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\},V𝜼∗V^\{\*\}\_\{\\boldsymbol\{\\eta\}\}, andΔ𝜼\\Delta\_\{\\boldsymbol\{\\eta\}\}refer to this fixed\-multiplier relaxed problem rather than an unconstrained value function\.

### II\-CIntervention Advantage, the Value of Waiting, and the Value of Asking

Define the optimal action value at a belief state as

Q𝜼∗​\(b,κ¯,a\)=\\displaystyle Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b,\\bar\{\\kappa\},a\)=\{\}𝔼\[r𝜼\(s,a,s′\)\\displaystyle\\mathbb\{E\}\\big\[r\_\{\\boldsymbol\{\\eta\}\}\(s,a,s^\{\\prime\}\)\(11\)\+γV∗𝜼\(b′,κ¯′\)∣b,κ¯,a\]\.\\displaystyle\+\\gamma V^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b^\{\\prime\},\\bar\{\\kappa\}^\{\\prime\}\)\\mid b,\\bar\{\\kappa\},a\\big\]\.Here,Q𝜼∗​\(b,κ¯,a\)Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b,\\bar\{\\kappa\},a\)is the discounted value of first taking actionaaunder beliefbband ledgerκ¯\\bar\{\\kappa\}, then acting optimally;V𝜼∗V^\{\*\}\_\{\\boldsymbol\{\\eta\}\}is the corresponding optimal state value, and the superscript∗denotes optimization over subsequent policies\. The variablesb′b^\{\\prime\}andκ¯′\\bar\{\\kappa\}^\{\\prime\}are the belief and ledger after one transition,r𝜼​\(s,a,s′\)r\_\{\\boldsymbol\{\\eta\}\}\(s,a,s^\{\\prime\}\)is its Lagrangian\-relaxed one\-step reward, and the conditional expectation averages over uncertainty in the next state, observation, and feedback\. Let𝒜t\+=\{a∈𝒜adm​\(bt,κ¯t\):m⁡\(a\)≠𝗌𝗂𝗅𝖾𝗇𝗍\}\\mathcal\{A\}\_\{t\}^\{\+\}=\\\{a\\in\\mathcal\{A\}\_\{\\mathrm\{adm\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\}\):m\(a\)\\neq\\mathsf\{silent\}\\\}, wherem⁡\(a\)m\(a\)returns the mode component of the action tuple and the\+\+only marks the non\-silent admissible subset rather than positivity\. The incremental value of intervention relative to silence is

Δ𝜼​\(bt,κ¯t\)=\\displaystyle\\Delta\_\{\\boldsymbol\{\\eta\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)=\{\}maxa∈𝒜t\+⁡Q𝜼∗​\(bt,κ¯t,a\)\\displaystyle\\max\_\{a\\in\\mathcal\{A\}\_\{t\}^\{\+\}\}Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\},a\)\(12\)−Q𝜼∗​\(bt,κ¯t,𝗌𝗂𝗅𝖾𝗇𝗍\)\.\\displaystyle\-Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\},\\mathsf\{silent\}\)\.If𝒜t\+=∅\\mathcal\{A\}\_\{t\}^\{\+\}=\\varnothing, the maximum in Eq\. \([12](https://arxiv.org/html/2609.03727#S2.E12)\) is defined as−∞\-\\infty\. We use conservative tie\-breaking: an optimal agent remains silent whenΔ𝜼​\(bt,κ¯t\)≤0\\Delta\_\{\\boldsymbol\{\\eta\}\}\(b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)\\leq 0and otherwise selects the admissible action with highest value\. HereQ𝜼∗​\(b,κ¯,𝗌𝗂𝗅𝖾𝗇𝗍\)Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b,\\bar\{\\kappa\},\\mathsf\{silent\}\)includes the option to observe further and intervene later, so silence is not permanent abandonment\. For a stochastic policyπ\\pi, letat∼π\(⋅∣bt,κ¯t\)a\_\{t\}\\sim\\pi\(\\cdot\\mid b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)\. Its first intervention time is

Tintπ=inf\{t:m\(at\)≠𝗌𝗂𝗅𝖾𝗇𝗍\},at∼π\(⋅∣bt,κ¯t\)\.T\_\{\\mathrm\{int\}\}^\{\\pi\}=\\inf\\\{t:m\(a\_\{t\}\)\\neq\\mathsf\{silent\}\\\},\\quad a\_\{t\}\\sim\\pi\(\\cdot\\mid b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)\.\(13\)The infimuminf\\infselects the earliest time satisfying the condition; if no non\-silent action ever occurs,Tintπ=\+∞T\_\{\\mathrm\{int\}\}^\{\\pi\}=\+\\inftyby convention\. This random stopping time describes when the policy actually first intervenes rather than a trigger fixed in advance\. For the relaxed optimal policy under fixed𝜼\\boldsymbol\{\\eta\}, conservative tie\-breaking makes this equal to the first time of positive intervention advantage along a trajectory that has remained silent\. This also explains why predicting whether a need currently exists is generally insufficient\. With the same need probability, poor candidate content or high execution risk can produce a different intervention advantage\.

The total value of asking includes its immediate interaction effect and the way an answer changes later decisions\. In the special case where an answer returns immediately andyyis a sufficient statistic for the resulting observation and feedback, questionqqhas value

Q𝜼∗​\(𝖺𝗌𝗄⁡\(q\)∣b,κ¯\)=\\displaystyle Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(\\mathsf\{ask\}\(q\)\\mid b,\\bar\{\\kappa\}\)=\{\}𝔼y∼P⁡\(y∣b,κ¯,q\)\[r𝜼\(b,κ¯,𝖺𝗌𝗄\(q\),y\)\\displaystyle\\mathbb\{E\}\_\{y\\sim P\(y\\mid b,\\bar\{\\kappa\},q\)\}\\\!\\left\[r\_\{\\boldsymbol\{\\eta\}\}\(b,\\bar\{\\kappa\},\\mathsf\{ask\}\(q\),y\)\\right\.\(14\)\+γV∗𝜼\(bq,y,κ¯q,y\)\]\.\\displaystyle\\left\.\{\}\+\\gamma V^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b^\{q,y\},\\bar\{\\kappa\}^\{q,y\}\)\\right\]\.Here,𝖺𝗌𝗄⁡\(q\)\\mathsf\{ask\}\(q\)is an asking action whose content is questionqq,P⁡\(y∣b,κ¯,q\)P\(y\\mid b,\\bar\{\\kappa\},q\)is the predictive distribution of possible answeryy,bq,yb^\{q,y\}is the posterior belief after that answer, andκ¯q,y\\bar\{\\kappa\}^\{q,y\}is the subsequent ledger, which changes only if the answer contains a verified permission event\. The termr𝜼​\(b,κ¯,𝖺𝗌𝗄⁡\(q\),y\)r\_\{\\boldsymbol\{\\eta\}\}\(b,\\bar\{\\kappa\},\\mathsf\{ask\}\(q\),y\)is the conditional expected immediate relaxed reward of asking given the belief, ledger, and received answeryy\. The expectation averages over all possible answers, adding this immediate reward to the discounted optimal value after the answer\. Only a protocol\-verified consent or revocation event may changeκ¯\\bar\{\\kappa\}\. In a one\-step approximation that ignores other immediate effects, letV0V\_\{0\}denote the optimal baseline value when the current question is disallowed and the process proceeds directly to the next decision, and letCQ​\(q\)C\_\{Q\}\(q\)be the direct burden or cost of askingqq\. The pure value of information is then𝔼y​\[V0​\(bq,y,κ¯q,y\)\]−V0​\(b,κ¯\)−CQ​\(q\)\\mathbb\{E\}\_\{y\}\[V\_\{0\}\(b^\{q,y\},\\bar\{\\kappa\}^\{q,y\}\)\]\-V\_\{0\}\(b,\\bar\{\\kappa\}\)\-C\_\{Q\}\(q\)\. If an answer changes neither the belief, authorization, nor downstream action values, this pure information value cannot be positive\. A question may nevertheless have an immediate politeness, commitment, or relational effect\. Qulac and clarifying\-question generation first made whether and what to ask directly evaluable in information retrieval, while conversational recommendation later used questions about usage context for preference elicitation\[[11](https://arxiv.org/html/2609.03727#bib.bib11),[28](https://arxiv.org/html/2609.03727#bib.bib28),[29](https://arxiv.org/html/2609.03727#bib.bib29)\]\. Recent clarification work further learns gating and question construction jointly\[[22](https://arxiv.org/html/2609.03727#bib.bib22),[30](https://arxiv.org/html/2609.03727#bib.bib30),[31](https://arxiv.org/html/2609.03727#bib.bib31),[23](https://arxiv.org/html/2609.03727#bib.bib23),[32](https://arxiv.org/html/2609.03727#bib.bib32)\]\. Visual ambiguity likewise changes the value of asking: AQuA selects among inference, enumeration, and clarification according to ambiguity, whereas the FoRLM workshop paper ClarifyVQA studies question generation under missing context\. The latter is workshop\-level method evidence, not evidence of deployment benefit\[[33](https://arxiv.org/html/2609.03727#bib.bib33),[34](https://arxiv.org/html/2609.03727#bib.bib34)\]\.

###### Proposition 1\(One\-step threshold special case for preordered candidates\)\.

Fix the other state variables and authorization, let the latent need beN∈\{0,1\}N\\in\\\{0,1\\\}andp=P⁡\(N=1∣b\)∈\[0,1\]p=P\(N=1\\mid b\)\\in\[0,1\], and let an application preorder a finite candidate set by interference or risk asa\(1\)≺⋯≺a\(K\)a^\{\(1\)\}\\prec\\cdots\\prec a^\{\(K\)\}\. IfUi​\(p\)=ui​0\+p​diU\_\{i\}\(p\)=u\_\{i0\}\+pd\_\{i\}, the optimal utility is the upper envelope of these affine functions\. For any pair withdi≠djd\_\{i\}\\neq d\_\{j\}, a valid switch can occur only at an intersection in\[0,1\]\[0,1\]:

pi​j=ui​0−uj​0dj−di\.p\_\{ij\}=\\frac\{u\_\{i0\}\-u\_\{j0\}\}\{d\_\{j\}\-d\_\{i\}\}\.\(15\)Here,KKis the number of candidate actions,ui​0=Ui​\(0\)u\_\{i0\}=U\_\{i\}\(0\)is candidateii’s utility intercept when the need variable is zero,did\_\{i\}is its utility slope with respect to need probabilitypp, andpi​jp\_\{ij\}is a potential switch probability at which candidatesiiandjjhave equal utility\. Only an intersection in\[0,1\]\[0,1\]that lies on the upper envelope changes the optimal action\. Ifdid\_\{i\}is nondecreasing in the predefined order, thenUj​\(p\)−Ui​\(p\)U\_\{j\}\(p\)\-U\_\{i\}\(p\)is nondecreasing inppfor everyj\>ij\>i\. Under fixed tie\-breaking, the index of the optimal action is therefore nondecreasing inpp\. Candidates dominated on the upper envelope may disappear from the optimal policy, and collinear candidates are resolved by the tie\-breaking rule\.

The proof follows because the upper envelope of affine functions changes only where two functions are equal, and the single\-crossing condition prevents pairwise preference from reversing twice asppincreases\. The classic mixed\-initiative expected\-utility analysis gives one instance with inaction, dialogue, and automated execution\[[2](https://arxiv.org/html/2609.03727#bib.bib2)\]; the proposition does not assume that𝖺𝗌𝗄,𝖺𝗌𝗌𝗂𝗌𝗍,𝖺𝖼𝗍\\mathsf\{ask\},\\mathsf\{assist\},\\mathsf\{act\}naturally form a linear autonomy order\. Lowering an intercept moves a threshold according to Eq\. \([15](https://arxiv.org/html/2609.03727#S2.E15)\) only when the added interruption or risk cost is independent ofNNand the remaining terms are fixed\. In general, a gate based only on need probability and a fixed threshold is not guaranteed to be optimal unless incremental value is monotone in that probability and other action attributes are fixed or correctly marginalized\.

## IIIA Decision\-Centered Synthesis of Methods

Fig\.[2](https://arxiv.org/html/2609.03727#S3.F2)gives the functional axis used in this survey\. A complete system converts history into a belief state, gates intervention within the feasible set, constructs and executes an action, and uses feedback to update its state or policy\. Sensing modality, application domain, autonomy level, and training paradigm are orthogonal properties rather than classes parallel to these four modules\. Representative systems often cover only part of the loop; recording that coverage helps distinguish proactive decision mechanisms from general supporting technology\.

![Refer to caption](https://arxiv.org/html/2609.03727v1/mechanisms_en_v10.png)Fig\. 2:Decision\-centered functional axis and non\-exclusive policy\-construction mechanisms\. A complete system maps history to a belief state, gates intervention, constructs a structured action, and adapts from feedback\. Prescribed, predictive, model\-based, and return\-optimizing mechanisms may span and combine across modules; row formulas and descriptors are mechanism signatures rather than empirical coverage\. Verified permission and severe\-risk constraints define hard feasibility; interruption, asking, privacy, and execution or rollback enter costs or budgets instead of being treated as equivalent hard constraints\.The four mechanism signatures in the figure use the following notation\. The mapggis directly specified by rules, thresholds, prompts, or SOPs\. The predictorfθf\_\{\\theta\}has parametersθ\\theta, andy^t\\hat\{y\}\_\{t\}is its estimated need, gate, or action label/score, with a hat denoting an estimate\. Model\-based methods explicitly use transition, observation, and reward components\(T,Z,r\)\(T,Z,r\);Q^\\hat\{Q\}andSplanS\_\{\\mathrm\{plan\}\}denote an estimated action value and a planning/search state\. Finally,maxπ⁡𝔼π​∑tγt​r𝜼,t\\max\_\{\\pi\}\\mathbb\{E\}\_\{\\pi\}\\sum\_\{t\}\\gamma^\{t\}r\_\{\\boldsymbol\{\\eta\},t\}denotes maximization of discounted cumulative relaxed reward over policiesπ\\pi\. These signatures identify how the policy mapping is constructed; they do not rank the four mechanisms\.

### III\-AFrom Observation to a Decision\-Ready Belief State

Opportunity detection and temporal segmentation\.In streaming screens, egocentric video, or sensor input, most moments contain no service event\. A system must first segment observations into decision opportunities and distinguish task signals from background activity and noise\. PIRA\-Bench evaluates interleaved latent intents in manually curated sequential GUI\-screenshot trajectories\[[35](https://arxiv.org/html/2609.03727#bib.bib35)\]; ESTP\-Bench couples answer content with an appropriate response time in egocentric video\[[16](https://arxiv.org/html/2609.03727#bib.bib16)\]; ContextAgent and Alpha\-Service map multimodal context to tool or service opportunities\[[36](https://arxiv.org/html/2609.03727#bib.bib36),[37](https://arxiv.org/html/2609.03727#bib.bib37)\]\. AppAgent\-Pro, published at CIKM 2025, further integrates cross\-application information to extend a literal request, illustrating how state construction can surface latent subgoals; it does not establish an open\-stream silence gate\[[38](https://arxiv.org/html/2609.03727#bib.bib38)\]\. In these streaming resources, key errors beyond language generation include omissions, duplicate segments, and noncausal use of future frames\. Evaluation should retain a predefined complete negative stream and timestamps\.

Need, interruptibility, and uncertainty\.Moving from an event to action also requires estimating whether help is needed, its urgency, and whether the user can be interrupted\. PASK combines need detection with user, workspace, and global memory\[[17](https://arxiv.org/html/2609.03727#bib.bib17)\]; Satori uses a belief–desire–intention model to explain the next need\[[39](https://arxiv.org/html/2609.03727#bib.bib39)\]; and ProMemAssist modulates intervention timing through working\-memory and interference models\[[40](https://arxiv.org/html/2609.03727#bib.bib40)\]\. The unified framework requires calibrated uncertainty rather than only an intent label, because Eqs\. \([9](https://arxiv.org/html/2609.03727#S2.E9)\) and \([12](https://arxiv.org/html/2609.03727#S2.E12)\) respectively evaluate a tail\-risk probability and the expected value of waiting\.

The conditional role of memory\.Long\-term memory matters for cross\-session preferences, recurrent tasks, and personal routines\. MemoryOS, HyMEM, and PersonalAlign respectively investigate hierarchical storage, structured trajectory memory, and personalization from longitudinal records\[[41](https://arxiv.org/html/2609.03727#bib.bib41),[42](https://arxiv.org/html/2609.03727#bib.bib42),[43](https://arxiv.org/html/2609.03727#bib.bib43)\]\. Memory nevertheless changes only howbtb\_\{t\}is constructed: a warning based on an immediate hazard may use no long\-term memory, whereas a system retrieving years of history only after an instruction remains reactive\. Longer memory also creates stale\-information, subject\-mismatch, and privacy costs\. Provenance, confidence, retention period, and deletion rights should therefore be represented in the state\.

### III\-BHow Policies Are Constructed: Four Non\-Exclusive Mechanisms

Table[II](https://arxiv.org/html/2609.03727#S3.T2)gives four stackable labels for how the online mapping\(bt,κ¯t\)↦at\(b\_\{t\},\\bar\{\\kappa\}\_\{t\}\)\\mapsto a\_\{t\}is constructed: whether a rule directly specifies the policy, a model fits need or action labels, transition or observation dynamics are explicit, and sequential return is optimized directly\. A compound system may receive several labels\. For example, offline reinforcement learning with Monte Carlo tree search contains both return\-optimizing and model\-based components, while whether its gate includes𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}still requires a separate annotation\.

TABLE II:Four non\-exclusive mechanisms for constructing a proactive policy\. Representative studies illustrate components; their inclusion does not imply that every study implements the complete four\-mode gate\.LabelOnline decision formMain design or training signalAdvantages and suitable conditionsTypical failures and representative workPrescribedRules, thresholds, prompts, or SOPs directly specify an action or policyExpert rules, few\-shot examples, program constraintsTransparent and inexpensive; suitable for stable permissions and enumerable risksThresholds transfer poorly across users and long\-horizon effects remain implicit; prompts and SOPs in\[[44](https://arxiv.org/html/2609.03727#bib.bib44),[45](https://arxiv.org/html/2609.03727#bib.bib45),[46](https://arxiv.org/html/2609.03727#bib.bib46)\]PredictiveA supervised model directly estimates a need, gate, or action labelHuman/model labels, preference pairs, confidenceScales to fixed protocols and supports high\-throughput offline testingLabels compress utility into a point target and calibration degrades under shift; examples in\[[14](https://arxiv.org/html/2609.03727#bib.bib14),[17](https://arxiv.org/html/2609.03727#bib.bib17),[22](https://arxiv.org/html/2609.03727#bib.bib22),[32](https://arxiv.org/html/2609.03727#bib.bib32)\]Model\-basedExplicit user/environment model, Bayesian update, POMDP, BDI, or searchTransition and observation models, simulator, heuristic valueCompares waiting, asking, and future effects, and makes constraints interpretableModel mismatch and planning cost; examples in\[[2](https://arxiv.org/html/2609.03727#bib.bib2),[47](https://arxiv.org/html/2609.03727#bib.bib47),[39](https://arxiv.org/html/2609.03727#bib.bib39),[48](https://arxiv.org/html/2609.03727#bib.bib48),[49](https://arxiv.org/html/2609.03727#bib.bib49),[50](https://arxiv.org/html/2609.03727#bib.bib50)\]Return\-optimizedBandits, RL, offline policy learning, or preference optimization maximize cumulative returnOutcome/process rewards, user or simulated feedbackHandles delayed outcomes and coupling between actionsReward misspecification, simulator bias, and insufficient offline support; examples in\[[51](https://arxiv.org/html/2609.03727#bib.bib51),[52](https://arxiv.org/html/2609.03727#bib.bib52),[53](https://arxiv.org/html/2609.03727#bib.bib53),[54](https://arxiv.org/html/2609.03727#bib.bib54),[55](https://arxiv.org/html/2609.03727#bib.bib55),[56](https://arxiv.org/html/2609.03727#bib.bib56)\]Prescribed and predictive components commonly compress future effects into expert rules or labels\. They are computationally light but have difficulty expressing the option value of waiting\. Model\-based components explicitly expandT,ZT,Z, or a search tree, and can evaluate Eq\. \([11](https://arxiv.org/html/2609.03727#S2.E11)\), but are sensitive to user\-model error\. Return\-optimizing components estimate long\-horizon value directly, yet if their training environment lacks silence, rejection, or authorization violations, they still optimize only a content policy\. In multi\-turn strategy tasks where a speaking turn is already available, EPO and CSO improve policy sequences through explicit strategic reasoning and preference/process optimization, respectively\. They show that return optimization can act on contentztz\_\{t\}, not that proactive gating over modemtm\_\{t\}has been learned\[[57](https://arxiv.org/html/2609.03727#bib.bib57),[58](https://arxiv.org/html/2609.03727#bib.bib58)\]\. Component comparisons therefore cannot be separated from the action space and feedback protocol\.

### III\-CJoint Intervention Gating and Action Construction

The gate selects a mode and time; the content policy selects a specific question, suggestion, or tool plan; and the delivery policy chooses channel, modality, and explanation\. Autonomy and external side effects are represented by mode and permission\. Goal guidance and policy planning in proactive dialogue\[[5](https://arxiv.org/html/2609.03727#bib.bib5),[59](https://arxiv.org/html/2609.03727#bib.bib59),[60](https://arxiv.org/html/2609.03727#bib.bib60),[61](https://arxiv.org/html/2609.03727#bib.bib61)\], preference elicitation and goal planning in conversational recommendation\[[9](https://arxiv.org/html/2609.03727#bib.bib9),[62](https://arxiv.org/html/2609.03727#bib.bib62),[63](https://arxiv.org/html/2609.03727#bib.bib63),[64](https://arxiv.org/html/2609.03727#bib.bib64),[65](https://arxiv.org/html/2609.03727#bib.bib65)\], and clarification in software engineering\[[66](https://arxiv.org/html/2609.03727#bib.bib66),[56](https://arxiv.org/html/2609.03727#bib.bib56)\]provide content\-construction mechanisms, but many listed experiments already grant the system a speaking turn\. DuRecDial 2\.0, TG\-ReDial, and INSPIRED add bilingual, topic\-guided, and sociable recommendation resources, but their protocols largely condition on an ongoing dialogue; they therefore support action construction and cross\-lingual evaluation rather than the silence gate\[[67](https://arxiv.org/html/2609.03727#bib.bib67),[68](https://arxiv.org/html/2609.03727#bib.bib68),[69](https://arxiv.org/html/2609.03727#bib.bib69)\]\. A WWW 2025 companion paper on influence\-path planning and a separate preprint on joint timing–content recommendation provide emerging mechanism evidence, not evidence of long\-term deployment benefit\[[70](https://arxiv.org/html/2609.03727#bib.bib70),[71](https://arxiv.org/html/2609.03727#bib.bib71)\]\. Applying these methods to open\-world proactive service also requires estimating the conditional value of content: even a high\-quality answer can have negative net utility at the wrong time\. A notification\-optimization preprint jointly models whether to send and future response, furnishing a methodological example of comparing intervention with silence over a longer horizon; because no formal proceedings record was verified, we do not treat it as published evidence\[[72](https://arxiv.org/html/2609.03727#bib.bib72)\]\.

The𝖺𝗌𝗄\\mathsf\{ask\},𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}, and𝖺𝖼𝗍\\mathsf\{act\}modes are not a simple linear scale of autonomy\. Asking can reduce epistemic uncertainty but adds cognitive burden; assistance preserves user control but can create choice architecture and overreliance; execution can save effort but introduces permission, rollback, and accountability\. Search and planning methods such as DPDP, PCQPR, EPL, and ChatSOP compare downstream effects of candidate policies\[[49](https://arxiv.org/html/2609.03727#bib.bib49),[50](https://arxiv.org/html/2609.03727#bib.bib50),[73](https://arxiv.org/html/2609.03727#bib.bib73),[46](https://arxiv.org/html/2609.03727#bib.bib46)\]\. To implement proactive gating in the sense of Eq\. \([12](https://arxiv.org/html/2609.03727#S2.E12)\), their root candidates should also contain𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}and the authorization levels feasible at that time\. Content evaluation should separately report conditional quality under a reference gate and end\-to\-end quality under the system gate, so that upstream false interventions remain visible\.

### III\-DFeedback, Personalization, and Continual Adaptation

Feedback operates at least at three timescales\. Immediate feedback \(an answer, rejection, or undo\) updates the current belief\. Task outcomes update the value of content and execution\. Across sessions, acceptance, trust, and burden change the long\-term user model\. These representative studies refresh memory or retrieve prior experience but do not provide controlled online updates of the gating policy\[[73](https://arxiv.org/html/2609.03727#bib.bib73),[41](https://arxiv.org/html/2609.03727#bib.bib41),[42](https://arxiv.org/html/2609.03727#bib.bib42),[43](https://arxiv.org/html/2609.03727#bib.bib43)\]\. These operations should be distinguished: writing a new event into memory does not show that a model maintains a stability–plasticity balance under preference drift\[[74](https://arxiv.org/html/2609.03727#bib.bib74)\]\.

Acceptance or task outcomes observed only after intervention create selective feedback\. The system sees a rejection after a poor suggestion, but when it remains silent it cannot observe whether help was needed\. Directly using visible acceptance as reward favors moments that are easy to accept and may overlook potential beneficiaries\. Continual adaptation generally requires versioned regression sets and preserved authorization boundaries\. Offline policy learning and counterfactual evaluation additionally require logging\-policy probabilities, and exploration is appropriate only when ethical and safety conditions permit it\. Section IV accordingly evaluates classification, timing, and policy value separately\.

## IVEvaluation Protocols, Benchmarks, and Evidence

### IV\-AA Common Decision Unit and Benchmark Schema

A comparable proactive\-service example should use apredefined complete stream of decision opportunitiesas its unit, rather than collecting only positive cases in which the system should help\. A study should state whether opportunities are constructed from fixed time slices, event changes, task stages, or user\-acceptable windows\. A minimal record includes session, user, and time; visible observations and the history window; current request status; a service opportunity and its valid interval; permissible actions; authorization and risk; the selected action and confidence; logging\-policy probability; whether the user saw, accepted, rejected, or undid the action; and task and long\-term outcomes\. Label provenance \(real user, expert, simulator, or LLM\) should also be explicit\. Conversation\-shape work shows that initiative and collaboration structure can be operationalized, although such dialogue\-level measures are not deployment utility\[[75](https://arxiv.org/html/2609.03727#bib.bib75)\]; multimodal ProactiveBench adds proactive inquiry under incomplete visual evidence\[[76](https://arxiv.org/html/2609.03727#bib.bib76)\]\. Table[III](https://arxiv.org/html/2609.03727#S4.T3)restates representative resources using the variables above, rather than comparing event counts, stages, and dataset counts in a single scale column\. To avoid collapsing realism, comparison, and follow\-up into one rank, R0–R4 describes only interaction/deployment realism from constructed cases to in\-situ use; C0/C1 records whether a prespecified condition or policy comparison exists; and H\-NA/H\-S/H\-L denotes no human outcome, short\-session outcomes, or longitudinal follow\-up linked at the individual level\. The descriptors are independent, and C1 does not by itself establish causality\.

TABLE III:Representative proactive\-service resources and studies restated under a common decision protocol\. Modes are only those directly supervised or evaluated; R/C/H denote interaction realism, comparison design, and human\-outcome horizon\.ResourceDecision unit and sourceDirect modesProtocol and direct outcomeR/C/HClariQ\[[12](https://arxiv.org/html/2609.03727#bib.bib12)\]Queries/topics; human clarification and relevance labels𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗄\\mathsf\{ask\}Static need classification and question ranking/retrievalR0/C0/H\-NAProactiveBench\[[14](https://arxiv.org/html/2609.03727#bib.bib14)\]Text events; 6,790 synthetic train, 233 real test𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Discrete positives/negatives; P/R/F1 and reward\-model acceptance proxyR0/C0/H\-NAPROBE\[[77](https://arxiv.org/html/2609.03727#bib.bib77)\]1,000 synthetic long\-document professional scenarios𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Injected bottleneck in every case; retrieval, identification, and plan selectionR0/C0/H\-NAAmbig\-SWE\[[66](https://arxiv.org/html/2609.03727#bib.bib66)\]Underspecified coding tasks; Full/Hidden/Interaction conditions𝖺𝗌𝗄\\mathsf\{ask\}/𝖺𝖼𝗍\\mathsf\{act\}Simulated interaction; detection, question quality, and solve rateR2/C1/H\-NAESTP\-Bench\[[16](https://arxiv.org/html/2609.03727#bib.bib16)\]890 Ego4D videos; 2,264 human\-verified timed QA𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Sequential frames and answer windows; ESTP\-F1, latency/FPSR1/C0/H\-NAPIRA\-Bench\[[35](https://arxiv.org/html/2609.03727#bib.bib35)\]100 curated GUI screenshot trajectories; injected/pure noise𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Complete offline stream; mean F1 and normalized false alarmsR1/C0/H\-NALatentNeeds\-Bench\[[17](https://arxiv.org/html/2609.03727#bib.bib17)\]100 real transcribed sessions \(3,936 turns\)𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Multiturn binary need; balanced accuracy and latencyR1/C0/H\-NAProAgentBench\[[15](https://arxiv.org/html/2609.03727#bib.bib15)\]One\-month computer logs; LLM invocation as need proxy𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Matched non\-invocation negatives; timing, intent, and query similarityR1/C0/H\-NAProactiveEval\[[78](https://arxiv.org/html/2609.03727#bib.bib78)\]Six simulated multiturn text scenarios𝖺𝗌𝗄\\mathsf\{ask\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Staged interaction; planning/guidance rubricR2/C0/H\-NAProactBench\[[79](https://arxiv.org/html/2609.03727#bib.bib79)\]Planner\-generated history and fixed trigger turn𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}No silence gate; stage and overall response scoresR0/C0/H\-NAWhen Not to Help\[[48](https://arxiv.org/html/2609.03727#bib.bib48)\]Three policies in a simplified POMDP user model𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}Long\-horizon simulation; model\-internal return/engagementR2/C1/H\-NAProMemAssist\[[40](https://arxiv.org/html/2609.03727#bib.bib40)\]12 participants; four glasses/object tasks; within\-subject study𝗌𝗂𝗅𝖾𝗇𝗍\\mathsf\{silent\}/𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}About 60 minutes; messages, reactions, scales, and burdenR3/C1/H\-SSCALA\[[80](https://arxiv.org/html/2609.03727#bib.bib80)\]1,508 students; semester\-long in\-situ classroom deployment𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}2,608 sessions; anonymous session\-level feedbackR4/C0/H\-SThe table exposes three gaps\. First, R0 resources diagnose static capabilities but cannot estimate how intervention changes a later trajectory\. Every PROBE case contains a bottleneck, so it tests what plan to identify and select rather than when to remain silent in an open stream; ProactBench likewise regenerates a response only at a fixed trigger turn\. Second, R1 complete streams improve negative and timing evaluation but remain offline replays whose observations are unaffected by model actions\. ProAgentBench uses the time of an LLM invocation as a proxy for need rather than user\-confirmed counterfactual ground truth\. Third, R2/C1 simulation supports policy comparison only inside its user model; ProMemAssist provides a short designed human comparison, whereas SCALA provides semester\-long observational deployment but, by design, does not link student identities to their queries and therefore cannot provide individual longitudinal outcomes\. The listed studies reach R4, but not H\-L, and none uses a comparison design that identifies long\-term incremental intervention value\. Offline scores therefore do not establish long\-term net utility\.

![Refer to caption](https://arxiv.org/html/2609.03727v1/evidence_matrix_en_v10.png)Fig\. 3:Per\-resource evidence matrix for the 13 representative resources and studies in Table III\. Each row records one interaction\-realism descriptor \(R0–R4\), one comparison descriptor \(C0/C1\), and one human\-outcome\-horizon descriptor \(H\-NA/H\-S/H\-L\); numbers above columns are marginal counts\. R, C, and H remain independent, and the matrix describes only the table sample rather than field prevalence\. Higher R or C1 alone does not establish causal identification or longitudinal benefit\.
### IV\-BFrom Classification Scores to Policy Value

Gating and calibration\.ForNNdecision opportunities with need labelsyi∈\{0,1\}y\_\{i\}\\in\\\{0,1\\\}, the prevalenceρ=N−1​∑iyi\\rho=N^\{\-1\}\\sum\_\{i\}y\_\{i\}must be reported first\. Accuracy in a sparse stream can be achieved by always remaining silent\. Evaluation should therefore combine precision, recall, F1 or PR\-AUC, balanced accuracy, and false interventions per hour or session:

FAH=\#​\{false interventions\}observed hours\.\\mathrm\{FAH\}=\\frac\{\\\#\\\{\\text\{false interventions\}\\\}\}\{\\text\{observed hours\}\}\.\(16\)Here,\#​\{⋅\}\\\#\\\{\\cdot\\\}is an event count: the numerator counts interventions without a reference need and the denominator is the total duration under complete observation\. ThusFAH\\mathrm\{FAH\}is the false\-intervention rate per observed hour\. In this paragraph,NNis the number of decision opportunities,iiindexes an opportunity,yiy\_\{i\}is its binary reference label,ρ\\rhois prevalence, andp^i\\hat\{p\}\_\{i\}is the estimated need probability\. If the system outputs a need probabilityp^i\\hat\{p\}\_\{i\}, the Brier scoreN−1​∑i\(p^i−yi\)2N^\{\-1\}\\sum\_\{i\}\(\\hat\{p\}\_\{i\}\-y\_\{i\}\)^\{2\}, calibration curves, and expected calibration error with confidence intervals should accompany discrimination metrics\. ECE is sensitive to binning and cannot be the sole calibration evidence\.

Event\-level timing\.Let the reference service events beℰ=\{\(\[lj,uj\],tj∗\)\}\\mathcal\{E\}=\\\{\(\[l\_\{j\},u\_\{j\}\],t\_\{j\}^\{\*\}\)\\\}and the predicted intervention times be𝒫\\mathcal\{P\}\. For eventjj,\[lj,uj\]\[l\_\{j\},u\_\{j\}\]is its valid intervention interval, with lower and upper boundsljl\_\{j\}anduju\_\{j\}, andtj∗t\_\{j\}^\{\*\}is the reference ideal time inside that interval\. Form a bipartite graph in which a prediction connects to an event when it falls in the valid interval\. Select a maximum\-cardinality one\-to\-one matching, and, if several exist, the one with minimum total absolute timing error; denote it byM⊆𝒫×ℰM\\subseteq\\mathcal\{P\}\\times\\mathcal\{E\}\. Then

PrecT=\|M\|\|𝒫\|,RecT=\|M\|\|ℰ\|,F1,T=2​P​r​e​cT​RecTPrecT\+RecT\.\\mathrm\{Prec\}\_\{T\}=\\frac\{\|M\|\}\{\|\\mathcal\{P\}\|\},\\quad\\mathrm\{Rec\}\_\{T\}=\\frac\{\|M\|\}\{\|\\mathcal\{E\}\|\},\\quad F\_\{1,T\}=\\frac\{2\\mathrm\{Prec\}\_\{T\}\\mathrm\{Rec\}\_\{T\}\}\{\\mathrm\{Prec\}\_\{T\}\+\\mathrm\{Rec\}\_\{T\}\}\.\(17\)Here,\|⋅\|\|\\cdot\|is set cardinality, andPrecT\\mathrm\{Prec\}\_\{T\},RecT\\mathrm\{Rec\}\_\{T\}, andF1,TF\_\{1,T\}are event\-level timing precision, recall, and their harmonic mean; subscriptTTdistinguishes timing from content quality\. If a corresponding denominator is empty, the metric is N/A rather than zero; ifPrecT\+RecT=0\\mathrm\{Prec\}\_\{T\}\+\\mathrm\{Rec\}\_\{T\}=0,F1,TF\_\{1,T\}is likewise recorded as N/A under the preregistered convention\. For every matched event, the signed errorej=t^j−tj∗e\_\{j\}=\\hat\{t\}\_\{j\}\-t\_\{j\}^\{\*\}should be reported, wheret^j\\hat\{t\}\_\{j\}is the prediction matched to reference eventjj;ej<0e\_\{j\}<0andej\>0e\_\{j\}\>0indicate early and late intervention\. Delay to the first valid intervention should be summarized separately\. Repeated alerts for one event match only once\. A fixed frame tolerance that is unrelated to a user\-acceptable interval replaces utility with annotation convenience\.

Action and end\-to\-end decomposition\.Four\-mode selection can be evaluated with macro\-F1 or a cost\-weighted confusion matrix, whereas content can use solve rate, verifiable correctness, or human judgment as appropriate\. Every content metric should include at least two conditions: evaluate\(z,ℓ\)\(z,\\ell\)under reference trigger conditions and evaluate the end\-to\-end system under its own gate\. The first localizes action\-construction capability; the second captures error propagation from false triggers\. Acceptance, ignoring, rejection, correction, and undo should also be separated\. A high acceptance rate can result from selecting easy users or persuasive defaults and cannot replace net utility\.

Policy and causal value\.LetYπY^\{\\pi\}be the task or long\-term outcome under policyπ\\pi, and let𝐂π\\mathbf\{C\}^\{\\pi\}be a vector of user burden, privacy, and risk costs\. With preregistered, dimensionally explicit scalarization weights𝝀\\boldsymbol\{\\lambda\}, deployment value relative to silence or an existing systemπ0\\pi\_\{0\}is

Δ​V​\(π,π0\)=𝔼⁡\[Yπ−Yπ0\]−𝝀⊤​𝔼​\[𝐂π−𝐂π0\]\.\\Delta V\(\\pi,\\pi\_\{0\}\)=\\mathbb\{E\}\[Y^\{\\pi\}\-Y^\{\\pi\_\{0\}\}\]\-\\boldsymbol\{\\lambda\}^\{\\top\}\\mathbb\{E\}\[\\mathbf\{C\}^\{\\pi\}\-\\mathbf\{C\}^\{\\pi\_\{0\}\}\]\.\(18\)Here,𝔼\\mathbb\{E\}averages over user and environment outcomes induced by the corresponding policy,𝝀⊤​𝐂\\boldsymbol\{\\lambda\}^\{\\top\}\\mathbf\{C\}is the inner product of the cost vector and nonnegative scalarization weights, andΔ​V​\(π,π0\)\\Delta V\(\\pi,\\pi\_\{0\}\)is the target policy’s net incremental value over the baseline\. A positive value means that incremental benefit exceeds added cost under the declared weights\. The same trajectory cannot reveal outcomes both with and without intervention\. In the contextual\-bandit special case \(one decision opportunity followed by its outcome\), data logged by a behavior policyμ\\muwith support overlap admit the inverse propensity estimator

V^IPS​\(π\)=1N​∑i=1Nπ⁡\(ai∣hi\)μ⁡\(ai∣hi\)​Ri,\\widehat\{V\}\_\{\\mathrm\{IPS\}\}\(\\pi\)=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\frac\{\\pi\(a\_\{i\}\\mid h\_\{i\}\)\}\{\\mu\(a\_\{i\}\\mid h\_\{i\}\)\}R\_\{i\},\(19\)In Eq\. \([19](https://arxiv.org/html/2609.03727#S4.E19)\),NNis the number of independent logged decision units andiiindexes a unit;hih\_\{i\},aia\_\{i\}, andRiR\_\{i\}are its logged history, action, and realized return\. The probabilitiesμ⁡\(ai∣hi\)\\mu\(a\_\{i\}\\mid h\_\{i\}\)andπ⁡\(ai∣hi\)\\pi\(a\_\{i\}\\mid h\_\{i\}\)are the propensities of that action under the behavior and target policies, and their ratio reweights the behavior log toward the target\-policy distribution\. The hat onV^IPS\\widehat\{V\}\_\{\\mathrm\{IPS\}\}denotes an estimate from finite data\. Support overlap requires every action with positive target\-policy probability to have positive behavior\-policy probability\. However, proactive interventions usually change subsequent states, so a whole trajectory cannot be compressed into independent samples\. For sequential trajectoryii, define

wi,t\\displaystyle w\_\{i,t\}=∏k=0tπ⁡\(ai,k∣hi,k\)μ⁡\(ai,k∣hi,k\),\\displaystyle=\\prod\_\{k=0\}^\{t\}\\frac\{\\pi\(a\_\{i,k\}\\mid h\_\{i,k\}\)\}\{\\mu\(a\_\{i,k\}\\mid h\_\{i,k\}\)\},\(20\)V^PDIS​\(π\)\\displaystyle\\widehat\{V\}\_\{\\mathrm\{PDIS\}\}\(\\pi\)=1N​∑i=1N∑t=0Tiγt​wi,t​ri,t\.\\displaystyle=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\sum\_\{t=0\}^\{T\_\{i\}\}\\gamma^\{t\}w\_\{i,t\}r\_\{i,t\}\.In Eq\. \([20](https://arxiv.org/html/2609.03727#S4.E20)\),NNinstead denotes the number of logged trajectories,TiT\_\{i\}is the final time of trajectoryii,kkindexes time inside the propensity product,ttindexes the current reward, andri,tr\_\{i,t\}is the observed one\-step reward\. The quantitywi,tw\_\{i,t\}is the cumulative importance weight through timett, andV^PDIS\\widehat\{V\}\_\{\\mathrm\{PDIS\}\}is the per\-decision importance\-sampling estimate\. Thiswi,tw\_\{i,t\}is an evaluation weight, distinct from the workload/interruptibility state componentwtw\_\{t\}in Eq\. \([2](https://arxiv.org/html/2609.03727#S2.E2)\);γ\\gammaremains the discount factor defined in Eq\. \([1](https://arxiv.org/html/2609.03727#S2.E1)\)\. Sequential doubly robust or model\-based estimators can also control variance\[[81](https://arxiv.org/html/2609.03727#bib.bib81),[82](https://arxiv.org/html/2609.03727#bib.bib82),[83](https://arxiv.org/html/2609.03727#bib.bib83)\]\. These methods require consistent outcome definitions, support of the target policy under the behavior policy, no unrecorded sequential confounding conditional on logged history, and complete action, probability, and outcome logs; sensitivity analysis is needed when assumptions may fail\. Importance weighting cannot identify actions outside the support of a deterministic log\. Work on the intervention paradox further shows that a high failure\-prediction AUROC can coexist with lower end\-to\-end success, because an intervention can rescue a failing trajectory or damage one that would have succeeded\[[84](https://arxiv.org/html/2609.03727#bib.bib84)\]\.

### IV\-CRisk, User Burden, and Reproducibility

Risk evaluation should cover bothincidenceandseverity: unauthorized\-action rate, severity\-weighted harm, near misses, successful undo or rollback, sensitive\-data exposure, and explanation–action consistency\. Let a larger selection scoreccindicate that intervention is more likely to be acceptable or beneficial, and letLLbe a prespecified loss on covered interventions, such as severe\-risk lossLRL\_\{R\}or a cost\-weighted error\. Selective\-intervention studies should report, as thresholdτ\\tauvaries,

Cov⁡\(τ\)=Pr⁡\(c≥τ\),Risk⁡\(τ\)=𝔼⁡\[L∣c≥τ\],\\mathrm\{Cov\}\(\\tau\)=\\Pr\(c\\geq\\tau\),\\qquad\\mathrm\{Risk\}\(\\tau\)=\\mathbb\{E\}\[L\\mid c\\geq\\tau\],\(21\)Here,Cov⁡\(τ\)\\mathrm\{Cov\}\(\\tau\)is the fraction of opportunities whose score reaches thresholdτ\\tau, andRisk⁡\(τ\)\\mathrm\{Risk\}\(\\tau\)is the conditional mean loss among those covered interventions; probability and expectation are taken over the deployment\-opportunity distribution\. The scalar selection scorecchere is distinct from the cost vector𝐜\\mathbf\{c\}in Eq\. \([1](https://arxiv.org/html/2609.03727#S2.E1)\)\. rather than only the result at a best threshold\. User burden should include interventions per unit time, question turns, rejection or ignoring, time to resume the primary task, and perceived interruption\. A short\-term click or “like” is not a proxy for long\-term trust\.

Reproducible experiments require fixed model versions, prompts, tool permissions, history windows, inference budgets, graders, and random seeds\. LLM\-based assessment should report the rubric, order randomization, agreement with human judgment, and sensitivity to alternative judge models\. For real streams, authors should state whether retrieval leaks future information, whether memories are isolated between users, and whether privacy filtering changes the negative distribution\. Public code and data links are one necessary condition, but do not replace a complete protocol or evidence from users\.

## VFrom Methods to Deployment Regimes

### V\-AThree Regimes Share the Same Decision Variables

Applications need not create another domain catalog\. Table[IV](https://arxiv.org/html/2609.03727#S5.T4)organizes work into three deployment regimes by observation continuity, time window, action reversibility, permission, and feedback delay\. The threshold and admissible set of the same method change systematically across regimes\.

TABLE IV:Mapping three deployment regimes to common decision variables\. Dominant risks and permissions are constraints, not judgments of a domain’s value\.RegimeState and timescaleTypical actionsDominant constraintsRepresentative work and suitable designDigital workspaceScreens, documents, code, and cross\-application events; seconds to daysClarification, drafts, GUI/tool executionInterleaved intents, account permissions, external side effects, rollbackPIRA, ProAgentBench, PersonalAlign, and Ambig\-SWE\[[35](https://arxiv.org/html/2609.03727#bib.bib35),[15](https://arxiv.org/html/2609.03727#bib.bib15),[43](https://arxiv.org/html/2609.03727#bib.bib43),[66](https://arxiv.org/html/2609.03727#bib.bib66)\]; reviewable𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}and tiered𝖺𝖼𝗍\\mathsf\{act\}Contextual and embodied environmentEgocentric video, wearables, and robot state; frames to minutesTimely cues, navigation, collaborative actionsPerception delay, bystander privacy, physical safety, human workloadESTP, ProMemAssist, Satori, and PACE\[[16](https://arxiv.org/html/2609.03727#bib.bib16),[40](https://arxiv.org/html/2609.03727#bib.bib40),[39](https://arxiv.org/html/2609.03727#bib.bib39),[85](https://arxiv.org/html/2609.03727#bib.bib85)\]; risk\-aware gating and action synchronizationHigh\-stakes human serviceIndividual state in health, education, and psychological support; turns to monthsIntervention messages, coaching questions, support policies, escalationProfessional scope, consent, long\-term effects, vulnerable users, fairnessJITAI, SCALA, and counseling/support systems\[[13](https://arxiv.org/html/2609.03727#bib.bib13),[86](https://arxiv.org/html/2609.03727#bib.bib86),[24](https://arxiv.org/html/2609.03727#bib.bib24),[80](https://arxiv.org/html/2609.03727#bib.bib80),[87](https://arxiv.org/html/2609.03727#bib.bib87),[88](https://arxiv.org/html/2609.03727#bib.bib88)\]; conservative𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}, professional oversight, and longitudinal evaluationIn digital workspaces, a richer𝖺𝖼𝗍\\mathsf\{act\}set is appropriate when actions are sandboxed and tested, their impact can be previewed, and external side effects can be rolled back\. Continuous screen capture nevertheless exposes information unrelated to the task, and reversibility is not costlessness\. Software\-engineering clarification shows that detecting underspecification, asking a useful question, and exploiting the answer are distinct bottlenecks\[[66](https://arxiv.org/html/2609.03727#bib.bib66),[56](https://arxiv.org/html/2609.03727#bib.bib56)\]\. In contextual and embodied environments, timing and perception errors are coupled: late help may be useless, while an incorrect physical action may cause harm\. Bayesian assistance and progress estimation incorporate uncertainty and human task progress into the gate\[[47](https://arxiv.org/html/2609.03727#bib.bib47),[85](https://arxiv.org/html/2609.03727#bib.bib85)\]\. HRI studies further distinguish anticipating a person’s next step from taking initiative on that prediction and examine how proactive behavior affects teamwork\[[19](https://arxiv.org/html/2609.03727#bib.bib19),[89](https://arxiv.org/html/2609.03727#bib.bib89)\]\. The proposed “Goldilocks” intervention window is a useful timing hypothesis, but presently a conceptual framework rather than evidence for a universal threshold\[[90](https://arxiv.org/html/2609.03727#bib.bib90)\]\. High\-stakes human services often have delayed outcomes, so offline appropriateness scores cannot establish clinical, educational, or psychological benefit\. Classroom studies and JITAI designs offer protocols closer to deployment but still require professional oversight and longitudinal controls\[[80](https://arxiv.org/html/2609.03727#bib.bib80),[13](https://arxiv.org/html/2609.03727#bib.bib13),[86](https://arxiv.org/html/2609.03727#bib.bib86)\]\.

Emotional\-support data and methods place affective trajectories, dialogue stage, and support strategy inside state–action construction: ESConv supplies strategy labels, while EmoDynamiX and ESCA model mixed\-emotion/discourse dynamics and stage\-aware strategy planning\[[91](https://arxiv.org/html/2609.03727#bib.bib91),[92](https://arxiv.org/html/2609.03727#bib.bib92),[93](https://arxiv.org/html/2609.03727#bib.bib93)\]\. AFlow and LEKIA currently provide only preprint evidence on affective flow and a situated “psychological world”; they are hypotheses for state construction, not evidence of psychological safety or clinical efficacy\[[94](https://arxiv.org/html/2609.03727#bib.bib94),[95](https://arxiv.org/html/2609.03727#bib.bib95)\]\. In education, GenMentor, TRAVER, and Learning\-to\-Prompt respectively study goal guidance, turn\-level verification, and adaptive prompting; as a companion paper, a Findings paper, and a preprint, they support mechanism or short\-horizon comparisons rather than longitudinal learning effects\[[96](https://arxiv.org/html/2609.03727#bib.bib96),[97](https://arxiv.org/html/2609.03727#bib.bib97),[98](https://arxiv.org/html/2609.03727#bib.bib98)\]\.

### V\-BEncoding Safety in the Action Space and Interaction Design

Equation \([9](https://arxiv.org/html/2609.03727#S2.E9)\) gives an abstract constraint, but systems also require operational safety mechanisms\.Tiered permissionseparates reading, drafting, reversible modification, external communication, and irreversible commitment; authorization should bind an object, purpose, and duration\.Progressive autonomylets an agent degrade from𝖺𝖼𝗍\\mathsf\{act\}to𝖺𝗌𝗌𝗂𝗌𝗍\\mathsf\{assist\}or𝖺𝗌𝗄\\mathsf\{ask\}under low confidence or high risk, rather than choose only between acting and not acting\.Recoverabilityrequires preview, impact scope, idempotent design, undo logs, and human takeover\.Auditable groundsshould faithfully record trigger evidence, material uncertainty, and permission checks instead of generating a post hoc account unrelated to the decision\.Data minimizationlimits sensing, memory, and retrieval to information necessary and proportionate to a declared purpose and authorized service scope, together with provenance tracking and user access and deletion\. Equation \([12](https://arxiv.org/html/2609.03727#S2.E12)\) is a utility model, not a legal or ethical necessity test\.

MindGuard and WatchGuardian provide system examples of an on\-device mental\-health agent and user\-defined just\-in\-time intervention, respectively, informing data minimization and personalized gating\. WatchGuardian is currently a preprint, and neither study by itself establishes clinical benefit\[[99](https://arxiv.org/html/2609.03727#bib.bib99),[100](https://arxiv.org/html/2609.03727#bib.bib100)\]\.

These mechanisms alter the optimal policy rather than merely adding an ethical statement\. Reversible action lowersCexecC^\{\\mathrm\{exec\}\}, clear authorization enlarges𝒜perm​\(κ¯t\)\\mathcal\{A\}\_\{\\mathrm\{perm\}\}\(\\bar\{\\kappa\}\_\{t\}\), on\-device processing lowersCprivC^\{\\mathrm\{priv\}\}, and repeated confirmation raisesCaskC^\{\\mathrm\{ask\}\}\. Safety design should therefore appear as a measurable variable in methods and evaluation, not as a principles list appended to the paper\.

### V\-CFour Testable Questions Implied by Current Evidence

Q1: How can counterfactual intervention value be learned?Current gates commonly learn a label for whether help is needed now, whereas Eq\. \([18](https://arxiv.org/html/2609.03727#S4.E18)\) asks what intervention changes relative to silence\. Where equipoise, ethics approval, and safety guardrails permit, a testable direction is to use micro\-randomized trials, encouragement designs, or conservative exploration at real decision opportunities, log behavior probabilities, and measure user\-endorsed net utility and long\-term outcomes\. Offline AUROC is an intermediate diagnostic rather than deployment evidence\.

Q2: How can need, content, and authorization be calibrated jointly?Proposition 1 shows that changes in the conditional utility of candidate actions can induce distinct switching thresholds; it does not impose a fixed autonomy order on the four semantic modes\. Future benchmarks can annotate the benefit–cost tradeoffs of multiple candidate actions under the same state, compare an independent need classifier with a fixed action against an approximate jointQ𝜼∗​\(b,κ¯,m,z,ℓ\)Q^\{\*\}\_\{\\boldsymbol\{\\eta\}\}\(b,\\bar\{\\kappa\},m,z,\\ell\)model, and report calibration, coverage–risk, and overreach\. An improvement in content score without an improvement in net utility does not establish a better gate\.

Q3: How can an agent adapt safely under preference drift?Accept and reject signals are selectively generated by the old policy, while long\-term memory may retain obsolete goals\. Evaluation should partition time and users to test drift detection, policy update, forgetting of stale preferences, and safety regression\. At minimum it should jointly report post\-adaptation benefit, old\-scenario performance, authorization violations, and user deletion controls, rather than only memory question\-answering accuracy\.

Q4: How can a common protocol cross regimes without erasing their constraints?A single overall leaderboard hides differences in time windows, risk, and feedback\. A more defensible design shares the decision\-opportunity record, four\-mode confusion matrix, event matching, and policy value, and separately reports interaction realism R, comparison design C, and human\-outcome horizon H\. Comparisons can then remain within digital, embodied, and high\-stakes regimes\. This preserves contextual constraints while testing whether the same formal claim holds across domains\.

## VIConclusion

Proactive service is not the ability to generate an unsolicited sentence\. It is a system’s autonomous selection, under a genuine silence alternative and incomplete information, of a trigger, subgoal, question, or action not fully specified by the current directive\. Formulating this choice as sequential decision making constrained by authorization and risk unifies timing, content, and delivery as a structured action\. Waiting acquires option value; the pure information value of clarification depends on whether it changes later action value, while its total value may also include immediate interaction effects\.

The representative studies reviewed here offer state estimation, policy planning, clarification learning, and streaming resources, but the evidence in Table[III](https://arxiv.org/html/2609.03727#S4.T3)is concentrated in constructed samples, offline replay, and short\-term simulation\. Higher trigger F1, more fluent advice, or longer memory is insufficient by itself to establish deployment benefit\. A central next step is to learn the causal incremental value of intervention relative to silence, while constraining policies through calibrated uncertainty, explicit authorization, progressive autonomy, recoverable execution, and longitudinal user outcomes\. Proactivity approaches trustworthy service when evaluation shows that the agent reliably waits under insufficient evidence, improves net utility when it intervenes, and leaves auditable grounds for the decision\.

## References

- \[1\]M\. Walker and S\. Whittaker, “Mixed Initiative in Dialogue: An Investigation into Discourse Segmentation,” in*28th Annual Meeting of the Association for Computational Linguistics \(ACL\)*, 1990, pp\. 70–78\. \[Online\]\. Available:[https://aclanthology\.org/P90\-1010/](https://aclanthology.org/P90-1010/)
- \[2\]E\. Horvitz, “Principles of Mixed\-Initiative User Interfaces,” in*Proceedings of the SIGCHI Conference on Human Factors in Computing Systems*, 1999, pp\. 159–166\. \[Online\]\. Available:[https://doi\.org/10\.1145/302979\.303030](https://doi.org/10.1145/302979.303030)
- \[3\]E\. Horvitz, A\. Jacobs, and D\. Hovel, “Attention\-Sensitive Alerting,” in*Proceedings of the Fifteenth Conference on Uncertainty in Artificial Intelligence*, 1999, pp\. 305–313, original UAI 1999 paper; arXiv version deposited in 2013\. \[Online\]\. Available:[https://arxiv\.org/abs/1301\.6707](https://arxiv.org/abs/1301.6707)
- \[4\]E\. Horvitz, C\. Kadie, T\. Paek, and D\. Hovel, “Models of Attention in Computing and Communication: From Principles to Applications,”*Communications of the ACM*, vol\. 46, no\. 3, pp\. 52–59, 2003\. \[Online\]\. Available:[https://doi\.org/10\.1145/636772\.636798](https://doi.org/10.1145/636772.636798)
- \[5\]W\. Wu, Z\. Guo, X\. Zhou, H\. Wu, X\. Zhang, R\. Lian, and H\. Wang, “Proactive Human\-Machine Conversation with Explicit Conversation Goal,” in*Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics \(ACL\)*, 2019, pp\. 3794–3804\. \[Online\]\. Available:[https://aclanthology\.org/P19\-1369/](https://aclanthology.org/P19-1369/)
- \[6\]Y\. Deng, W\. Lei, W\. Lam, and T\.\-S\. Chua, “A Survey on Proactive Dialogue Systems: Problems, Methods, and Prospects,” in*Proceedings of the Thirty\-Second International Joint Conference on Artificial Intelligence*, 2023, pp\. 6583–6591\. \[Online\]\. Available:[https://www\.ijcai\.org/proceedings/2023/738](https://www.ijcai.org/proceedings/2023/738)
- \[7\]Y\. Deng, L\. Liao, W\. Lei, G\. H\. Yang, W\. Lam, and T\.\-S\. Chua, “Proactive Conversational AI: A Comprehensive Survey of Advancements and Opportunities,”*ACM Transactions on Information Systems \(TOIS\)*, vol\. 43, no\. 3, pp\. 1–45, 2025\. \[Online\]\. Available:[https://dl\.acm\.org/doi/10\.1145/3715097](https://dl.acm.org/doi/10.1145/3715097)
- \[8\]Y\. Deng, L\. Liao, Z\. Zheng, G\. H\. Yang, and T\.\-S\. Chua, “Towards Human\-centered Proactive Conversational Agents,” in*Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval*, 2024, pp\. 807–818\. \[Online\]\. Available:[https://doi\.org/10\.1145/3626772\.3657843](https://doi.org/10.1145/3626772.3657843)
- \[9\]Z\. Liu, H\. Wang, Z\.\-Y\. Niu, H\. Wu, W\. Che, and T\. Liu, “Towards Conversational Recommendation over Multi\-Type Dialogs,” in*Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics*, 2020, pp\. 1036–1049\. \[Online\]\. Available:[https://aclanthology\.org/2020\.acl\-main\.98/](https://aclanthology.org/2020.acl-main.98/)
- \[10\]D\. Jannach, A\. Manzoor, W\. Cai, and L\. Chen, “A Survey on Conversational Recommender Systems,”*ACM Computing Surveys*, vol\. 54, no\. 5, pp\. 1–36, 2021\. \[Online\]\. Available:[https://dl\.acm\.org/doi/10\.1145/3453154](https://dl.acm.org/doi/10.1145/3453154)
- \[11\]M\. Aliannejadi, H\. Zamani, F\. Crestani, and W\. B\. Croft, “Asking Clarifying Questions in Open\-Domain Information\-Seeking Conversations,” in*Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval \(SIGIR\)*, 2019, pp\. 475–484\. \[Online\]\. Available:[https://doi\.org/10\.1145/3331184\.3331265](https://doi.org/10.1145/3331184.3331265)
- \[12\]M\. Aliannejadi, J\. Kiseleva, A\. Chuklin, J\. Dalton, and M\. Burtsev, “Building and Evaluating Open\-Domain Dialogue Corpora with Clarifying Questions,” in*Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing*, 2021, pp\. 4473–4484\. \[Online\]\. Available:[https://aclanthology\.org/2021\.emnlp\-main\.367/](https://aclanthology.org/2021.emnlp-main.367/)
- \[13\]I\. Nahum\-Shani, S\. N\. Smith, B\. J\. Spring, L\. M\. Collins, K\. Witkiewitz, A\. Tewari, and S\. A\. Murphy, “Just\-in\-time adaptive interventions \(JITAIs\) in mobile health: Key components and design principles for ongoing health behavior support,”*Annals of Behavioral Medicine*, vol\. 52, no\. 6, pp\. 446–462, 2018\.
- \[14\]Y\. Lu, S\. Yang, C\. Qian, G\. Chen, Q\. Luo, Y\. Wu, H\. Wang, X\. Cong, Z\. Zhang, Y\. Lin, W\. Liu, Y\. Wang, Z\. Liu, F\. Liu, and M\. Sun, “Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistance,” in*The Thirteenth International Conference on Learning Representations \(ICLR 2025\)*, 2025, published as an ICLR 2025 conference paper\. \[Online\]\. Available:[https://openreview\.net/forum?id=sRIU6k2TcU](https://openreview.net/forum?id=sRIU6k2TcU)
- \[15\]Y\. Tang, H\. Tang, T\. Cao, L\. Nguyen, A\. Zhang, X\. Cao, C\. Liu, W\. Ding, and Y\. Li, “ProAgentBench: Evaluating LLM Agents for Proactive Assistance with Real\-World Data,”*arXiv preprint arXiv:2602\.04482*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2602\.04482](https://arxiv.org/abs/2602.04482)
- \[16\]X\. Yu, C\. Shi, Y\. Wang, and S\. Yang, “Eyes Wide Open: Ego Proactive Video\-LLM for Streaming Video,” in*Advances in Neural Information Processing Systems 38 \(NeurIPS 2025\)*, 2025, pp\. 15 062–15 105, current NeurIPS electronic proceedings metadata list Xueyang Yu, whereas the frozen proceedings PDF lists Yulin Zhang\. This entry follows the latest official electronic metadata under the NeurIPS author name\-change policy\. \[Online\]\. Available:[https://proceedings\.neurips\.cc/paper\_files/paper/2025/hash/141304a37d59ec7f116f3535f1b74bde\-Abstract\-Conference\.html](https://proceedings.neurips.cc/paper_files/paper/2025/hash/141304a37d59ec7f116f3535f1b74bde-Abstract-Conference.html)
- \[17\]Z\. Xie, Z\. Hu, F\. Ye, X\. Zhang, H\. Chai, Z\. Liu, P\. Wu, G\. Zhang, Y\. Liao, X\. Hu, D\. Ye, C\. Miao, and S\. Yan, “PASK: Toward Intent\-Aware Proactive Agents with Long\-Term Memory,”*arXiv preprint arXiv:2604\.08000*, 2026, technical report; the arXiv record identifies the work as in progress\. \[Online\]\. Available:[https://arxiv\.org/abs/2604\.08000](https://arxiv.org/abs/2604.08000)
- \[18\]S\. Brenna, E\. Jezek, and B\. Magnini, “Investigating Proactivity in Task\-Oriented Dialogues,”*Dialogue & Discourse*, vol\. 16, no\. 1, pp\. 31–67, 2025\. \[Online\]\. Available:[https://doi\.org/10\.5210/dad\.2025\.102](https://doi.org/10.5210/dad.2025.102)
- \[19\]J\. E\. Domínguez\-Vidal and A\. Sanfeliu, “Anticipation and Proactivity\. Unraveling Both Concepts in Human\-Robot Interaction through a Handover Example,” in*2024 33rd IEEE International Conference on Robot and Human Interactive Communication \(RO\-MAN\)*, 2024, pp\. 957–962\. \[Online\]\. Available:[https://doi\.org/10\.1109/RO\-MAN60168\.2024\.10731441](https://doi.org/10.1109/RO-MAN60168.2024.10731441)
- \[20\]N\. Zargham, S\. Ferguson, J\. Sin, C\. Munteanu, and A\. Kuzminykh, “Proactive Systems in HCI and AI: Concepts, Challenges, and Opportunities,”*arXiv preprint arXiv:2606\.25149*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2606\.25149](https://arxiv.org/abs/2606.25149)
- \[21\]J\. Y\. Lee, S\. Kim, K\. Mehta, J\.\-Y\. Kao, Y\.\-H\. Lin, and A\. Gupta, “Redefining Proactivity for Information Seeking Dialogue,” in*Proceedings of the Second Workshop on Social Influence in Conversations \(SICon 2024\)*, 2024, pp\. 64–84\. \[Online\]\. Available:[https://aclanthology\.org/2024\.sicon\-1\.5/](https://aclanthology.org/2024.sicon-1.5/)
- \[22\]A\. Testoni and R\. Fernández, “Asking the Right Question at the Right Time: Human and Model Uncertainty Guidance to Ask Clarification Questions,” in*Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2024, pp\. 258–275\. \[Online\]\. Available:[https://aclanthology\.org/2024\.eacl\-long\.16/](https://aclanthology.org/2024.eacl-long.16/)
- \[23\]Z\. Cao, B\. Wen, and L\. L\. Wang, “Clarify or Answer: Reinforcement Learning for Agentic VQA with Context Under\-specification,”*arXiv preprint arXiv:2601\.16400*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2601\.16400](https://arxiv.org/abs/2601.16400)
- \[24\]D\. Haag, D\. Kumar, S\. Gruber, D\. P\. Hofer, M\. Sareban, G\. Treff, J\. Niebauer, C\. N\. Bull, A\. Schmidt, and J\. D\. Smeddinck, “The Last JITAI? Exploring Large Language Models for Issuing Just\-in\-Time Adaptive Interventions: Fostering Physical Activity in a Prospective Cardiac Rehabilitation Setting,” in*Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems*, 2025\. \[Online\]\. Available:[https://doi\.org/10\.1145/3706598\.3713307](https://doi.org/10.1145/3706598.3713307)
- \[25\]K\. J\. K\. Feng, D\. W\. McDonald, and A\. X\. Zhang, “Levels of Autonomy for AI Agents,”*arXiv preprint arXiv:2506\.12469*, 2025, also published in the Knight First Amendment Institute’s AI and Democratic Freedoms essay series\. \[Online\]\. Available:[https://arxiv\.org/abs/2506\.12469](https://arxiv.org/abs/2506.12469)
- \[26\]L\. P\. Kaelbling, M\. L\. Littman, and A\. R\. Cassandra, “Planning and acting in partially observable stochastic domains,”*Artificial Intelligence*, vol\. 101, no\. 1–2, pp\. 99–134, 1998\.
- \[27\]P\. Poupart, A\. Malhotra, P\. Pei, K\.\-E\. Kim, B\. Goh, and M\. Bowling, “Approximate linear programming for constrained partially observable markov decision processes,” in*Proceedings of the Twenty\-Ninth AAAI Conference on Artificial Intelligence*, 2015, pp\. 3342–3348\.
- \[28\]H\. Zamani, S\. Dumais, N\. Craswell, P\. Bennett, and G\. Lueck, “Generating Clarifying Questions for Information Retrieval,” in*Proceedings of The Web Conference 2020 \(WWW\)*, 2020, pp\. 418–428\. \[Online\]\. Available:[https://doi\.org/10\.1145/3366423\.3380126](https://doi.org/10.1145/3366423.3380126)
- \[29\]I\. Kostric, K\. Balog, and F\. Radlinski, “Generating Usage\-related Questions for Preference Elicitation in Conversational Recommender Systems,”*ACM Transactions on Recommender Systems*, vol\. 2, no\. 2, pp\. 1–24, 2024\. \[Online\]\. Available:[https://krisztianbalog\.com/files/tors2024\-crs\-questions\.pdf](https://krisztianbalog.com/files/tors2024-crs-questions.pdf)
- \[30\]C\. Andukuri, J\.\-P\. Fränken, T\. Gerstenberg, and N\. D\. Goodman, “STaR\-GATE: Teaching Language Models to Ask Clarifying Questions,” in*Conference on Language Modeling \(COLM\)*, 2024\. \[Online\]\. Available:[https://openreview\.net/forum?id=CrzAj0kZjR](https://openreview.net/forum?id=CrzAj0kZjR)
- \[31\]M\. J\. Q\. Zhang, W\. B\. Knox, and E\. Choi, “Modeling Future Conversation Turns to Teach LLMs to Ask Clarifying Questions,” in*ICLR*, 2025\. \[Online\]\. Available:[https://proceedings\.iclr\.cc/paper\_files/paper/2025/file/97e2df4bb8b2f1913657344a693166a2\-Paper\-Conference\.pdf](https://proceedings.iclr.cc/paper_files/paper/2025/file/97e2df4bb8b2f1913657344a693166a2-Paper-Conference.pdf)
- \[32\]N\. Edwards and S\. Schuster, “Ask or Assume? Uncertainty\-Aware Clarification\-Seeking in Coding Agents,”*arXiv preprint arXiv:2603\.26233*, 2026, submitted to the ACL Rolling Review, March 2026 cycle; no acceptance claim is made\. \[Online\]\. Available:[https://arxiv\.org/abs/2603\.26233](https://arxiv.org/abs/2603.26233)
- \[33\]J\. Jang and H\. Kim, “AQuA: Toward Strategic Response Generation for Ambiguous Visual Questions,” in*International Conference on Learning Representations \(ICLR\)*, 2026\. \[Online\]\. Available:[https://openreview\.net/forum?id=7b1MpD6IF8](https://openreview.net/forum?id=7b1MpD6IF8)
- \[34\]Z\. Cao, B\. Wen, and L\. L\. Wang, “Asking the Missing Piece: Context\-Driven Clarification for Ambiguous VQA,” in*FoRLM*, 2025\. \[Online\]\. Available:[https://openreview\.net/forum?id=VBmxXLvQYM](https://openreview.net/forum?id=VBmxXLvQYM)
- \[35\]Y\. Chai, S\. Tang, H\. Xiao, R\. Liu, and H\. Li, “PIRA\-Bench: A Transition from Reactive GUI Agents to GUI\-based Proactive Intent Recommendation Agents,”*arXiv preprint arXiv:2603\.08013*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2603\.08013](https://arxiv.org/abs/2603.08013)
- \[36\]B\. Yang, L\. Xu, L\. Zeng, K\. Liu, S\. Jiang, W\. Lu, H\. Chen, X\. Jiang, G\. Xing, and Z\. Yan, “ContextAgent: Context\-Aware Proactive LLM Agents with Open\-World Sensory Perceptions,” in*Advances in Neural Information Processing Systems 38*, 2025\. \[Online\]\. Available:[https://openreview\.net/forum?id=tRXt10xKc5](https://openreview.net/forum?id=tRXt10xKc5)
- \[37\]Z\. Wen, Y\. Wang, C\. Liao, B\. Yang, J\. Li, W\. Liu, H\. He, B\. Feng, X\. Liu, Y\. Lyu, X\. Zheng, X\. Hu, and L\. Zhang, “AI for Service: Proactive Assistance with AI Glasses,”*arXiv preprint arXiv:2510\.14359*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2510\.14359](https://arxiv.org/abs/2510.14359)
- \[38\]Y\. Zhao, W\. Shi, F\. Feng, and X\. He, “AppAgent\-Pro: A Proactive GUI Agent System for Multidomain Information Integration and User Assistance,” in*Proceedings of the 34th ACM International Conference on Information and Knowledge Management*, 2025, pp\. 6767–6771\. \[Online\]\. Available:[https://doi\.org/10\.1145/3746252\.3761473](https://doi.org/10.1145/3746252.3761473)
- \[39\]C\. Li, G\. Wu, G\. Y\.\-Y\. Chan, D\. G\. Turakhia, S\. C\. Quispe, D\. Li, L\. Welch, C\. T\. Silva, and J\. Qian, “Satori: Towards Proactive AR Assistant with Belief\-Desire\-Intention User Modeling,” in*Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems*, 2025, pp\. 1–24, the official title also includes a Japanese\-script rendering of “Satori”; the displayed title uses its Latin form for cross\-template font compatibility\. \[Online\]\. Available:[https://dl\.acm\.org/doi/10\.1145/3706598\.3714188](https://dl.acm.org/doi/10.1145/3706598.3714188)
- \[40\]K\. Pu, T\. Zhang, N\. Sendhilnathan, S\. Freitag, R\. Sodhi, and T\. R\. Jonker, “ProMemAssist: Exploring Timely Proactive Assistance Through Working Memory Modeling in Multi\-Modal Wearable Devices,” in*Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology \(UIST\)*, 2025, pp\. 1–19, article 56; current ACM/Crossref metadata use the author form Tanya R\. Jonker\. \[Online\]\. Available:[https://doi\.org/10\.1145/3746059\.3747770](https://doi.org/10.1145/3746059.3747770)
- \[41\]J\. Kang, M\. Ji, Z\. Zhao, and T\. Bai, “Memory OS of AI Agent,” in*Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing*, 2025, pp\. 25 961–25 970\. \[Online\]\. Available:[https://aclanthology\.org/2025\.emnlp\-main\.1318/](https://aclanthology.org/2025.emnlp-main.1318/)
- \[42\]S\. Zhu, W\. Wu, K\. Zhou, S\. Wang, and B\. Huang, “Hybrid Self\-evolving Structured Memory for GUI Agents,”*arXiv preprint arXiv:2603\.10291*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2603\.10291](https://arxiv.org/abs/2603.10291)
- \[43\]Y\. Lyu, G\. Chen, R\. Shao, W\. Guan, and L\. Nie, “PersonalAlign: Hierarchical Implicit Intent Alignment for Personalized GUI Agent with Long\-Term User\-Centric Records,” in*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2026, pp\. 36 074–36 089\. \[Online\]\. Available:[https://aclanthology\.org/2026\.acl\-long\.1669/](https://aclanthology.org/2026.acl-long.1669/)
- \[44\]Y\. Deng, L\. Liao, L\. Chen, H\. Wang, W\. Lei, and T\.\-S\. Chua, “Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target\-guided, and Non\-collaboration,” in*Findings of the Association for Computational Linguistics: EMNLP 2023*, 2023, pp\. 10 602–10 621\. \[Online\]\. Available:[https://aclanthology\.org/2023\.findings\-emnlp\.711/](https://aclanthology.org/2023.findings-emnlp.711/)
- \[45\]M\. Chen, X\. Yu, W\. Shi, U\. Awasthi, and Z\. Yu, “Controllable Mixed\-Initiative Dialogue Generation through Prompting,” in*Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics \(Volume 2: Short Papers\)*, 2023, pp\. 951–966\. \[Online\]\. Available:[https://aclanthology\.org/2023\.acl\-short\.82/](https://aclanthology.org/2023.acl-short.82/)
- \[46\]Z\. Li, J\. Peng, Y\. Wang, Y\. Cao, T\. Shen, M\. Zhang, L\. Su, S\. Wu, Y\. Wu, Y\. Wang, Y\. Wang, W\. Hu, J\. Li, S\. Wang, J\. Xiao, and D\. Xiong, “ChatSOP: An SOP\-Guided MCTS Planning Framework for Controllable LLM Dialogue Agents,” in*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2025, pp\. 17 637–17 659\. \[Online\]\. Available:[https://aclanthology\.org/2025\.acl\-long\.863/](https://aclanthology.org/2025.acl-long.863/)
- \[47\]A\. Andriella, I\. Cucciniello, A\. Origlia, and S\. Rossi, “A Bayesian Framework for Learning Proactive Robot Behaviour in Assistive Tasks,”*User Modeling and User\-Adapted Interaction*, vol\. 35, 2025, published online 26 December 2024\. \[Online\]\. Available:[https://doi\.org/10\.1007/s11257\-024\-09421\-1](https://doi.org/10.1007/s11257-024-09421-1)
- \[48\]M\. Steyvers and L\. Mayer, “When not to help: planning for lasting human\-AI collaboration,”*arXiv preprint arXiv:2508\.01837*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2508\.01837](https://arxiv.org/abs/2508.01837)
- \[49\]T\. He, L\. Liao, Y\. Cao, Y\. Liu, M\. Liu, Z\. Chen, and B\. Qin, “Planning Like Human: A Dual\-process Framework for Dialogue Planning,” in*Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2024, pp\. 4768–4791\. \[Online\]\. Available:[https://aclanthology\.org/2024\.acl\-long\.262/](https://aclanthology.org/2024.acl-long.262/)
- \[50\]S\. Guo, L\. Liao, J\. Zhang, C\. Li, and H\. Chen, “PCQPR: Proactive Conversational Question Planning with Reflection,” in*Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing*, 2024, pp\. 11 266–11 278\. \[Online\]\. Available:[https://aclanthology\.org/2024\.emnlp\-main\.631/](https://aclanthology.org/2024.emnlp-main.631/)
- \[51\]H\. Yu, Z\. Qi, Y\. Zhao, K\. Nottingham, K\. Xuan, B\. P\. Majumder, H\. Zhu, P\. P\. Liang, and J\. You, “Sotopia\-RL: Reward Design for Social Intelligence,”*arXiv preprint arXiv:2508\.03905*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2508\.03905](https://arxiv.org/abs/2508.03905)
- \[52\]C\. Qian, Z\. Liu, A\. Prabhakar, J\. Qiu, Z\. Liu, H\. Chen, S\. Kokane, H\. Ji, W\. Yao, S\. Heinecke, S\. Savarese, C\. Xiong, and H\. Wang, “UserRL: Training Interactive User\-Centric Agent via Reinforcement Learning,”*arXiv preprint arXiv:2509\.19736*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2509\.19736](https://arxiv.org/abs/2509.19736)
- \[53\]H\. Wang, Y\. Chen, L\. Luo, B\. Zhang, E\. D\. Wen, and P\. Li, “Implicit Turn\-Wise Policy Optimization for Proactive User\-LLM Interaction,”*arXiv preprint arXiv:2603\.23550*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2603\.23550](https://arxiv.org/abs/2603.23550)
- \[54\]Y\. Dou and J\. Liu, “TO\-GATE: Clarifying Questions and Summarizing Responses with Trajectory Optimization for Eliciting Human Preference,”*Proceedings of the AAAI Conference on Artificial Intelligence*, vol\. 40, no\. 36, pp\. 30 548–30 556, 2026\. \[Online\]\. Available:[https://ojs\.aaai\.org/index\.php/AAAI/article/view/40309](https://ojs.aaai.org/index.php/AAAI/article/view/40309)
- \[55\]E\. C\. Acikgoz, J\. Oh, J\. Hao, J\. H\. Jeon, H\. Ji, D\. Hakkani\-Tur, G\. Tur, X\. Li, C\. Ma, and X\. Fan, “SpeakRL: Synergizing Reasoning, Speaking, and Acting in Language Models with Reinforcement Learning,” in*Proceedings of the 16th International Workshop on Spoken Dialogue System Technology*, 2026, pp\. 312–325\. \[Online\]\. Available:[https://aclanthology\.org/2026\.iwsds\-1\.32/](https://aclanthology.org/2026.iwsds-1.32/)
- \[56\]S\. Vijayvargiya, V\. Viswanathan, and G\. Neubig, “Asking What Matters: Reward\-Driven Clarification for Software Engineering Tasks,”*arXiv preprint arXiv:2604\.14624*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2604\.14624](https://arxiv.org/abs/2604.14624)
- \[57\]X\. Liu, K\. Wang, Y\. Li, Y\. Wu, W\. Ma, A\. Kong, F\. Huang, J\. Jiao, and J\. Zhang, “EPO: Explicit Policy Optimization for Strategic Reasoning in LLMs via Reinforcement Learning,” in*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2025, pp\. 15 371–15 396\. \[Online\]\. Available:[https://aclanthology\.org/2025\.acl\-long\.747/](https://aclanthology.org/2025.acl-long.747/)
- \[58\]W\. Zhao, X\. Sui, X\. Han, Y\. Deng, Y\. Hu, J\. Guo, L\. Qin, Q\. Du, S\. Wang, Y\. Zhao, B\. Qin, and T\. Liu, “Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter,” in*Findings of the Association for Computational Linguistics: EMNLP 2025*, 2025, pp\. 15 361–15 381\. \[Online\]\. Available:[https://aclanthology\.org/2025\.findings\-emnlp\.831/](https://aclanthology.org/2025.findings-emnlp.831/)
- \[59\]J\. Tang, T\. Zhao, C\. Xiong, X\. Liang, E\. P\. Xing, and Z\. Hu, “Target\-Guided Open\-Domain Conversation,” in*Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics \(ACL\)*, 2019, pp\. 5624–5634\. \[Online\]\. Available:[https://aclanthology\.org/P19\-1565/](https://aclanthology.org/P19-1565/)
- \[60\]J\. Wang, Y\. Cheng, D\. Lin, C\. Leong, and W\. Li, “Target\-oriented Proactive Dialogue Systems with Personalization: Problem Formulation and Dataset Curation,” in*Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing*, 2023, pp\. 1132–1143\. \[Online\]\. Available:[https://aclanthology\.org/2023\.emnlp\-main\.72/](https://aclanthology.org/2023.emnlp-main.72/)
- \[61\]Y\. Deng, W\. Zhang, W\. Lam, S\.\-K\. Ng, and T\.\-S\. Chua, “Plug\-and\-Play Policy Planner for Large Language Model Powered Dialogue Agents,” in*International Conference on Learning Representations \(ICLR\)*, 2024\. \[Online\]\. Available:[https://openreview\.net/forum?id=MCNqgUFTHI](https://openreview.net/forum?id=MCNqgUFTHI)
- \[62\]Z\. Liu, D\. Zhou, H\. Liu, H\. Wang, Z\.\-Y\. Niu, H\. Wu, W\. Che, T\. Liu, and H\. Xiong, “Graph\-Grounded Goal Planning for Conversational Recommendation,”*IEEE Transactions on Knowledge and Data Engineering \(TKDE\)*, vol\. 35, no\. 5, pp\. 4923–4939, 2023\.
- \[63\]J\. Wang, D\. Lin, and W\. Li, “Follow Me: Conversation Planning for Target\-driven Recommendation Dialogue Systems,”*arXiv preprint arXiv:2208\.03516*, 2022\. \[Online\]\. Available:[https://arxiv\.org/abs/2208\.03516](https://arxiv.org/abs/2208.03516)
- \[64\]M\. Wang, C\. Gao, W\. Wang, Y\. Li, and F\. Feng, “Tunable LLM\-based Proactive Recommendation Agent,” in*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2025, pp\. 19 262–19 276\. \[Online\]\. Available:[https://aclanthology\.org/2025\.acl\-long\.944/](https://aclanthology.org/2025.acl-long.944/)
- \[65\]S\. Bi, W\. Wang, H\. Pan, F\. Feng, and X\. He, “Proactive Recommendation with Iterative Preference Guidance,” in*Companion Proceedings of the ACM Web Conference 2024 \(WWW ’24 Companion\)*, 2024, pp\. 871–874\. \[Online\]\. Available:[https://doi\.org/10\.1145/3589335\.3651548](https://doi.org/10.1145/3589335.3651548)
- \[66\]S\. Vijayvargiya, X\. Zhou, A\. Yerukola, M\. Sap, and G\. Neubig, “Ambig\-SWE: Interactive Agents to Overcome Underspecificity in Software Engineering,” in*The Fourteenth International Conference on Learning Representations \(ICLR 2026\)*, 2026, published as an ICLR 2026 conference paper\. \[Online\]\. Available:[https://openreview\.net/forum?id=X2yzXtH4wp](https://openreview.net/forum?id=X2yzXtH4wp)
- \[67\]Z\. Liu, H\. Wang, Z\.\-Y\. Niu, H\. Wu, and W\. Che, “DuRecDial 2\.0: A Bilingual Parallel Corpus for Conversational Recommendation,” in*Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing*, 2021, pp\. 4335–4347\. \[Online\]\. Available:[https://aclanthology\.org/2021\.emnlp\-main\.356/](https://aclanthology.org/2021.emnlp-main.356/)
- \[68\]K\. Zhou, Y\. Zhou, W\. X\. Zhao, X\. Wang, and J\.\-R\. Wen, “Towards Topic\-Guided Conversational Recommender System,” in*Proceedings of the 28th International Conference on Computational Linguistics*, 2020, pp\. 4128–4139\. \[Online\]\. Available:[https://aclanthology\.org/2020\.coling\-main\.365/](https://aclanthology.org/2020.coling-main.365/)
- \[69\]S\. A\. Hayati, D\. Kang, Q\. Zhu, W\. Shi, and Z\. Yu, “INSPIRED: Toward Sociable Recommendation Dialog Systems,” in*Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing \(EMNLP\)*, 2020, pp\. 8142–8152\. \[Online\]\. Available:[https://aclanthology\.org/2020\.emnlp\-main\.654/](https://aclanthology.org/2020.emnlp-main.654/)
- \[70\]M\. Wang, S\. Bi, W\. Wang, C\. Gao, Y\. Li, and F\. Feng, “Leveraging LLMs for Influence Path Planning in Proactive Recommendation,” in*Companion Proceedings of the ACM Web Conference 2025*, 2025, pp\. 1355–1359\. \[Online\]\. Available:[https://doi\.org/10\.1145/3701716\.3715537](https://doi.org/10.1145/3701716.3715537)
- \[71\]J\. Chai, X\. Ma, J\. Yang, and J\. Wu, “When and What to Recommend: Joint Modeling of Timing and Content for Active Sequential Recommendation,”*arXiv preprint arXiv:2511\.18717*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2511\.18717](https://arxiv.org/abs/2511.18717)
- \[72\]C\. O’Brien, H\. Wu, S\. Zhai, D\. Guo, W\. Shi, and J\. J\. Hunt, “Should I send this notification? Optimizing push notifications decision making by modeling the future,”*arXiv preprint arXiv:2202\.08812*, 2022\. \[Online\]\. Available:[https://arxiv\.org/abs/2202\.08812](https://arxiv.org/abs/2202.08812)
- \[73\]H\. Q\. Dao, Y\. Deng, K\.\-H\. Bui, D\. D\. Le, and L\. Liao, “Experience as Source for Anticipation and Planning: Experiential Policy Learning for Target\-driven Recommendation Dialogues,” in*Findings of the Association for Computational Linguistics: EMNLP 2024*, 2024, pp\. 14 179–14 198\. \[Online\]\. Available:[https://aclanthology\.org/2024\.findings\-emnlp\.829/](https://aclanthology.org/2024.findings-emnlp.829/)
- \[74\]L\. Wang, X\. Zhang, H\. Su, and J\. Zhu, “A comprehensive survey of continual learning: Theory, method and application,”*IEEE Transactions on Pattern Analysis and Machine Intelligence*, vol\. 46, no\. 8, pp\. 5362–5383, 2024\.
- \[75\]S\. Vakulenko, E\. Kanoulas, and M\. de Rijke, “An Analysis of Mixed Initiative and Collaboration in Information\-Seeking Dialogues,” in*Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval*, 2020, pp\. 2085–2088\. \[Online\]\. Available:[https://doi\.org/10\.1145/3397271\.3401297](https://doi.org/10.1145/3397271.3401297)
- \[76\]T\. De Min, S\. Roy, S\. Lathuilière, E\. Ricci, and M\. Mancini, “ProactiveBench: Benchmarking Proactiveness in Multimodal Large Language Models,”*arXiv preprint arXiv:2603\.19466*, 2026, the arXiv record reports acceptance at ECCV 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2603\.19466](https://arxiv.org/abs/2603.19466)
- \[77\]G\. Pasternak, D\. Rajagopal, J\. White, D\. Atreja, M\. Thomas, G\. Hurn\-Maloney, and A\. Lewis, “Beyond Reactivity: Measuring Proactive Problem Solving in LLM Agents,”*arXiv preprint arXiv:2510\.19771*, 2025, submitted to ICLR 2026; no acceptance claim is made\. \[Online\]\. Available:[https://arxiv\.org/abs/2510\.19771](https://arxiv.org/abs/2510.19771)
- \[78\]T\. Liu, F\. Wan, J\. Guo, and X\. Quan, “ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agents,” in*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2026, pp\. 41 068–41 100\. \[Online\]\. Available:[https://aclanthology\.org/2026\.acl\-long\.1906/](https://aclanthology.org/2026.acl-long.1906/)
- \[79\]S\. Harfi, A\. Salimi, D\. Shen, and A\. Smola, “ProactBench: Beyond What The User Asked For,”*arXiv preprint arXiv:2605\.09228*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2605\.09228](https://arxiv.org/abs/2605.09228)
- \[80\]J\. Lee, G\. Youn, S\. Lee, C\. Im, J\. Kim, and C\. Yoo, “Let LLM Tutors Ask First: Proactive LLM\-Based Tutoring at Scale in a 1,500\-Student Online Classroom,” in*Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 6: Industry Track\)*, 2026, pp\. 1541–1554\. \[Online\]\. Available:[https://aclanthology\.org/2026\.acl\-industry\.107/](https://aclanthology.org/2026.acl-industry.107/)
- \[81\]Y\.\-X\. Wang, A\. Agarwal, and M\. Dudík, “Optimal and adaptive off\-policy evaluation in contextual bandits,” in*Proceedings of the 34th International Conference on Machine Learning*, ser\. Proceedings of Machine Learning Research, vol\. 70, 2017, pp\. 3589–3597\. \[Online\]\. Available:[https://proceedings\.mlr\.press/v70/wang17a\.html](https://proceedings.mlr.press/v70/wang17a.html)
- \[82\]Y\. Liu, P\.\-L\. Bacon, and E\. Brunskill, “Understanding the curse of horizon in off\-policy evaluation via conditional importance sampling,” in*Proceedings of the 37th International Conference on Machine Learning*, ser\. Proceedings of Machine Learning Research, vol\. 119, 2020, pp\. 6184–6193\. \[Online\]\. Available:[https://proceedings\.mlr\.press/v119/liu20a\.html](https://proceedings.mlr.press/v119/liu20a.html)
- \[83\]N\. Jiang and L\. Li, “Doubly robust off\-policy value evaluation for reinforcement learning,” in*Proceedings of the 33rd International Conference on Machine Learning*, ser\. Proceedings of Machine Learning Research, vol\. 48, 2016, pp\. 652–661\. \[Online\]\. Available:[https://proceedings\.mlr\.press/v48/jiang16\.html](https://proceedings.mlr.press/v48/jiang16.html)
- \[84\]R\. Vasudev, M\. Russak, D\. Bikel, and W\. Alshikh, “Accurate Failure Prediction in Agents Does Not Imply Effective Failure Prevention,”*arXiv preprint arXiv:2602\.03338*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2602\.03338](https://arxiv.org/abs/2602.03338)
- \[85\]D\. De Lazzari, M\. Terreran, G\. Giacomuzzo, S\. Jain, P\. Falco, R\. Carli, and D\. Romeres, “PACE: Proactive Assistance in Human\-Robot Collaboration through Action\-Completion Estimation,” in*2025 IEEE International Conference on Robotics and Automation \(ICRA\)*, 2025, pp\. 6725–6731\. \[Online\]\. Available:[https://doi\.org/10\.1109/ICRA55743\.2025\.11127399](https://doi.org/10.1109/ICRA55743.2025.11127399)
- \[86\]K\. Bosschaerts, A\. Kashefi, L\. De Marez, P\. Conradie, S\. Van Hoecke, and F\. Ongenae, “Designing a Just\-in\-Time Adaptive Intervention with Trigger Detection and a Generative Chatbot: Smoking Cessation Use Case,”*Digital Health*, vol\. 11, 2025\. \[Online\]\. Available:[https://doi\.org/10\.1177/20552076251381747](https://doi.org/10.1177/20552076251381747)
- \[87\]Y\. Yang, P\. Achananuparp, H\. Huang, J\. Jiang, P\. L\. Kit, N\. G\. Lim, C\. T\. S\. Ern, and E\.\-P\. Lim, “CAMI: A Counselor Agent Supporting Motivational Interviewing through State Inference and Topic Exploration,” in*Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*, 2025, pp\. 21 037–21 081\. \[Online\]\. Available:[https://aclanthology\.org/2025\.acl\-long\.1024/](https://aclanthology.org/2025.acl-long.1024/)
- \[88\]S\. Park, H\. Kang, S\. Cho, and D\. Kim, “PsyProbe: Proactive and Interpretable Dialogue through User State Modeling for Exploratory Counseling,” in*Findings of the Association for Computational Linguistics: EACL 2026*, 2026, pp\. 6390–6411\. \[Online\]\. Available:[https://aclanthology\.org/2026\.findings\-eacl\.336/](https://aclanthology.org/2026.findings-eacl.336/)
- \[89\]R\. Jamshad, A\. Haripriyan, A\. Sonti, S\. Simkins, and L\. D\. Riek, “Taking Initiative in Human\-Robot Action Teams: How Proactive Robot Behaviors Affect Teamwork,” in*Companion of the 2024 ACM/IEEE International Conference on Human\-Robot Interaction*, 2024, pp\. 559–562\. \[Online\]\. Available:[https://doi\.org/10\.1145/3610978\.3640640](https://doi.org/10.1145/3610978.3640640)
- \[90\]C\. M\. Fang, W\. Zulfikar, P\. Maes, Y\. Samaradivakara, and S\. Nanayakkara, “The Goldilocks Time Window for Proactive Interventions in Wearable AI Systems,”*arXiv preprint arXiv:2504\.09332*, 2025, presented at the Everyday AR through AI\-in\-the\-Loop CHI 2025 Workshop; the workshop PDF uses a different display order and a placeholder DOI, so this entry follows the unambiguous arXiv record\. \[Online\]\. Available:[https://arxiv\.org/abs/2504\.09332](https://arxiv.org/abs/2504.09332)
- \[91\]S\. Liu, C\. Zheng, O\. Demasi, S\. Sabour, Y\. Li, Z\. Yu, Y\. Jiang, and M\. Huang, “Towards Emotional Support Dialog Systems,” in*Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing \(Volume 1: Long Papers\)*, 2021, pp\. 3469–3483\. \[Online\]\. Available:[https://aclanthology\.org/2021\.acl\-long\.269/](https://aclanthology.org/2021.acl-long.269/)
- \[92\]C\. Wan, M\. Labeau, and C\. Clavel, “EmoDynamiX: Emotional Support Dialogue Strategy Prediction by Modelling MiXed Emotions and Discourse Dynamics,” in*Proceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\)*, 2025, pp\. 1678–1695\. \[Online\]\. Available:[https://aclanthology\.org/2025\.naacl\-long\.81/](https://aclanthology.org/2025.naacl-long.81/)
- \[93\]J\. Li, Y\. Luo, D\. Han, Y\. Zhan, X\. Fu, B\. Qiao, and G\. Wu, “ESCA: An Emotional Support Conversation Agent for Enhancing Reasonable Strategy Planning and Effective Expression,”*Proceedings of the AAAI Conference on Artificial Intelligence*, vol\. 40, no\. 21, pp\. 17 526–17 534, 2026\. \[Online\]\. Available:[https://ojs\.aaai\.org/index\.php/AAAI/article/view/38807](https://ojs.aaai.org/index.php/AAAI/article/view/38807)
- \[94\]C\. Zou, N\. Wang, T\. Shen, L\. Xiao, C\. Ma, X\. Li, R\. Mao, and E\. Cambria, “Affective Flow Language Model for Emotional Support Conversation,”*arXiv preprint arXiv:2602\.08826*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2602\.08826](https://arxiv.org/abs/2602.08826)
- \[95\]B\. Zhao, Y\. Hu, and X\. Li, “From Stateless to Situated: Building a Psychological World for LLM\-Based Agents,”*arXiv preprint arXiv:2603\.25031*, 2026, the arXiv record reports acceptance at the WAICA 2026 workshop\. \[Online\]\. Available:[https://arxiv\.org/abs/2603\.25031](https://arxiv.org/abs/2603.25031)
- \[96\]T\. Wang, Y\. Zhan, J\. Lian, Z\. Hu, N\. J\. Yuan, Q\. Zhang, X\. Xie, and H\. Xiong, “LLM\-powered Multi\-agent Framework for Goal\-oriented Learning in Intelligent Tutoring System,” in*Companion Proceedings of the ACM Web Conference 2025*, 2025, pp\. 510–519\. \[Online\]\. Available:[https://doi\.org/10\.1145/3701716\.3715244](https://doi.org/10.1145/3701716.3715244)
- \[97\]J\. Wang, Y\. Dai, Y\. Zhang, Z\. Ma, W\. Li, and J\. Chai, “Training Turn\-by\-Turn Verifiers for Dialogue Tutoring Agents: The Curious Case of LLMs as Your Coding Tutors,” in*Findings of the Association for Computational Linguistics: ACL 2025*, 2025, pp\. 12 416–12 436\. \[Online\]\. Available:[https://aclanthology\.org/2025\.findings\-acl\.642/](https://aclanthology.org/2025.findings-acl.642/)
- \[98\]P\.\-C\. Chang, N\. Hogan, A\. Plaat, and M\. T\. van der Meer, “Learning to Prompt: Improving Student Engagement with Adaptive LLM\-based High\-School Tutoring,”*arXiv preprint arXiv:2606\.20138*, 2026\. \[Online\]\. Available:[https://arxiv\.org/abs/2606\.20138](https://arxiv.org/abs/2606.20138)
- \[99\]S\. Ji, X\. Zheng, W\. Gao, and M\. Srivastava, “Transforming Mental Health Care with Autonomous LLM Agents at the Edge,” in*Proceedings of the 23rd ACM Conference on Embedded Networked Sensor Systems*, 2025, pp\. 692–693\. \[Online\]\. Available:[https://doi\.org/10\.1145/3715014\.3724073](https://doi.org/10.1145/3715014.3724073)
- \[100\]Y\. Lei, Y\. Cao, W\. K\. Wang, Y\. Dong, C\. Yin, W\. Cao, P\. Zhang, J\. Yang, B\. Yao, Y\. Peng, C\. Weng, R\. Auerbach, L\. Mamykina, D\. Wang, Y\. Wang, and X\. Xu, “WatchGuardian: Enabling User\-Defined Personalized Just\-in\-Time Intervention on Smartwatch,”*arXiv preprint arXiv:2502\.05783*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2502\.05783](https://arxiv.org/abs/2502.05783)