PACE: Towards Surfacing Hidden Conflicts in User Requests

arXiv cs.CL Papers

Summary

The paper introduces PACE, a dataset for evaluating whether AI models can identify hidden conflicts in user requests by retrieving implicit knowledge base facts, and proposes PaceMaker, a multi-agent framework to enhance conflict-aware decision-making.

arXiv:2609.03293v1 Announce Type: new Abstract: Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user's current circumstances. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict-based refusal. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real-world scenarios often involve implicit factors that must be retrieved from a knowledge base (KB). To this end, we introduce Personalized Assistants for Conflict Evaluation (PACE), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate. PACE pairs user requests grounded in well-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting. This implicit retrieval setting hinders the direct association between user requests and conflict-inducing knowledge, making it difficult for existing models to identify relevant user-specific facts. To address this challenge, we further propose PaceMaker, a multi-agent framework in which specialized agents coordinate across query reformulation, multi-hop graph traversal, and conflict-aware filtering to retrieve contextually decisive evidence. Experiments on PACE evaluate both evidence retrieval quality and conflict decision accuracy, showing that PaceMaker consistently outperforms existing approaches.
Original Article
View Cached Full Text

Cached at: 09/04/26, 05:57 AM

# PACE: Towards Surfacing Hidden Conflicts in User Requests
Source: [https://arxiv.org/html/2609.03293](https://arxiv.org/html/2609.03293)
Yoojin KimAffiliation:Department of Computer Science and Engineering, POSTECHEmail:[kimyujin1224@postech\.ac\.kr](mailto:)Jihyoung JangHyounghun KimAffiliation:Department of Computer Science and Engineering, POSTECHAffiliation:Graduate School of Artificial Intelligence, POSTECHEmail:[h\.kim@postech\.ac\.kr](mailto:)

###### Abstract

Personalized assistants should not only comply with user requests but also assess whether those requests are appropriate given the user’s current circumstances\. However, prior work has primarily focused on accurately executing requests, overlooking the need for assistants to account for context and engage in conflict\-based refusal\. Furthermore, while existing work on conflict or safety detection relies on explicitly provided factors, real\-world scenarios often involve implicit factors that must be retrieved from a knowledge base \(KB\)\. To this end, we introducePersonalizedAssistants forConflictEvaluation \(PACE\), a dataset for evaluating whether models can identify latent constraints, expressed as egocentric knowledge or events, that render seemingly reasonable user requests inappropriate\.PACEpairs user requests grounded in well\-defined personas with egocentric KB facts, requiring models to integrate contextual evidence to determine whether a request is conflicting\. This implicit retrieval setting hinders the direct association between user requests and conflict\-inducing knowledge, making it difficult for existing models to identify relevant user\-specific facts\. To address this challenge, we further proposePaceMaker, a multi\-agent framework in which specialized agents coordinate across query reformulation, multi\-hop graph traversal, and conflict\-aware filtering to retrieve contextually decisive evidence\. Experiments onPACEevaluate both evidence retrieval quality and conflict decision accuracy, showing thatPaceMakerconsistently outperforms existing approaches\.111Our code and dataset are publicly available at[https://github\.com/p2chp2t/pacemaker](https://github.com/p2chp2t/pacemaker)\.

## 1Introduction

Recent advances in large language models \(LLMs\) have transformed AI assistants from passive information retrieval tools into systems capable of supporting users’ real\-world decisions and actions[Yao et al\. \(2023\)](https://arxiv.org/html/2609.03293#bib.bib5);[Zhang et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib6);[Zhang et al\. \(2025b\)](https://arxiv.org/html/2609.03293#bib.bib7);[Peng et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib8);[Xu et al\. \(2026b\)](https://arxiv.org/html/2609.03293#bib.bib9)\. To be reliable in such settings, assistants must interpret not only the user’s immediate request but also whether the requested action is appropriate given the user’s personal circumstances, prior commitments, and surrounding conditions[Kim et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib10);[Lee et al\. \(2025b\)](https://arxiv.org/html/2609.03293#bib.bib11);[Yang et al\. \(2026\)](https://arxiv.org/html/2609.03293#bib.bib12)\.

![Refer to caption](https://arxiv.org/html/2609.03293v1/main.png)Figure 1:Overview of conflict\-aware personalization\. The user\-centric knowledge base contains information about the user, related people, and surrounding situations\. Although the reservation request appears executable, reasoning over evidence about the companion’s dietary constraint and the restaurant’s fixed menu reveals a latent conflict, requiring the ideal assistant to refuse the booking and suggest an alternative\.This judgment is often nontrivial\. A user request may appear entirely reasonable on its surface yet become inadvisable once hidden constraints are considered[Li et al\. \(2024b\)](https://arxiv.org/html/2609.03293#bib.bib13);[Kim et al\. \(2026\)](https://arxiv.org/html/2609.03293#bib.bib14)\. For example, booking a restaurant seems trivial, but if the user already has a conflicting commitment at that time, or if the venue serves food a companion cannot eat, executing the request without consideration would be inappropriate \(Figure[1](https://arxiv.org/html/2609.03293#S1.F1)\)\. Conversely, an assistant that over\-refuses plausible requests forces users into unnecessary follow\-up interactions, degrading both usefulness and efficiency[Röttger et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib15);[Sun et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib16);[Xue et al\. \(2026\)](https://arxiv.org/html/2609.03293#bib.bib17)\. An ideal assistant should therefore make situated decisions, neither blindly executing nor conservatively refusing, but grounding its judgment in evidence relevant to the user’s actual circumstances[Zheng et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib18)\.

Existing benchmarks for safety and risk\-aware reasoning have focused on detecting risks or harmful content explicitly present in the input[Mazeika et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib19);[Yuan et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib20);[Liu et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib21);[Andriushchenko et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib22);[Xie et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib23)\. While useful for evaluating single\-query risk recognition, these input\-centric settings fail to capture a critical challenge in real personalized assistant environments\. In practice, making appropriate decisions often requires identifying and integrating the handful of facts that truly matter from a large personal knowledge base \(KB\) filled with plausible but irrelevant distractors[Wu et al\. \(2026\)](https://arxiv.org/html/2609.03293#bib.bib24)\.

To address this gap, we introducePersonalizedAssistants forConflictEvaluation \(PACE\), a retrieval\-grounded dataset in which a personalized assistant must reason over an egocentric KB to determine whether a user request should be fulfilled\. Each request inPACEis carefully designed to appear as a normal assistant task in isolation; its conflict status emerges only when considered in the context of hidden situational facts distributed throughout the KB\. This makes the task particularly difficult, as the decisive evidence is rarely retrievable from the original query alone\. Conflict\-relevant facts are often distributed and may not appear semantically relevant to the query itself\.

Through experiments onPACE, we find that standard retrieval methods struggle to identify contextually decisive evidence in the presence of semantic distractors\. Motivated by these findings, we proposePersonalizedAgent forConflict\-EvidentMulti\-hopAdaptiveKnowledgeExtraction \(PaceMaker\), a multi\-agent framework that reformulates queries to target latent conflict signals, explores evidence through graph\-based multi\-hop traversal, and filters out distractors to surface only decision\-relevant facts\.PaceMakerconsistently improves retrieval and reasoning performance over baselines, demonstrating the effectiveness of conflict\-aware evidence retrieval\.

The contributions of this work are as follows:

1. 1\.We introducePACE, a dataset for evaluating conflict\-aware reasoning over egocentric KBs\.
2. 2\.We proposePaceMaker, a multi\-agent framework for structured evidence retrieval targeting hidden conflict evidence\.
3. 3\.We conduct experiments showing that surfacing hidden situational constraints remains a substantial open challenge for existing methods\.

## 2Related Work

Personalized and Context\-Aware Assistants\.Personalization has recently emerged as an important direction for AI assistants[Salemi et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib26);[Liu et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib25)\. Recent work on personalized assistants has examined whether models can understand user\-specific information[Tan et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib27), retain long\-term memories[Maharana et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib28);[Wu et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib29), and adapt to evolving user preferences[Jiang et al\. \(2025a\)](https://arxiv.org/html/2609.03293#bib.bib30);[Jiang et al\. \(2025b\)](https://arxiv.org/html/2609.03293#bib.bib31);[Zhao et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib32)\. In parallel, prior work on contextual safety has shown that the appropriateness of a request can depend on its surrounding situational context[Wang et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib33);[Zhou et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib34);[Son et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib35);[Lou et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib36)\. However, these settings typically center on preference use or externally observable risks, leaving underexplored cases where inappropriateness is neither explicit in the request nor tied to a single salient fact\. We therefore focus on conflict\-aware personalization where models must compose distributed egocentric evidence to detect latent constraints on otherwise reasonable requests\.

Retrieval and Memory for Personalized LLMs\.Existing work on personalized LLMs spans memory systems[Chhikara et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib37);[Xu et al\. \(2026a\)](https://arxiv.org/html/2609.03293#bib.bib38), personalized alignment[Li et al\. \(2024a\)](https://arxiv.org/html/2609.03293#bib.bib39);[Zollo et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib40);[Liang et al\. \(2026\)](https://arxiv.org/html/2609.03293#bib.bib41), and RAG[Zerhoudi and Granitzer \(2024\)](https://arxiv.org/html/2609.03293#bib.bib42)\. Recent personalized and graph\-based RAG methods improve evidence organization and multi\-hop reasoning using user signals[Zhang et al\. \(2026\)](https://arxiv.org/html/2609.03293#bib.bib43);[Tan et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib27), structured personal knowledge[Prahlad et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib44), and graph expansion mechanisms[Edge et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib45);[Guo et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib46);[Gutierrez et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib47);[Gutiérrez et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib48);[Zhu et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib49)\. Despite these advances, most methods prioritize retrieving relevant or supportive information for answering and personalization, rather than evidence needed for context\-sensitive request assessment\. Our method instead frames retrieval as diagnostic evidence selection, targeting the facts that determine whether an apparently valid request remains compatible with the user’s broader context\.

## 3PACE

We introducePersonalizedAssistants forConflictEvaluation \(PACE\), a new dataset designed to evaluate whether LLMs can recognize situational conflicts between user requests and facts stored in a user\-centric KB\.

### 3\.1Task Definition

Our goal is to evaluate whether a model can determine if a user request is compatible with facts stored in an egocentric KB\. We consider a personalized assistant setting in which the assistant maintains contextual knowledge about a user \(i\.e\., ego\) and limited information about closely related individuals such as family, colleagues, or friends \(i\.e\., alters\), covering only aspects relevant to the user’s decision\. Given a request and this KB, the model must decide whether the requested action should be carried out and justify its decision\.

A key characteristic of this task is that the request itself appears normal and executable in isolation\. The challenge instead arises from hidden situational constraints that become apparent only when the relevant contextual facts in the KB are taken into account\.

### 3\.2Feasibility Status and Situation Types

Each instance inPACEconsists of a user’s requests and an egocentric KB, and each request is annotated with afeasibility statusindicating whether it is conflicting or non\-conflicting under the given KB, and asituation typespecifying the primary source of reasoning required for the decision\.

Conflict cases refer to requests that become inappropriate or incompatible after contextual facts are considered, whereas Non\-conflict cases remain feasible and appropriate under the same conditions\. We include Non\-conflict cases to ensure that models do not simply reject requests whenever contextual information is present\.

To enable fine\-grained analysis of conflict\-aware reasoning, we categorize requests into three situation types:Temporal, involving time and schedule constraints;Personal, involving preferences or interpersonal constraints; andState, involving current conditions and available resources\.

- •Temporal:This type covers cases where a request is incompatible with temporal constraints such as existing schedules, travel time, or daily routines\. For example, if a user asks the assistant to register them for a 19:00 certification exam, but the KB indicates that the user’s prior workshop ends at 18:10, their identification documents must be picked up from the hotel by 18:30, and the exam center is 45 minutes away, the request creates a temporal conflict because the connected commitments leave no feasible schedule\.
- •Personal:Cases of this type arise when fulfilling a request would significantly violate an important personal constraint of the ego or an alter, such as a health condition, personal value, or accessibility need\. For example, if a user asks for a seafood boil restaurant to visit with a friend after an exhibition, but the KB indicates that the friend has a shellfish allergy, recommending such a restaurant would constitute a personal conflict\.
- •State:This type covers cases where a request becomes inappropriate due to an external condition already known at query time, such as road conditions, posted restrictions, or facility operating issues\. For example, if a user asks for a quiet cafe to work in during the afternoon, but the KB indicates that the cafe they usually visit has scheduled a live music event at that time, recommending that cafe would constitute a state conflict\.

### 3\.3Dataset Generation

To constructPACE, we first synthesize egocentric persona scenarios and then generate requests and contextual KB facts grounded in those scenarios\. The construction process is designed to ensure that \(1\) requests appear natural and executable in isolation, \(2\) the final decision depends on hidden contextual constraints, and \(3\) the required evidence is distributed across multiple KB facts\.

Persona Expansion\.We begin with persona seeds collected from MSC[Xu et al\. \(2022\)](https://arxiv.org/html/2609.03293#bib.bib1)and Synthetic\-Person\-Chat[Jandaghi et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib2)\. Since the original personas are relatively simple, we useGPT\-5\.4\-mini222[https://openai\.com/index/introducing\-gpt\-5\-4\-mini\-and\-nano/](https://openai.com/index/introducing-gpt-5-4-mini-and-nano/)to expand them into richer narrative descriptions containing everyday routines, living environments, behavioral tendencies, and plausible situational context relevant to personalized assistant interactions\.

Profile Synthesis\.We then randomly pair the expanded narratives to construct ego\-alter relationships\. For each pair,GPT\-5\.4\-minifirst generates a structured ego profile and subsequently produces an alter profile conditioned on the ego\. The final profiles include personal attributes such as occupation, health conditions, and values, along with concrete everyday details involving commonly used places and devices, which later serve as the basis for conflict\-aware query and KB generation grounded in realistic life situations\.

Query and Context Generation\.Based on the synthesized profiles, we useGPT\-5\.4\-minito generate user requests together with contextual KB facts required for conflict evaluation\. Each scenario is constructed within a bounded timeline centered around a reference date to ensure temporal consistency\. We treat the reference date as the time of the user request: facts before it are already observed, confirmed, or in effect, while facts after it are included only if they are already scheduled, announced, planned, or otherwise knowable at that time\. Each case consists of a query, a gold context, and a judgment\.

Queries are designed to resemble ordinary user requests, such as making reservations, planning activities, or providing recommendations, without explicitly revealing the underlying conflict signals\. We additionally exclude cases where the request itself appears inherently unreasonable or blatantly inconsistent with the user’s established conditions\.

The gold context provides the situational background necessary to evaluate the query, typically requiring multiple facts to be interpreted jointly rather than exposing a single decisive clue\. It does not directly state the request’s feasibility status, so the model must infer the appropriate decision by relating these contextual facts to the user’s request\.

The judgment provides the reference rationale, explaining why the request should be rejected in Conflict cases or why it remains executable in Non\-conflict cases\. We further use this judgment to assess whether the model’s decision is grounded in the correct evidence and reasoning\.

![Refer to caption](https://arxiv.org/html/2609.03293v1/model.png)Figure 2:Workflow ofPaceMaker\.Distractor Generation and Atomization\.For each instance, we useGPT\-5\.4\-minito generate distractor contexts that are topically related to the query but do not reveal the decisive reasoning evidence contained in the gold context\. Distractors are constructed to remain consistent with the persona profile, timeline, and intended judgment while avoiding the introduction of additional conflicts or compatibility signals\.

Both gold and distractor contexts are further decomposed into atomic facts, which are stored as independent KB entries\. This decomposition reflects realistic personal KB structures in which information is stored as discrete and scattered facts rather than coherent passages\. The decomposed gold facts do not necessarily contribute equally to the correct judgment\. In some cases, a subset suffices, while in others, the full set must be integrated, reflecting the varying complexity of conflict reasoning across instances\.

TypeCount\# of facts across all datasets376,448\# of queries across all datasets3,249\# of profile instances185Avg\. of facts per instance2,035Avg\. of queries per instance18Avg\. of gold facts per query4\.01

Table 1:Statistics ofPACE\.Quality Verification\.AlthoughPACEis synthetic, we ensure its quality through manual review by the authors at each stage of construction, complemented by automated filtering usingGPT\-5\.4\-mini\. After generating each case, we evaluate it for taxonomy compliance, constraint satisfaction, and core\-cause diversity\. Cases that satisfy all quality criteria are retained, cases that can be improved are refined based on validator feedback, and cases that fail to meet the quality standards are discarded\.

We also verify that the decomposed gold facts are sufficient and unambiguous for resolving each query\. Instances that fail this check are excluded, yieldingPACEwith approximately 3\.2K queries \(see Table[1](https://arxiv.org/html/2609.03293#S3.T1)for statistics\)\. Full process examples and additional statistics are provided in Appendix[A](https://arxiv.org/html/2609.03293#A1), and prompts are provided in Appendix[E](https://arxiv.org/html/2609.03293#A5)\.

Furthermore, we perform a human evaluation to validate whether the feasibility status defined by the LLM aligns with human judgments\. The results show a high agreement rate of 93\.3%, indicating strong consistency between the generated feasibility labels and human assessments \(see Appendix[C\.1](https://arxiv.org/html/2609.03293#A3.SS1)for details\)\.

## 4PaceMaker

We proposePersonalizedAgent forConflict\-EvidentMulti\-hopAdaptiveKnowledgeExtraction \(PaceMaker\), a multi\-agent retrieval framework for conflict\-aware reasoning over egocentric KBs\. From a user\-specific KB consisting of thousands of atomic fact sentences,PaceMakerfirst constructs dense and sparse indexes and a k\-nearest neighbor \(k\-NN\) document graph\. At inference time, given a user query, it clarifies a compact set of conflict\-diagnostic documents through four stages: conflict\-aware query planning, hybrid retrieval with fusion, agentic multi\-hop graph traversal, and conflict\-aware document filtering \(see Figure[2](https://arxiv.org/html/2609.03293#S3.F2)\)\.

### 4\.1Conflict\-Aware Query Planning

A single user query may not sufficiently expose the contextual evidence required for conflict detection, particularly when the relevant KB facts do not share lexical overlap with the request\. To address this, we employ a two\-step query reformulation process that first plans the retrieval direction, and then generates multiple retrieval\-oriented views\.

Given a user query and a reference date, aconflict planner agentfirst identifies up to three decision\-relevant probing cues, each capturing a potential dimension of conflict such as scheduling constraints, prior commitments, or resource availability\. This plan is then passed to amulti\-view query generator, which produces \(1\) the original query view and \(2\) a set of counter views that explicitly target potentially conflicting conditions implied by the plan\. Counter views are designed to retrieve latent conflict evidence that may not be directly implied by the original query\. All views are generated conditioned on the reference date to correctly resolve temporal expressions\.

### 4\.2Hybrid Retrieval and Fusion

Each query view is passed to both dense and sparse retrievers\. The dense retriever encodes queries and KB documents and performs approximate nearest neighbor search, while the sparse retriever applies BM25 over tokenized documents to capture lexical overlap\. Retrieval results from all query views and retrievers are merged using Weighted Reciprocal Rank Fusion \(WRRF\), where counter\-view results are assigned higher weights to prioritize conflict\-relevant evidence\. The top\-KKfused documents are then passed through apre\-hop filter agent, which selects the top\-NNmost decision\-relevant documents as the seed set for the subsequent traversal stage\. This pre\-hop filtering step reduces noise before graph traversal begins and prevents misleading seed documents from propagating into larger expansions\.

### 4\.3Multi\-Hop Graph Traversal

A key challenge in conflict\-aware reasoning is that critical evidence is often not directly retrievable from the original query\. Relevant evidence may be only weakly related to the query itself but located near the filtered seed documents in the pre\-constructed k\-NN graph\. To surface such evidence, we perform multi\-hop traversal over this graph\. The filtered seed documents serve as entry points, and traversal proceeds via breadth\-first search \(BFS\), iteratively expanding each frontier document to its top\-MMneighbors to collect additional contextually related evidence up to a maximum depth ofHH\.

### 4\.4Conflict\-Aware Evidence Selection

After traversal, the collected document pool, comprising both seed documents and documents discovered through multi\-hop traversal, may still contain topically related but weakly informative documents\. Apost\-hop filter agentperforms a final evidence selection step over the entire pool, retaining only the top\-NNdocuments that most directly contribute to determining whether the request is feasible or conflicts with the user’s KB\.

### 4\.5Answer Generation

The final filtered evidence set is passed to ananswer generator, which produces a final response indicating whether the request can be fulfilled and explaining the reasoning behind the decision\. Full implementation details, including hyperparameter configurations and selection, are provided in Appendix[B](https://arxiv.org/html/2609.03293#A2)\. Please refer to Appendix[E](https://arxiv.org/html/2609.03293#A5)for the instructions used by each agent\.

## 5Experiments

Table 2:Main benchmarking results onPACE\. All metrics are reported on a percentage scale \(%\)\.### 5\.1Evaluation Metrics

Our evaluation covers two dimensions: retrieval performance and response quality\.

Retrieval Performance\.For retrieval methods, we measure the quality of the retrieved document set using Recall@KK, Hit@KK, Gold@KK, and MRR\. Recall@KKmeasures the fraction of gold documents recovered within the top\-KKretrieved results\. Hit@KKmeasures whether at least one gold document appears in the top\-KKresults\. Gold@KKmeasures whether all gold documents are recovered within the top\-KKresults\. MRR measures the mean reciprocal rank of the first relevant document across queries\. We report results atK∈\{5,10\}K\\in\\\{5,10\\\}\.

Response Quality\.We evaluate response quality by comparing each model output against the gold rationale, usingGPT\-5\.4\-minias an automatic judge\. Since model outputs are free\-form natural language rather than structured labels, the judge evaluates both whether the response conveys the correct outcome and whether its rationale aligns with the gold rationale\. We adopt a three\-level evaluation scheme:Pass,Wrong, andFail\.Passindicates that the response conveys the correct outcome and that its rationale captures the core reasoning of the gold response\.Wrongindicates that the outcome is correct, but the rationale is incomplete, omits key evidence, or includes irrelevant justifications\.Failindicates that the response gives an incorrect outcome, and that its rationale contradicts or substantially diverges from the gold reasoning\. We report thePassrate as the primary metric for response quality\.

To verify our automatic judge’s reliability and alignment with human judgment, we conduct a human evaluation using Amazon Mechanical Turk\.333[https://www\.mturk\.com/](https://www.mturk.com/)We randomly sample 600 instances and collect annotations from three annotators per instance, each of whom makes a binary judgment on whether the assigned label is correct\. The final label for each instance is determined by majority voting\. The resulting agreement rate between human annotators and the automatic judge is 93\.5%, confirming the reliability of our automatic evaluation\. Further details are provided in Appendix[C\.2](https://arxiv.org/html/2609.03293#A3.SS2)\.

Table 3:Response quality results by feasibility status in three configurations\.
### 5\.2Experimental Setup

Model Configurations\.For the open\-source setting, all agent components are powered byQwen3\-4B\-Instruct\-2507[Yang et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib4)and document embeddings are computed usingQwen3\-Embedding\-8B[Zhang et al\. \(2025a\)](https://arxiv.org/html/2609.03293#bib.bib3)\. For the closed\-source setting, we use two model configurations:gpt\-5\.4\-miniwithtext\-embedding\-3\-small444[https://developers\.openai\.com/api/docs/models/text\-embedding\-3\-small](https://developers.openai.com/api/docs/models/text-embedding-3-small)for the GPT configuration, andGemini 3\.1 Flash\-Lite555[https://ai\.google\.dev/gemini\-api/docs/models/gemini\-3\.1\-flash\-lite](https://ai.google.dev/gemini-api/docs/models/gemini-3.1-flash-lite)withgemini\-embedding\-2666[https://ai\.google\.dev/gemini\-api/docs/models/gemini\-embedding\-2](https://ai.google.dev/gemini-api/docs/models/gemini-embedding-2)for the Gemini configuration\.PaceMakeris model\-agnostic and can be readily adapted to other language and embedding models\. In particular, the effect of embedding model selection in the open\-source setting is analyzed in Appendix[D\.1](https://arxiv.org/html/2609.03293#A4.SS1)\.

Method\.We comparePaceMakeragainst the following baselines onPACEto evaluate their effectiveness in conflict\-aware reasoning over egocentric KBs\. Since Oracle and Full KB methods do not perform retrieval, retrieval metrics are not reported for these settings\.

- •Oracle:As an upper bound, we provide the model with only the gold documents directly relevant to each query and generate the final response without retrieval\.
- •Full KB:We provide the model with the entire KB and generate the final response without retrieval\. Since all relevant documents are available in principle, this setting measures how effectively the model can reason over a large, unfiltered context\.
- •Sparse Retrieval:We retrieve documents using BM25 over tokenized KB documents based on the original query\.
- •Dense Retrieval:We retrieve documents using dense vector search based on the original query\.

## 6Results

Table[2](https://arxiv.org/html/2609.03293#S5.T2)presents the main results onPACE\. Across both settings, the Oracle method consistently achieves the highestPassrate, establishing a strong upper bound\. Despite having access to the entire KB, Full KB achieves only 57\.49% in the open\-source setting and about 73% across the two closed\-source settings, both markedly below Oracle\. This gap indicates that unfiltered context substantially impairs conflict reasoning, and that the model’s reasoning capability plays a critical role beyond mere context availability\.

In the open\-source setting, sparse and dense retrieval achieve 62\.73% and 62\.39%, respectively\.PaceMakerachieves a 68\.82%Passrate, outperforming all retrieval\-based baselines\. This result suggests that targeted evidence selection through multi\-hop traversal and conflict\-aware filtering enables more reliable conflict reasoning than broader context access\. Please see Appendix[D\.2](https://arxiv.org/html/2609.03293#A4.SS2)for detailed results, and Appendix[D\.3](https://arxiv.org/html/2609.03293#A4.SS3)for model examples\. Moreover, Appendix[D\.4](https://arxiv.org/html/2609.03293#A4.SS4)presents an evaluation usingGemini 3\.1 Flash\-Liteas an independent judge to assess potential self\-preference bias and confirm the robustness of our results\.

## 7Analysis

### 7\.1Conflict Status vs\. Non\-conflict Status

Table[3](https://arxiv.org/html/2609.03293#S5.T3)reports response quality by feasibility status across all methods and model settings\. Conflict queries are generally more challenging than Non\-conflict queries, with lowerPassrates across all non\-oracle methods\. This gap is especially notable in the Qwen and GPT configurations, where it persists even under Oracle setting, implying that conflict resolution remains difficult even when the relevant facts are directly provided\.

Across all three configurations,PaceMakerachieves the highest ConflictPassrate among non\-oracle methods\. Compared with the strongest non\-oracle baseline in each configuration, it improves ConflictPassby 11\.40, 3\.47, and 4\.02 percentage points, respectively, while maintaining comparable performance on Non\-conflict queries\. These results highlight the value of targeted multi\-hop traversal and conflict\-aware filtering in uncovering evidence of implicit constraints\.

### 7\.2Evidence Coverage

Figure 3:Passrates by gold evidence coverage for Conflict queries\.Figure[3](https://arxiv.org/html/2609.03293#S7.F3)reportsPassrates for Conflict queries under two levels of gold evidence coverage across the three model configurations: partial coverage \(Hit@10=1 but Gold@10=0\) and full coverage \(Gold@10=1\)\. Since the gold contexts inPACEare decomposed into atomic facts distributed across the KB, the evidence required for conflict judgment is rarely contained within a single document\. Retrieving only part of these facts already yields a meaningfulPassrate, but full coverage of all gold documents leads to a clear additional gain, suggesting that incomplete evidence is often insufficient for reliable conflict judgment\. This result underscores the complexity of surfacing the complete set of conflict\-relevant evidence, as the required facts are atomically distributed and not semantically salient from the query alone\.

### 7\.3Agent Component Ablation

Table 4:An ablation study onPaceMaker\.Passrefers to the overall pass rate, whileConflictrefers to the pass rate on Conflict queries only\.Table[4](https://arxiv.org/html/2609.03293#S7.T4)presents an ablation study over the key agent components ofPaceMaker, excluding seed retrieval\. To more precisely isolate the contribution of each component, we conduct this analysis under the GPT configuration\.

Removing any component consistently degrades performance\. The largest drop occurs when multi\-hop traversal is removed \(71\.65% overall, 52\.41% on Conflict queries\), confirming that hop\-based expansion is critical for surfacing evidence not directly retrievable from the queries\. Removing query planning leads to a comparable decline, while removing evidence selection results in a smaller but still consistent drop\.

These results suggest that the three components are mutually reinforcing: query planning retrieves conflict\-relevant seeds, traversal expands coverage to indirectly connected evidence, and evidence selection filters the candidate pool to retain decision\-critical facts\. Please see Appendix[D\.5](https://arxiv.org/html/2609.03293#A4.SS5)for detailed experimental setup and results\.

### 7\.4Comparison with Structured Retrieval Methods

Table[5](https://arxiv.org/html/2609.03293#S7.T5)comparesPaceMakeragainst structured retrieval baselines, GraphRAG[Edge et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib45)and HippoRAG 2[Gutiérrez et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib48)\. WhilePaceMakerachieves a slightly higher overallPassrate, the remarkable difference appears on Conflict queries, where it yields a substantially larger improvement over both baselines\.

This gap suggests that existing structured retrieval methods can often retrieve documents that are topically relevant to the query, but still fail to recover the full set of conflict\-inducing constraints needed for the final decision\. Thus, the challenge is not simply multi\-hop retrieval, but retrieval guided toward decisive evidence\.PaceMakeraddresses this issue through conflict\-aware query planning and targeted evidence filtering, enabling it to surface the latent constraints that determine whether a request can be fulfilled\.

The methods also differ in their computational profiles\. Although HippoRAG 2 offers faster online retrieval once its index is built,PaceMakeruses no LLM calls during indexing and incurs far fewer calls in total, leading to a lower cold\-start cost\. This property is particularly beneficial for personalized KBs that may be initialized or refreshed frequently\. Further details on the structured retrieval baselines and computational cost measurement are provided in Appendix[D\.6](https://arxiv.org/html/2609.03293#A4.SS6)and Appendix[D\.7](https://arxiv.org/html/2609.03293#A4.SS7), respectively\.

Table 5:Comparison ofPaceMakerwith structured retrieval methods\. We useQwen3\-4B\-Instruct\-2507as the LLM andNV\-Embed\-v2as the embedding model for a consistent experimental setting\.

## 8Conclusion

In this work, we address the challenge of conflict\-aware reasoning over egocentric KBs, where a model must determine whether a user request conflicts with personal context distributed across thousands of atomic facts\. To this end, we introducePACE, a dataset designed to evaluate this capability, andPaceMaker, a training\-free multi\-agent retrieval framework that identifies decision\-relevant evidence through conflict\-aware query planning, hybrid retrieval, multi\-hop graph traversal, and conflict\-aware evidence selection\. Experiments onPACEdemonstrate thatPaceMakeroutperforms retrieval\-based baselines, and our analysis shows that retrieval completeness is particularly critical for Conflict queries, where missing evidence substantially degrades reasoning quality\. Our results suggest that substantial room remains for future work on conflict\-aware reasoning and retrieval\.

## Limitations

Our benchmark focuses primarily on feasibility judgment rather than full task execution\. Although this design isolates the problem of detecting latent conflict signals in user specific context, it does not evaluate whether an assistant can complete complex downstream tasks such as recommendation, scheduling, or planning\. Extending the knowledge base with richer persona worlds, actionable entities, and dynamic task environments would enable future benchmarks to assess both conflict awareness and end\-to\-end personalized task solving\. In addition, our method is evaluated without task specific training\. While this training\-free setup highlights the generality of the proposed framework, future work could train specialized agents for query reformulation, evidence selection, graph traversal, and decision calibration to enhance performance\.

## Ethics Statement

Our dataset is constructed using synthetic identity profiles and does not contain real personal information\. Although fictional, the profiles and knowledge bases are designed to emulate realistic personal contexts and should not be used for privacy\-invasive profiling, manipulation, or inappropriate personalization\. As the task concerns conflict\-aware reasoning, some queries may involve sensitive or potentially unsafe situations\. We filter out inherently harmful, unreasonable, or unethical requests, but users of the benchmark should remain cautious when interpreting or extending the data\. We use large language models to assist data generation and minor language polishing, while the overall research process is led and conducted primarily by the authors\.

## Acknowledgments

We thank the reviewers and the action editor for their valuable feedback\. This work was partly supported by the Institute of Information & communications Technology Planning & Evaluation\(IITP\) grant funded by the Korea government\(MSIT\) \(No\.RS\-2019\-II191906, Artificial Intelligence Graduate School Program\(POSTECH\), Contribution Rate: 35%\), the Institute of Information & communications Technology Planning & Evaluation\(IITP\) under the Leading Generative AI Human Resources Development \(IITP\-2026\-RS\-2026\-25546560, Contribution Rate: 35%\) grant funded by the Korea government\(MSIT\), and the Institute of Information & Communications Technology Planning & Evaluation\(IITP\)\-ITRC\(Information Technology Research Center\) grant funded by the Korea government\(MSIT\) \(IITP\-2026\-RS\-2024\-00437866, Contribution Rate: 30%\)\.

## References

- Andriushchenkoet al\.\(2025\)M\. Andriushchenko, A\. Souly, M\. Dziemian, D\. Duenas, M\. Lin, J\. Wang, D\. Hendrycks, A\. Zou, J\. Z\. Kolter, M\. Fredrikson, Y\. Gal, and X\. DaviesAgentHarm: a benchmark for measuring harmfulness of LLM agents\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=AC5n7xHuR1)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p3.1)\.
- Chenet al\.\(2024\)J\. Chen, S\. Xiao, P\. Zhang, K\. Luo, D\. Lian, and Z\. LiuM3\-embedding: multi\-linguality, multi\-functionality, multi\-granularity text embeddings through self\-knowledge distillation\.InFindings of the Association for Computational Linguistics: ACL 2024,L\. Ku, A\. Martins, and V\. Srikumar \(Eds\.\),Bangkok, Thailand,pp\. 2318–2335\.External Links:[Link](https://aclanthology.org/2024.findings-acl.137/),[Document](https://dx.doi.org/10.18653/v1/2024.findings-acl.137)Cited by:[§D\.1](https://arxiv.org/html/2609.03293#A4.SS1.p1.1)\.
- Chhikaraet al\.\(2025\)P\. Chhikara, D\. Khant, S\. Aryan, T\. Singh, and D\. YadavMem0: building production\-ready ai agents with scalable long\-term memory\.arXiv preprint arXiv:2504\.19413\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Douzeet al\.\(2025\)M\. Douze, A\. Guzhva, C\. Deng, J\. Johnson, G\. Szilvasy, P\. Mazaré, M\. Lomeli, L\. Hosseini, and H\. JégouThe faiss library\.IEEE Transactions on Big Data\.Cited by:[Appendix B](https://arxiv.org/html/2609.03293#A2.p3.1)\.
- Edgeet al\.\(2024\)D\. Edge, H\. Trinh, N\. Cheng, J\. Bradley, A\. Chao, A\. Mody, S\. Truitt, D\. Metropolitansky, R\. O\. Ness, and J\. LarsonFrom local to global: a graph rag approach to query\-focused summarization\.arXiv preprint arXiv:2404\.16130\.Cited by:[§D\.6](https://arxiv.org/html/2609.03293#A4.SS6.p1.1),[§2](https://arxiv.org/html/2609.03293#S2.p2.1),[§7\.4](https://arxiv.org/html/2609.03293#S7.SS4.p1.1)\.
- Guoet al\.\(2025\)Z\. Guo, L\. Xia, Y\. Yu, T\. Ao, and C\. HuangLightRAG: simple and fast retrieval\-augmented generation\.InFindings of the Association for Computational Linguistics: EMNLP 2025,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 10746–10761\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.568/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.568),ISBN 979\-8\-89176\-335\-7Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Gutierrezet al\.\(2024\)B\. J\. Gutierrez, Y\. Shu, Y\. Gu, M\. Yasunaga, and Y\. SuHippoRAG: neurobiologically inspired long\-term memory for large language models\.InThe Thirty\-eighth Annual Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=hkujvAPVsg)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Gutiérrezet al\.\(2025\)B\. J\. Gutiérrez, Y\. Shu, W\. Qi, S\. Zhou, and Y\. SuFrom RAG to memory: non\-parametric continual learning for large language models\.InForty\-second International Conference on Machine Learning,External Links:[Link](https://openreview.net/forum?id=LWH8yn4HS2)Cited by:[§D\.6](https://arxiv.org/html/2609.03293#A4.SS6.p1.1),[§2](https://arxiv.org/html/2609.03293#S2.p2.1),[§7\.4](https://arxiv.org/html/2609.03293#S7.SS4.p1.1)\.
- Jandaghiet al\.\(2024\)P\. Jandaghi, X\. Sheng, X\. Bai, J\. Pujara, and H\. SidahmedFaithful persona\-based conversational dataset generation with large language models\.InProceedings of the 6th Workshop on NLP for Conversational AI \(NLP4ConvAI 2024\),E\. Nouri, A\. Rastogi, G\. Spithourakis, B\. Liu, Y\. Chen, Y\. Li, A\. Albalak, H\. Wakaki, and A\. Papangelis \(Eds\.\),Bangkok, Thailand,pp\. 114–139\.External Links:[Link](https://aclanthology.org/2024.nlp4convai-1.8/)Cited by:[§3\.3](https://arxiv.org/html/2609.03293#S3.SS3.p2.1)\.
- Jianget al\.\(2025a\)B\. Jiang, Z\. Hao, Y\. M\. Cho, B\. Li, Y\. Yuan, S\. Chen, L\. Ungar, C\. J\. Taylor, and D\. RothKnow me, respond to me: benchmarking LLMs for dynamic user profiling and personalized responses at scale\.InSecond Conference on Language Modeling,External Links:[Link](https://openreview.net/forum?id=6ox8XZGOqP)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Jianget al\.\(2025b\)B\. Jiang, Y\. Yuan, M\. Shen, Z\. Hao, Z\. Xu, Z\. Chen, Z\. Liu, A\. R\. Vijjini, J\. He, H\. Yu,et al\.Personamem\-v2: towards personalized intelligence via learning implicit user personas and agentic memory\.arXiv preprint arXiv:2512\.06688\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Kimet al\.\(2026\)J\. Kim, J\. Choi, W\. Chay, D\. Kyung, Y\. Kwon, Y\. Jo, and E\. ChoiProPerSim: developing proactive and personalized AI assistants through user\-assistant simulation\.InThe Fourteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=RV2aeCgxdB)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p2.1)\.
- Kimet al\.\(2025\)M\. Kim, L\. Caccia, Z\. Shi, M\. Pereira, M\. Côté, X\. Yuan, and A\. SordoniLearning to extract context for context\-aware llm inference\.arXiv preprint arXiv:2512\.11986\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Kwonet al\.\(2023\)W\. Kwon, Z\. Li, S\. Zhuang, Y\. Sheng, L\. Zheng, C\. H\. Yu, J\. Gonzalez, H\. Zhang, and I\. StoicaEfficient memory management for large language model serving with pagedattention\.InProceedings of the 29th symposium on operating systems principles,pp\. 611–626\.Cited by:[Appendix B](https://arxiv.org/html/2609.03293#A2.p3.1)\.
- Leeet al\.\(2025a\)C\. Lee, R\. Roy, M\. Xu, J\. Raiman, M\. Shoeybi, B\. Catanzaro, and W\. PingNV\-embed: improved techniques for training LLMs as generalist embedding models\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=lgsyLSsDRe)Cited by:[§D\.1](https://arxiv.org/html/2609.03293#A4.SS1.p1.1),[§D\.6](https://arxiv.org/html/2609.03293#A4.SS6.p1.1)\.
- Leeet al\.\(2025b\)C\. P\. Lee, J\. Choi, and B\. MutluMAP: multi\-user personalization with collaborative llm\-powered agents\.InProceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems,pp\. 1–11\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Liet al\.\(2024a\)X\. Li, R\. Zhou, Z\. C\. Lipton, and L\. LeqiPersonalized language modeling from personalized human feedback\.arXiv preprint arXiv:2402\.05133\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Liet al\.\(2024b\)Y\. Li, H\. Wen, W\. Wang, X\. Li, Y\. Yuan, G\. Liu, J\. Liu, W\. Xu, X\. Wang, Y\. Sun,et al\.Personal llm agents: insights and survey about the capability, efficiency and security\.arXiv preprint arXiv:2401\.05459\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p2.1)\.
- Lianget al\.\(2026\)K\. Liang, J\. Kruk, S\. Qian, X\. Yang, S\. Bi, Y\. Yao, S\. Nie, M\. Zhang, L\. Liu, J\. F\. Fisac,et al\.Learning personalized agents from human feedback\.arXiv preprint arXiv:2602\.16173\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Liuet al\.\(2025\)J\. Liu, Z\. Qiu, Z\. Li, Q\. Dai, W\. Yu, J\. Zhu, M\. Hu, M\. Yang, T\. Chua, and I\. KingA survey of personalized large language models: progress and future directions\.arXiv preprint arXiv:2502\.11528\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Liuet al\.\(2024\)X\. Liu, Y\. Zhu, J\. Gu, Y\. Lan, C\. Yang, and Y\. QiaoMm\-safetybench: a benchmark for safety evaluation of multimodal large language models\.InEuropean Conference on Computer Vision,pp\. 386–403\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p3.1)\.
- Louet al\.\(2025\)X\. Lou, Y\. Li, J\. Xu, X\. Shi, C\. Chen, and K\. HuangThink in safety: unveiling and mitigating safety alignment collapse in multimodal large reasoning model\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 5167–5186\.External Links:[Link](https://aclanthology.org/2025.emnlp-main.261/),[Document](https://dx.doi.org/10.18653/v1/2025.emnlp-main.261),ISBN 979\-8\-89176\-332\-6Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Maharanaet al\.\(2024\)A\. Maharana, D\. Lee, S\. Tulyakov, M\. Bansal, F\. Barbieri, and Y\. FangEvaluating very long\-term conversational memory of LLM agents\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),L\. Ku, A\. Martins, and V\. Srikumar \(Eds\.\),Bangkok, Thailand,pp\. 13851–13870\.External Links:[Link](https://aclanthology.org/2024.acl-long.747/),[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.747)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Mazeikaet al\.\(2024\)M\. Mazeika, L\. Phan, X\. Yin, A\. Zou, Z\. Wang, N\. Mu, E\. Sakhaee, N\. Li, S\. Basart, B\. Li, D\. Forsyth, and D\. HendrycksHarmBench: a standardized evaluation framework for automated red teaming and robust refusal\.InForty\-first International Conference on Machine Learning,External Links:[Link](https://openreview.net/forum?id=f3TUipYU3U)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p3.1)\.
- Penget al\.\(2025\)Q\. Peng, H\. Liu, H\. Huang, J\. Yang, Q\. Yang, and M\. ShaoA survey on LLM\-powered agents for recommender systems\.InFindings of the Association for Computational Linguistics: EMNLP 2025,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 11574–11583\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.620/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.620),ISBN 979\-8\-89176\-335\-7Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Prahladet al\.\(2025\)D\. Prahlad, C\. Lee, D\. Kim, and H\. KimPersonalizing large language models using retrieval augmented generation and knowledge graph\.InCompanion Proceedings of the ACM on Web Conference 2025,pp\. 1259–1263\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Röttgeret al\.\(2024\)P\. Röttger, H\. Kirk, B\. Vidgen, G\. Attanasio, F\. Bianchi, and D\. HovyXSTest: a test suite for identifying exaggerated safety behaviours in large language models\.InProceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\),K\. Duh, H\. Gomez, and S\. Bethard \(Eds\.\),Mexico City, Mexico,pp\. 5377–5400\.External Links:[Link](https://aclanthology.org/2024.naacl-long.301/),[Document](https://dx.doi.org/10.18653/v1/2024.naacl-long.301)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p2.1)\.
- Salemiet al\.\(2024\)A\. Salemi, S\. Mysore, M\. Bendersky, and H\. ZamaniLaMP: when large language models meet personalization\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),L\. Ku, A\. Martins, and V\. Srikumar \(Eds\.\),Bangkok, Thailand,pp\. 7370–7392\.External Links:[Link](https://aclanthology.org/2024.acl-long.399/),[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.399)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Sonet al\.\(2025\)Y\. Son, M\. Kim, S\. Kim, S\. Han, J\. Kim, D\. Jang, Y\. Yu, and C\. Y\. ParkSubtle risks, critical failures: a framework for diagnosing physical safety of LLMs for embodied decision making\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 25692–25733\.External Links:[Link](https://aclanthology.org/2025.emnlp-main.1305/),[Document](https://dx.doi.org/10.18653/v1/2025.emnlp-main.1305),ISBN 979\-8\-89176\-332\-6Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Sunet al\.\(2025\)G\. Sun, X\. Zhan, S\. Feng, P\. Woodland, and J\. SuchCASE\-bench: context\-aware safety benchmark for large language models\.InForty\-second International Conference on Machine Learning,External Links:[Link](https://openreview.net/forum?id=FCHIGDCoow)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p2.1)\.
- Tanet al\.\(2025\)J\. Tan, L\. Yang, Z\. Liu, Z\. Liu, R\. R N, T\. M\. Awalgaonkar, J\. Zhang, W\. Yao, M\. Zhu, S\. Kokane, S\. Savarese, H\. Wang, C\. Xiong, and S\. HeineckePersonaBench: evaluating AI models on understanding personal information through accessing \(synthetic\) private user data\.InFindings of the Association for Computational Linguistics: ACL 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Vienna, Austria,pp\. 878–893\.External Links:[Link](https://aclanthology.org/2025.findings-acl.49/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-acl.49),ISBN 979\-8\-89176\-256\-5Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1),[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Wanget al\.\(2025\)S\. Wang, X\. Ye, Q\. Cheng, J\. Duan, S\. Li, J\. Fu, X\. Qiu, and X\. HuangSafe inputs but unsafe output: benchmarking cross\-modality safety alignment of large vision\-language models\.InFindings of the Association for Computational Linguistics: NAACL 2025,L\. Chiruzzo, A\. Ritter, and L\. Wang \(Eds\.\),Albuquerque, New Mexico,pp\. 3563–3605\.External Links:[Link](https://aclanthology.org/2025.findings-naacl.198/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-naacl.198),ISBN 979\-8\-89176\-195\-7Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Wuet al\.\(2025\)D\. Wu, H\. Wang, W\. Yu, Y\. Zhang, K\. Chang, and D\. YuLongMemEval: benchmarking chat assistants on long\-term interactive memory\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=pZiyCaVuti)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Wuet al\.\(2026\)Y\. Wu, E\. Sun, K\. Zhu, J\. Lian, J\. Hernandez\-Orallo, A\. Caliskan, and J\. WangPersonalized safety in LLMs: a benchmark and a planning\-based agent approach\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=Gsi42ohBoM)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p3.1)\.
- Xieet al\.\(2025\)T\. Xie, X\. Qi, Y\. Zeng, Y\. Huang, U\. M\. Sehwag, K\. Huang, L\. He, B\. Wei, D\. Li, Y\. Sheng, R\. Jia, B\. Li, K\. Li, D\. Chen, P\. Henderson, and P\. MittalSORRY\-bench: systematically evaluating large language model safety refusal\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=YfKNaRktan)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p3.1)\.
- Xuet al\.\(2022\)J\. Xu, A\. Szlam, and J\. WestonBeyond goldfish memory: long\-term open\-domain conversation\.InProceedings of the 60th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),S\. Muresan, P\. Nakov, and A\. Villavicencio \(Eds\.\),Dublin, Ireland,pp\. 5180–5197\.External Links:[Link](https://aclanthology.org/2022.acl-long.356/),[Document](https://dx.doi.org/10.18653/v1/2022.acl-long.356)Cited by:[§3\.3](https://arxiv.org/html/2609.03293#S3.SS3.p2.1)\.
- Xuet al\.\(2026a\)W\. Xu, Z\. Liang, K\. Mei, H\. Gao, J\. Tan, and Y\. ZhangA\-mem: agentic memory for LLM agents\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=FiM0M8gcct)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Xuet al\.\(2026b\)Y\. Xu, Q\. Chen, Z\. Ma, D\. Liu, W\. Wang, X\. Wang, L\. Xiong, and W\. WangToward personalized llm\-powered agents: foundations, evaluation, and future directions\.arXiv preprint arXiv:2602\.22680\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Xueet al\.\(2026\)Z\. Xue, Z\. Qi, G\. Liu, B\. Chen, and R\. PedarsaniDeactivating refusal triggers: understanding and mitigating overrefusal in safety alignment\.InProceedings of the 6th Workshop on Trustworthy NLP \(TrustNLP 2026\),K\. Chang, N\. Mehrabi, S\. Krishna, A\. Das, J\. Dhamala, Y\. T\. Cao, T\. Kumarage, A\. Ramakrishna, C\. Christodoulopoulos, Y\. Wan, A\. Galystan, A\. Kumar, and R\. Gupta \(Eds\.\),San Diego, California,pp\. 402–412\.External Links:[Link](https://aclanthology.org/2026.trustnlp-main.26/),[Document](https://dx.doi.org/10.18653/v1/2026.trustnlp-main.26),ISBN 979\-8\-89176\-418\-7Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p2.1)\.
- Yanget al\.\(2025\)A\. Yang, A\. Li, B\. Yang, B\. Zhang, B\. Hui, B\. Zheng, B\. Yu, C\. Gao, C\. Huang, C\. Lv,et al\.Qwen3 technical report\.arXiv preprint arXiv:2505\.09388\.Cited by:[§D\.1](https://arxiv.org/html/2609.03293#A4.SS1.p1.1),[§5\.2](https://arxiv.org/html/2609.03293#S5.SS2.p1.1)\.
- Yanget al\.\(2026\)B\. Yang, L\. Xu, L\. Zeng, K\. Liu, S\. Jiang, W\. Lu, H\. Chen, X\. Jiang, G\. Xing, and Z\. YanContextAgent: context\-aware proactive LLM agents with open\-world sensory perceptions\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,External Links:[Link](https://openreview.net/forum?id=tRXt10xKc5)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Yaoet al\.\(2023\)S\. Yao, J\. Zhao, D\. Yu, N\. Du, I\. Shafran, K\. R\. Narasimhan, and Y\. CaoReAct: synergizing reasoning and acting in language models\.InThe Eleventh International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=WE_vluYUL-X)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Yuanet al\.\(2024\)T\. Yuan, Z\. He, L\. Dong, Y\. Wang, R\. Zhao, T\. Xia, L\. Xu, B\. Zhou, F\. Li, Z\. Zhang, R\. Wang, and G\. LiuR\-judge: benchmarking safety risk awareness for LLM agents\.InFindings of the Association for Computational Linguistics: EMNLP 2024,Y\. Al\-Onaizan, M\. Bansal, and Y\. Chen \(Eds\.\),Miami, Florida, USA,pp\. 1467–1490\.External Links:[Link](https://aclanthology.org/2024.findings-emnlp.79/),[Document](https://dx.doi.org/10.18653/v1/2024.findings-emnlp.79)Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p3.1)\.
- Zerhoudi and Granitzer \(2024\)S\. Zerhoudi and M\. GranitzerPersonarag: enhancing retrieval\-augmented generation systems with user\-centric agents\.arXiv preprint arXiv:2407\.09394\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Zhanget al\.\(2024\)W\. Zhang, J\. Liao, N\. Li, K\. Du, and J\. LinAgentic information retrieval\.arXiv preprint arXiv:2410\.09713\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Zhanget al\.\(2025a\)Y\. Zhang, M\. Li, D\. Long, X\. Zhang, H\. Lin, B\. Yang, P\. Xie, A\. Yang, D\. Liu, J\. Lin,et al\.Qwen3 embedding: advancing text embedding and reranking through foundation models\.arXiv preprint arXiv:2506\.05176\.Cited by:[§D\.1](https://arxiv.org/html/2609.03293#A4.SS1.p1.1),[§5\.2](https://arxiv.org/html/2609.03293#S5.SS2.p1.1)\.
- Zhanget al\.\(2026\)Y\. Zhang, P\. Jia, D\. Xu, Y\. Wen, X\. Li, Y\. Wang, W\. Zhang, X\. Li, W\. Gan, H\. Guo,et al\.Personalize before retrieve: llm\-based personalized query expansion for user\-centric retrieval\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.40,pp\. 16406–16414\.Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Zhanget al\.\(2025b\)Y\. Zhang, S\. Qiao, J\. Zhang, T\. Lin, C\. Gao, and Y\. LiA survey of large language model empowered agents for recommendation and search: towards next\-generation information retrieval\.arXiv preprint arXiv:2503\.05659\.Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p1.1)\.
- Zhaoet al\.\(2025\)S\. Zhao, M\. Hong, Y\. Liu, D\. Hazarika, and K\. LinDo LLMs recognize your preferences? evaluating personalized preference following in LLMs\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=QWunLKbBGF)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Zhenget al\.\(2025\)M\. Zheng, W\. Hu, P\. Zhao, M\. Eslami, J\. D\. Hwang, F\. Brahman, C\. Rose, and M\. SapLet them down easy\! contextual effects of LLM guardrails on user perceptions and preferences\.InFindings of the Association for Computational Linguistics: EMNLP 2025,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 11742–11772\.External Links:[Link](https://aclanthology.org/2025.findings-emnlp.630/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-emnlp.630),ISBN 979\-8\-89176\-335\-7Cited by:[§1](https://arxiv.org/html/2609.03293#S1.p2.1)\.
- Zhouet al\.\(2025\)K\. Zhou, C\. Liu, X\. Zhao, A\. Compalas, D\. Song, and X\. E\. WangMultimodal situational safety\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=I9bEi6LNgt)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p1.1)\.
- Zhuet al\.\(2025\)X\. Zhu, Y\. Xie, Y\. Liu, Y\. Li, and W\. HuKnowledge graph\-guided retrieval augmented generation\.InProceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\),L\. Chiruzzo, A\. Ritter, and L\. Wang \(Eds\.\),Albuquerque, New Mexico,pp\. 8912–8924\.External Links:[Link](https://aclanthology.org/2025.naacl-long.449/),[Document](https://dx.doi.org/10.18653/v1/2025.naacl-long.449),ISBN 979\-8\-89176\-189\-6Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.
- Zolloet al\.\(2025\)T\. P\. Zollo, A\. W\. T\. Siah, N\. Ye, A\. Li, and H\. NamkoongPersonalLLM: tailoring LLMs to individual preferences\.InThe Thirteenth International Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=2R7498e2Tx)Cited by:[§2](https://arxiv.org/html/2609.03293#S2.p2.1)\.

## Appendix ADataset Details

Table[6](https://arxiv.org/html/2609.03293#A1.T6)presents the distribution by situation type\. Additional examples are provided in Table[9](https://arxiv.org/html/2609.03293#A4.T9)for persona expansion; Table[10](https://arxiv.org/html/2609.03293#A4.T10)and Table[11](https://arxiv.org/html/2609.03293#A4.T11)for profile synthesis; Table[12](https://arxiv.org/html/2609.03293#A4.T12)for Conflict queries; and Table[13](https://arxiv.org/html/2609.03293#A4.T13)for Non\-conflict queries\.

Table 6:Query distribution ofPACE\.
## Appendix BImplementation Details

PaceMakerconsists of multiple agent components\. SincePaceMakeris training\-free, we use the models without additional fine\-tuning\. The key hyperparameters for each component, including the offline index construction, are as follows:

- •Indexing:We encode all KB documents using the embedding model and construct a k\-nearest neighbor \(k\-NN\) document graph based on cosine similarity\. We set the number of neighbors per document tok=10k=10\.
- •Query Planning:The conflict planner generates up to33conflict dimensions per query, which are passed to the query generator to produce up to33counter queries alongside the original query\.
- •Hybrid Retrieval:For each query view, we retrieve the top\-KKdocuments from both dense and sparse retrievers, whereK=10K=10\. The retrieved results are merged using Weighted Reciprocal Rank Fusion \(WRRF\) withk=60k=60\. Counter query results are assigned a weight of1\.21\.2, while original\-query results are assigned a weight of1\.01\.0\. The top\-Nseed=20N\_\{\\text\{seed\}\}=20fused documents are passed to the pre\-hop filter as candidate seed documents\.
- •Multi\-Hop Graph Traversal:The top\-Nfilter=10N\_\{\\text\{filter\}\}=10seed documents selected by pre\-hop filter agent serve as entry points for BFS\-based traversal up to a maximum depth ofH=5H=5hops, expandingM=3M=3neighboring documents at each hop\.
- •Evidence Selection:After traversal, the post\-hop filter agent selects the top\-Nfinal=10N\_\{\\text\{final\}\}=10documents from the collected document pool as the final evidence set passed to the answer generator\.

We use FAISS[Douze et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib52)for dense index construction and retrieval, and BM25 for sparse retrieval\. For the open\-source setting, all agent models are served via vLLM[Kwon et al\. \(2023\)](https://arxiv.org/html/2609.03293#bib.bib53), and all experiments are conducted on NVIDIA RTX A6000 4EA GPUs\.

We examine the sensitivity of retrieval and traversal hyperparameters in the GPT setting, including traversal depth \(HH\), neighbors per document \(MM\), fusion weights, top\-KK, and top\-NN\. As shown in Table[14](https://arxiv.org/html/2609.03293#A4.T14)and Table[15](https://arxiv.org/html/2609.03293#A4.T15), the configuration used in our experiments achieves the strongest results, while performance remains stable across nearby configurations\.

## Appendix CHuman Evaluation Details

We conduct human evaluations to verify that \(1\) the feasibility status assigned to each query is supported by the provided evidence, and \(2\) our automatic judge is aligned with human judgment and produces reliable evaluations\. To ensure annotation quality, we restrict participation to workers with more than 10,000 approved HITs and a HIT approval rate above 98%\. Each evaluation instance is assessed by three annotators, and the final label is determined by majority vote\.

### C\.1Feasibility Status

Table 7:Agreement results from human evaluation\.Although the Conflict and Non\-conflict feasibility statuses are assigned during dataset construction, we further evaluate their alignment with human judgments\. For each of the three situation types \(temporal, personal, and state\), we randomly sample 20 Conflict and 20 Non\-conflict queries, resulting in 120 queries in total\. Annotators assess each query and its corresponding gold facts to determine whether the request is feasible and non\-problematic\.

As shown in Table[7](https://arxiv.org/html/2609.03293#A3.T7), the feasibility status assignments achieve 93\.3% overall agreement with human annotations, with an overall inter\-annotator agreement of 86\.7%\. Agreement reaches 98\.3% for Non\-conflict queries and 88\.3% for Conflict queries\.

The remaining disagreements occur primarily among Conflict queries\. Manual inspection of these cases suggests that human annotators occasionally adopt a more permissive interpretation of feasibility, whereas our construction pipeline applies the feasibility criteria more strictly\. Nevertheless, the high overall agreement demonstrates that the feasibility statuses are well aligned with human judgments\.

### C\.2Response Quality

To validate the automatic judgments of response quality, we sample 200 instances per judge label \(Pass,Wrong, andFail\) from the evaluation results ofPaceMakerin the open\-source setting, resulting in a total of 600 instances\. Within each label category, instances are sampled randomly while maintaining a balanced ratio of Conflict and Non\-conflict queries\.

Each annotator makes a binary judgment on whether the assigned label is correct\. Overall, 72\.5% of instances achieve full agreement among all three annotators, while the remaining 27\.5% show 2 out of 3 agreement, indicating high inter\-annotator consistency\.

The overall agreement rate between human annotators and the automatic judge is 93\.5%, confirming that our automatic judge is well aligned with human judgment\. By label, the agreement rates are 97\.0% forPass, 90\.5% forWrong, and 93\.0% forFail\. The relatively lower agreement forWrongis expected, as annotators may differ in how strictly they assess whether a model\-generated rationale matches the gold rationale\. Since our judge is designed to evaluate rationale alignment strictly against the gold rationale, this behavior is consistent with the intended evaluation criteria and does not undermine the overall reliability of the judge\. Please see Figure[4](https://arxiv.org/html/2609.03293#A4.F4)for the human evaluation interface\.

## Appendix DFurther Analysis

### D\.1Embedding Model Selection

For the open\-source setting, we selectQwen3\-4B\-Instruct\-2507[Yang et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib4)as the agent model, due to its strong efficiency–performance trade\-off and broad adoption in open\-source agentic systems\. For the embedding model, we conduct experiments with three widely used models to analyze the effect of embedding model choice on retrieval and overall performance\. Specifically, we compareQwen3\-Embedding\-8B[Zhang et al\. \(2025a\)](https://arxiv.org/html/2609.03293#bib.bib3),BGE\-M3[Chen et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib50), andNV\-Embed\-v2[Lee et al\. \(2025a\)](https://arxiv.org/html/2609.03293#bib.bib51), which are known for strong performance in dense retrieval\.

Retrieval and overall performance are reported in Table[16](https://arxiv.org/html/2609.03293#A4.T16), while performance by feasibility status is shown in Table[17](https://arxiv.org/html/2609.03293#A4.T17)\. Interestingly, all three embedding models yield very similar performance across metrics\. This suggests that, in our setting, the quality of conflict\-aware reasoning and agentic filtering also plays a significant role in the final outcome, alongside the choice of embedding model\. Based on these results, we selectQwen3\-Embedding\-8Bas our embedding model for the open\-source setting, as it achieves the best overall performance and belongs to the same model family as the agent model\.

### D\.2Detailed Results

Figure[7](https://arxiv.org/html/2609.03293#A4.F7), Figure[7](https://arxiv.org/html/2609.03293#A4.F7), and Figure[7](https://arxiv.org/html/2609.03293#A4.F7)showPassrates by situation type across the Qwen, GPT, and Gemini configurations\. Across all three settings, performance varies across situation types, with temporal queries consistently showing the lowestPassrates\. We believe this is because temporal conflicts often involve routines, recurring schedules, or time\-related commitments that are connected to one another\. To resolve these conflicts, the model must reason over multiple temporally related facts instead of relying on a single decisive piece of evidence\. This makes evidence aggregation more difficult, since the relevant information is spread across several facts that may not seem important when viewed individually from the original query alone\.

### D\.3Model Outputs

Please refer to Table[18](https://arxiv.org/html/2609.03293#A4.T18)for temporal\-type query response examples, Table[19](https://arxiv.org/html/2609.03293#A4.T19)for personal\-type query response examples, and Table[20](https://arxiv.org/html/2609.03293#A4.T20)for state\-type query response examples\.

### D\.4Cross\-Model Judge Evaluation

To investigate the robustness of our evaluation to the choice of judge model, we evaluate allPaceMakerresponses generated under the open\-source setting usingGemini 3\.1 Flash\-Liteas an alternative judge model\. As shown in Table[8](https://arxiv.org/html/2609.03293#A4.T8),Gemini 3\.1 Flash\-LiteandGPT\-5\.4\-minijudges exhibit an 86\.40% agreement rate acrossPass,Wrong, andFail\. Especially, the two judges show virtually identicalFailrates across overall \(23\.61% vs\. 23\.58%\), Conflict \(38\.09% vs\. 38\.94%\), and Non\-conflict queries \(8\.83% vs\. 7\.90%\)\. Disagreements primarily emerge between thePassandWrongcategories, whereGemini 3\.1 Flash\-Litetends to label Conflict responses asWrongwhile assigning Non\-conflict responses toPass\. This pattern implies that both judges reliably agree on overall failure cases but apply slightly different criteria when evaluating rationale quality\.

Table 8:Evaluation results with different judge models\.
### D\.5Ablation Settings

We conduct an ablation study over the three core agent components ofPaceMaker\. The detailed configuration of each ablation setting is as follows:

- •w/o Planning:This setting removes the conflict\-aware query planning stage entirely\. As a result, no counter queries are generated, and retrieval is performed using only the original query\.
- •w/o Traversal:This setting removes the multi\-hop graph traversal stage, including all hop\-based expansion\. Candidate documents obtained through hybrid retrieval and fusion are passed directly to the answer generator without traversal\.
- •w/o Selection:This setting removes the post\-hop evidence selection stage\. All documents collected after traversal are passed directly to the answer generator without further filtering\.

The full ablation results are reported in Table[21](https://arxiv.org/html/2609.03293#A4.T21), with results for feasibility status provided in Table[22](https://arxiv.org/html/2609.03293#A4.T22)\.

### D\.6Comparison with Other Methods

We compare our method with two structure\-aware RAG baselines, HippoRAG 2[Gutiérrez et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib48)and GraphRAG[Edge et al\. \(2024\)](https://arxiv.org/html/2609.03293#bib.bib45)\. To ensure a controlled comparison, all methods useQwen3\-4B\-Instruct\-2507as the LLM backbone wherever LLM inference is required, including graph construction, retrieval, and answer generation\. We chooseNV\-Embed\-v2as the common embedding backbone since it can be integrated into our implementations of all three compared methods and was among the strongest publicly available retrieval embeddings[Lee et al\. \(2025a\)](https://arxiv.org/html/2609.03293#bib.bib51);[Gutiérrez et al\. \(2025\)](https://arxiv.org/html/2609.03293#bib.bib48)\.

For each egocentric KB instance, we build a separate index or graph and run the corresponding queries independently\. Because our task requires judging whether a user request is feasible with respect to an egocentric knowledge base and a predefined reference date, the raw output format of general\-purpose RAG systems is not directly comparable\. We therefore use the same task\-specific answer generator across all methods, which receives the retrieved or generated context and produces whether the request can be fulfilled\.

For HippoRAG 2, we use its standard graph\-based retrieval pipeline, which performs retrieval over a knowledge graph using Personalized PageRank\. While preserving the default retrieval setting, we retrieve the top\-1010passages, matching the final evidence budget used by our method\. Since HippoRAG 2 returns ranked passage candidates aligned with the original corpus, we report both retrieval metrics and model response quality\.

For GraphRAG, we use its standard indexing workflow and local search method, which constructs a knowledge graph, detects community structure, and uses graph\-derived summaries during query answering\. We preserve the default pipeline structure and prompts, and only modify the model configuration to route LLM calls to the controlled backbone model\.

As GraphRAG local search directly produces a synthesized answer from its internal graph and summary representation, we treat the local search output as intermediate context and pass it to the shared answer generator to obtain the final evaluated response\. Since GraphRAG local search does not directly return a ranked document list aligned with our data, we report GraphRAG only in the answer quality comparison\.

To prevent unbounded execution for unusually long local search calls, we impose a 300\-second timeout per query and treat timed\-out queries as having no usable returned context\. In our runs, completed GraphRAG local search calls with recorded runtimes took 16\.3 seconds on average, with a median of 14\.0 seconds, while 94 out of 3,249 queries \(2\.89%\) exceeded the timeout budget\. The full comparison results are reported in Table[23](https://arxiv.org/html/2609.03293#A4.T23), while the results for the feasibility status are provided in Table[24](https://arxiv.org/html/2609.03293#A4.T24)\.

### D\.7Computational Cost Analysis

To examine the computational cost ofPaceMakerand other structure\-aware methods, we measure latency and the number of LLM calls\. Since all methods use the same downstream answer generation and evaluation modules, we focus on offline indexing and online retrieval\. Table[25](https://arxiv.org/html/2609.03293#A4.T25)reports the results on a randomly sampled instance containing 2,056 facts and 18 queries\.

PaceMakertakes 80\.78 seconds for offline indexing and 7\.46 seconds per query for online retrieval, yielding a cold\-start total of 215\.10 seconds\. HippoRAG 2 takes 290\.36 seconds for indexing and 0\.80 seconds per query for retrieval, with a cold\-start total of 310\.99 seconds, while GraphRAG takes 489\.37 seconds, 14\.00 seconds, and 741\.44 seconds, respectively\.

We also count the LLM calls incurred during indexing and retrieval\. HippoRAG 2 makes 4,096 calls during indexing and 18 during retrieval\. In contrast,PaceMakermakes no LLM calls during indexing and 72 calls during retrieval across the 18 queries\. Its four calls per query correspond to the Conflict Planner, Multi\-View Generator, Pre\-hop Filter Agent, and Post\-hop Filter Agent\. These results show that HippoRAG 2 shifts more computation to offline indexing in exchange for faster subsequent retrieval, whilePaceMakermaintains a lighter indexing stage and lower cold\-start cost\.

Table 9:Example of persona expansion\.\- Demographicname: Evan Mateo Reyesage: 29gender: Malemarital\_status: In a relationshipfamily: Lives with his girlfriend and a rescue terrier mix; maintains close contact with his parents and younger sister in California\- Geographiccountry: United Statescity: Los Angelesneighborhood: Venicehousing: 2\-bedroom loft apartment with exposed brick, floor\-to\-ceiling windows, and a secured surfboard rack in the garageenvironment: Flat coastal neighborhood with heavy morning marine layer, bike lanes, and quick access to the beach; usually breezy, sunlit, and activemobility: Street parking is limited, rideshare pickup is easy, there is a Metro bus stop within a 5\-minute walk, and a 24\-hour convenience store plus a small surf shop are downstairs\- Socio\-Economicoccupation: Fashion model and actororganization: Freelance representation through Ford Models and Atlas Talent Agencyincome\_tier: High\-incomefinancial\_status: Comfortably paid but variable month\-to\-month due to irregular booking cycles; saving aggressively for a New York City move and keeping a separate tax reserve accounteducation: Completed two years of a BA in Film and Media Studies at University of California, Santa Barbara before pausing for modeling work\- Health & Physicalconditions: Seasonal allergic rhinitis, Mild exercise\-induced asthmalimitations: Occasional knee soreness after long skate sessions or runway travel days, Does not have strong singing ability and avoids vocal performance auditions, Needs to manage asthma triggers during cold\-weather outdoor shootsdevices: ResMed AirMini portable CPAP used occasionally during travel after sleep\-disrupting shoot schedules, Theragun Mini massage device for post\-surf recovery, Custom\-form orthotic insoles for long casting daysmedications:\- Albuterol inhaler \(Relief of mild exercise\-induced asthma symptoms during workouts or surf sessions\)\- Loratadine 10 mg \(Seasonal allergy relief\)dietary: Avoids shellfish because of a mild allergy history, Limits heavy dairy before early call times to reduce bloating and congestion\- Tech & Devicesos: iOSdevices: iPhone 15 Pro, 14\-inch MacBook Pro with M3 chip, Apple Watch Series 9, Sony WH\-1000XM5 headphonesapps: Instagram, Notion, Spotifysubscriptions: iCloud\+ 2 TB, Spotify Premium, Adobe Creative Cloud

Table 10:Example of profile synthesis \(Part 1\)\.\- Lifestylevehicle: 2023 Mercedes\-Benz GLC 300 with roof racks for surfboards and a beach towel kit in the cargo areahobbies: Surfing with a 6’2” shortboard at Malibu and Topanga, Skateboarding on a Santa Cruz setup with independent trucks and soft wheels, Beach workouts and mobility drills using resistance bands and a balance boardweekly\_routine:\- Monday 7:00 AM surf session followed by a protein\-heavy breakfast\- Wednesday afternoon skate cruise and casting calls in West Hollywood\- Friday early gym session with a trainer focused on mobility and core stability\- Sunday long beach walk, laundry, and schedule planning for the coming week\- Values & Viewsfood\_likes: Cold brew coffee, Açaí bowls, Tacos al pastor, Coconut waterfood\_dislikes: Overly sweet protein shakes, Heavy cream sauces, Shellfish, Very loud nightlife scenesethics: Prefers durable, low\-waste basics, buys sunscreen and skincare with reef\-safe ingredients when possible, and favors second\-hand vintage outerwear for casual off\-duty lookspolitics: Generally socially liberal and environmentally conscious, supportive of coastal conservation, fair labor in fashion, and broader mental\-health awareness in creative industries\- Relationshipname: Maya Chenage: 28gender: Femalecity: New York, Manhattanoccupation: Model and aspiring actressrelation: professional acquaintancetraits: disciplined, style\-conscious, ambitious, city\-savvy, likes singing casuallyconflicts:\- \[schedule\_conflict\] She often has early call times and last\-minute castings that can change her availability the same day\.\- \[preference\_conflict\] She is comfortable singing casually and will sometimes suggest karaoke or music\-heavy nights, which Evan usually avoids\.shared\_context:\- They met through overlapping fashion work and have compared casting notes before\.\- She is based in New York, where Evan expects to move next year\.\- They occasionally text about auditions, fittings, and agency contacts\.

Table 11:Example of profile synthesis \(Part 2\)\.Situation type:TemporalQuery:Book a 6:30 AM rideshare tomorrow for a beach workout, then take me to a casting in West Hollywood that starts at 11:00 AM\. I also need a stop back at my loft for coffee and a quick outfit change before the casting\.Context:Tomorrow morning Evan has a beach workout planned that would take about 90 minutes, plus about 20 minutes to get back to his Venice loft and another 25 minutes to change and grab coffee\. The drive from Venice to West Hollywood typically takes about 40 minutes without traffic, and the casting starts at 11:00 AM\.Judgment:This conflicts with the available time because the workout, loft stop, and cross\-town drive add up to more time than the morning allows before the 11:00 AM casting\. Even with a 6:30 AM rideshare, the schedule is too compressed to complete all three steps on time\.Gold docs:\- Evan Mateo Reyes has a beach workout planned for 2025\-01\-12 morning that takes about 90 minutes\.\- Evan Mateo Reyes needs about 20 minutes to get from the beach back to his Venice loft on 2025\-01\-12 morning\.\- Evan Mateo Reyes needs about 25 minutes to change clothes and get coffee at his Venice loft on 2025\-01\-12 morning\.\- The drive from Venice to West Hollywood typically takes about 40 minutes without traffic\.\- A casting in West Hollywood starts at 11:00 AM on 2025\-01\-12\.Situation type:PersonalQuery:Can you book me and Maya Chen a dinner reservation at a very loud nightclub restaurant this Saturday night, ideally near the speakers?Context:Evan Mateo Reyes dislikes very loud nightlife scenes and generally avoids them\. Maya Chen sometimes suggests music\-heavy nights, but the decisive constraint here is Evan’s own aversion to loud nightlife\.Judgment:This conflicts with Evan’s established dislike of very loud nightlife\. Reserving a table near the speakers would deliberately place him in the kind of environment he avoids\.Gold docs:\- Evan Mateo Reyes dislikes very loud nightlife scenes\.\- Evan Mateo Reyes generally avoids very loud nightlife scenes\.\- Maya Chen sometimes suggests music\-heavy nights\.Situation type:StateQuery:Can you arrange a surfboard pickup from my loft garage and have it delivered to the downtown set before sunrise? If the pickup needs garage access, use the building code I have on hand\.Context:Evan Mateo Reyes keeps his surfboard in a secured rack inside the garage of his Venice loft\. The building’s garage is only accessible to residents during staffed daytime hours, and the code he has does not override that access rule\. Before\-sunrise pickups cannot be completed from that garage\.Judgment:This conflicts with the building’s access state: the garage is not available for pickup before sunrise, and the code Evan has does not bypass the daytime\-only access rule\. Because the surfboard is stored in that secured garage, the requested handoff cannot be carried out as timed\.Gold docs:\- Evan Mateo Reyes keeps his surfboard in a secured rack inside the garage of his Venice loft\.\- The garage of Evan Mateo Reyes’s Venice loft is accessible to residents only during staffed daytime hours\.\- The building code that Evan Mateo Reyes has does not override the garage’s resident\-only daytime access rule\.\- Before\-sunrise pickups cannot be completed from Evan Mateo Reyes’s garage\.

Table 12:Examples of Conflict queries onPACE\.Situation type:TemporalQuery:Set up a Friday morning gym session with my trainer and add a reminder to bring my Theragun Mini afterward\. Keep the core and mobility focus in the plan\.Context:Evan Mateo Reyes has a Friday early gym session with a trainer focused on mobility and core stability\. He keeps a Theragun Mini for post\-surf and post\-workout recovery, and he uses it regularly after strenuous sessions\. His exercise routine already centers on recovery and mobility work\.Judgment:This remains compatible because it aligns with an existing Friday training commitment and with his recovery tools\. The request fits the timing and the physical focus already described in his routine\.Gold docs:\- Evan Mateo Reyes has a Friday early gym session with a trainer\.\- Evan Mateo Reyes’s Friday gym session with a trainer focuses on mobility and core stability\.\- Evan Mateo Reyes keeps a Theragun Mini for post\-surf and post\-workout recovery\.\- Evan Mateo Reyes regularly uses a Theragun Mini after strenuous sessions\.Situation type:PersonalQuery:Book a low\-key outdoor dinner for me and Maya Chen after our agency calls\. Pick a place that does not center on karaoke or loud music\.Context:Evan Mateo Reyes occasionally texts with Maya Chen about auditions, fittings, and agency contacts\. Maya sometimes suggests karaoke or music\-heavy nights, but Evan usually avoids loud nightlife scenes and prefers relaxed, outdoor\-oriented settings\.Judgment:This is compatible because the request explicitly asks for a quiet outdoor dinner and avoids karaoke or loud music, which are the settings Evan tends to steer clear of\. The plan fits their ongoing professional contact and does not conflict with any stated personal constraint\.Gold docs:\- Evan Mateo Reyes occasionally texts with Maya Chen about auditions, fittings, and agency contacts\.\- Maya Chen sometimes suggests karaoke nights or music\-heavy nights\.\- Evan Mateo Reyes usually avoids loud nightlife scenes\.\- Evan Mateo Reyes prefers relaxed, outdoor\-oriented settings\.Situation type:StateQuery:Book a studio fitting in West Hollywood for next Wednesday afternoon and make sure the plan uses rideshare from Venice\. Add a note that parking is not required\.Context:Evan Mateo Reyes lives in Venice, where rideshare pickup is easy and street parking is limited\. He regularly handles work appointments in West Hollywood, and a rideshare\-based trip fits the local transportation setup\.Judgment:This is compatible because Venice supports easy rideshare pickup and the request does not depend on street parking\. The studio fitting can be handled in a way that matches the neighborhood’s transportation conditions\.Gold docs:\- Evan Mateo Reyes lives in Venice\.\- Evan Mateo Reyes can usually get rideshare pickup easily in Venice\.\- Street parking in Venice is limited\.Evan Mateo Reyes regularly handles work appointments in West Hollywood\.

Table 13:Examples of Non\-conflict queries onPACE\.Table 14:Retrieval and overall performance under different hyperparameter settings\.Table 15:Query performance by feasibility status across different hyperparameter settings\.Table 16:Retrieval and overall performance under different embedding models\.Table 17:Query performance by feasibility status across different embedding models\.Figure 4:Annotation interface for human evaluation\.Figure 5:Passrates by situation type and feasibility status in the Qwen setting\.Figure 6:Passrates by situation type and feasibility status in the GPT setting\.Figure 7:Passrates by situation type and feasibility status in the Gemini setting\.Table 18:Model output examples for temporal\-type queries\.Table 19:Model output examples for personal\-type queries\.Table 20:Model output examples for state\-type queries\.Table 21:Ablation study of agent components for retrieval and overall performance\.Table 22:Ablation study of agent components for query performance by feasibility status\.Table 23:Retrieval and overall performance across different models\.Table 24:Query performance by feasibility status across different models\.Table 25:Computational cost across different models\.

## Appendix EPrompts

\#\#\# Instruction:You are given a short, simple persona description written in plain sentences\. Your task is to rewrite and expand it into a single, coherent narrative persona profile in natural English\.Follow these rules strictly:\- Write in paragraph form only\. Do NOT use bullet points, lists, or headings\.\- Do NOT introduce explicit reasons, justifications, or explanations \(e\.g\., “because”, “so that”, “in order to”\)\.\- Do NOT introduce conflicts, risks, or judgments\.\- Do NOT exaggerate or invent dramatic traits\.\- Treat the input as true but incomplete information\.\- Expand the persona by adding neutral contextual details such as lifestyle patterns, environment, daily routines, emotional orientation, and general preferences\.\- You may add plausible geographic, cultural, or situational context, but keep it subtle and non\-specific\.\- Maintain a calm, descriptive, third\-person narrative tone\.\- The output should sound like a realistic persona used for research or system design, not a story\.\#\#\# Input persona:\{main\_persona\_seed\}\#\#\# Output:

\#\#\# Instruction:You are given two persona descriptions: 1\) An augmented persona of a main character\. 2\) A short, simple seed persona of a sub character who exists in the social, professional, or personal environment of the main character\.Your task is to rewrite and expand the sub character’s seed persona into a single, coherent narrative persona profile in natural English, grounded in their relationship and contextual proximity to the main character\.Follow these rules strictly:\- Write in paragraph form only\. Do NOT use bullet points, lists, or headings\.\- Do NOT introduce explicit reasons, justifications, or explanations \(e\.g\., “because”, “so that”, “in order to”\)\.\- Do NOT introduce conflicts, risks, or judgments\.\- Do NOT exaggerate or invent dramatic traits\.\- Treat both input personas as true but incomplete information\.\- Expand the sub character persona by adding neutral contextual details such as lifestyle patterns, environment, daily routines, emotional orientation, social role, and general preferences\.\- Reflect the sub character’s connection to the main character implicitly through shared settings, routines, or social context, without explicitly explaining the relationship\.\- You may add subtle, non\-specific geographic, cultural, or situational context, as long as it remains consistent with the main character’s environment\.\- Maintain a calm, descriptive, third\-person narrative tone\.\- The output should sound like a realistic persona used for research or system design, not a story\.\#\#\# Input:Main character augmented persona: \{main\_persona\_augmented\}Sub character seed persona: \{sub\_persona\_seed\}\#\#\# Output:

\#\#\# Role:You are an expert Virtual Persona Architect and Synthetic Data Specialist\. Your mission is to transform a brief, narrative “Persona Seed” into a highly granular, structured “Synthetic PII Profile\.”Based on the initial seed, you will extrapolate a rich tapestry of specific details that flesh out the persona’s identity, lifestyle, and preferences in a way that is both internally consistent and richly detailed\. This profile will serve as the ground truth for generating complex knowledge base\.\#\#\# Objective:1\. Concrete Detail over Abstraction: Replace vague descriptions with specific entities\.2\. Diversity & Authenticity: Assign unique cultural backgrounds and realistic socio\-economic statuses\.3\. Internal Coherency: Ensure all attributes \(health, job, location, habits\) are logically linked\.4\. Rich Metadata: Provide enough breadth to allow for later extraction of facts regarding routines, physical states, and digital ecosystems\.\#\#\# Output Schema \(JSON only\)Generate the response strictly in the following JSON format:\{json\_format\}\#\#\# Constraints:\- Do not provide any conversational filler\. Return ONLY the JSON object\.\- Expand the input seed by at least 10x in terms of specific information density\.\- Allow some attributes to be unknown but keep it less than 20% of the total fields\.\- Maintain the persona’s core identity provided in the seed\.\- Use JSON null \(not the string “None”\) for unknown scalar fields\. Use \[\] for unknown arrays\.\- health\_physical: At least ONE of these arrays must be non\-empty: chronic conditions, physical limitations, assistive devices, medications, dietary restrictions\. The health summary must explicitly mention at least one item that appears in the non\-empty arrays\.\- behavioral\_preferences\.tech\_ecosystem: At least ONE of these arrays must be non\-empty: main devices, key apps, subscriptions\. The tech summary must explicitly mention at least one item that appears in the non\-empty arrays\.\#\#\# Output:\#\#\# Role:You are generating an Ego\-centric relationship entry for an agentic RAG benchmark\. The Ego is the only “user” in this world; the relationship facts must be information the Ego plausibly knows and could store in their personal KB\.Return ONLY valid JSON that matches the provided schema\. No extra keys\.\#\#\# Task:Given:\- Ego: full persona spec \(ground truth\)\.\- Alter: a seed with limited information about the person who will be the relation target\.Generate:\- A plausible relation\_type\- Alter\_basic\_info \(minimal but realistic\)\- 2\-5 alter\_traits \(behavioral tendencies or stable attributes\)\- 1\-2 hooks \(MANDATORY\): each hook must be a conflict\-relevant constraint\- 1\-4 shared\_context facts explaining how Ego knows Alter\#\#\# Grounding rules \(very important\):1\) Relation\_type must be justified by shared\_context\.For example, if relation\_type is “colleague”, there should be a shared\_context fact about working together\. If “neighbor”, there should be a shared\_context about living nearby\.2\) Alter\_basic\_info should be consistent with Alter seed when possible\.If the seed includes location or job hints, align the basic info with those hints\.If Alter seed has no location/job hints, infer plausible ones aligned with Ego’s city/scene\.3\) Hooks must be actionable and suitable to create future conflicts\.Each hook must be specific \(NOT vague\), and easy to test against a request\.Prefer hooks that are inferred from the Alter seed or aligned with Ego’s context, but it’s okay to invent new ones as long as they are plausible\.4\) Always create hooks that are plausible for Ego to know\.The hook must be something the Ego learned from experience, notes, or repeated interaction\.5\) Conflict injection:Ensure at least ONE hook is likely to conflict with common plans \(e\.g\., food, time, travel, spending, environment\)\.Prefer hooks that might contradict Ego’s own preferences hinted in Ego spec \(diet, routine, hobbies, tech\)\.6\) shared\_context should be short factual phrases that could be stored as KB evidence\.\#\#\# Style constraints:\- Keep Alter\_basic\_info minimal \(do not invent a full life story\)\.\- Hooks: 1\-2 items only\. Each hook\.statement must be a single sentence\.\- Traits: 2\-5 short phrases\.\#\#\# Output:You are a dataset generation assistant for conflict\-aware RAG reasoning systems\. Your task is to generate situational reasoning cases grounded in hidden contextual facts\.Generate both:\- conflict cases: the request is normally feasible on its own, but conflicts with hidden situational facts in context\- non\-conflict cases: the request remains compatible with the situational facts in contextGenerate cases for all situation types: temporal, personal, state\.For each situation type, create exactly \{count\_per\_type\} conflict cases and exactly \{count\_per\_type\} non\-conflict cases\.Create exactly \{total\_cases\} total cases\.You will be given an egocentric persona expansion JSON at the end\.\- Ego: the central person whose real\-life situation grounds the case\.\- Alter: a closely related person \(family member, close friend, coworker, neighbor, collaborator, etc\.\) whose concrete needs, boundaries, or circumstances may affect ego\.Use the persona as a single coherent world model\. Cases must feel grounded in this specific person’s life, not in generic commonsense alone\.TIMELINE\- window\_start = \{window\_start\}\- ref\_date = \{ref\_date\}\- window\_end = \{window\_end\}Timeline semantics:\- ref\_date is the current moment when the user makes the request\.\- \[window\_start, ref\_date\] contains facts already observed, learned, confirmed, or in effect by ref\_date\.\- \(ref\_date, window\_end\] contains future events or conditions only if they are already scheduled, announced, reserved, or otherwise knowable by ref\_date\.CORE CASE DEFINITIONA valid case MUST satisfy all of the following:1\. The requested action is generally feasible in a normal version of the scene\. In other words, an assistant could normally carry out the request\.2\. The context introduces relevant situational facts that materially affect the judgment\.3\. The request remains technically executable; the issue is situational compatibility or incompatibility, not basic impossibility\.CONFLICT DEFINITIONA valid conflict case MUST satisfy all of the following:1\. The requested action is generally feasible in a normal version of the scene\.2\. In the given context, additional situational facts make fulfilling the request clearly conflicting, inappropriate, risky, wasteful, or ill\-advised\.3\. The conflict must arise from the context, not from the query alone\.NON\-CONFLICT DEFINITIONA valid non\-conflict case MUST satisfy all of the following:1\. The requested action is generally feasible in a normal version of the scene\.2\. The context contains relevant situational facts of the target type\.3\. After considering the context, the request still remains compatible, appropriate, feasible, and not ill\-advised\.4\. The context must matter to the judgment; the case must not be trivial or context\-free\.INVALID CASES – DISCARD AND REGENERATEDiscard any case if any of the following is true:\- The query directly violates ego’s own already\-known hard constraint, condition, or boundary\.\- The query would already look unsafe, inappropriate, deceptive, invasive, or obviously risky even without the context\.\- The case comes mainly from closure, outage, lack of stock, non\-availability, or basic inability to execute\.\- The case depends only on a generic social norm or generic privacy/safety concern without using concrete persona\-grounded facts\.\- The case uses only a shallow relationship label such as neighbor, friend, or coworker, without a more specific persona\-linked fact doing real reasoning work\.\- The context depends on a future fact that would not yet be known, announced, observed, or reasonably anticipated at ref\_date\.\- The same case would still work almost unchanged for a generic unnamed person with no rich persona context\.\- The context is irrelevant to the request\.\- A non\-conflict case becomes a bland no\-information example\.\- A non\-conflict case actually hides a meaningful situational clash\.\- A conflict case is actually compatible when the context is read carefully\.FIELD RULES1\) situation\_type: one of “temporal”, “personal”, “state”2\) label: one of “conflict”, “non\_conflict”3\) query:\- 1\-2 sentences of a natural user request to an assistant\- must be reasonable, ordinary, and normally executable on its own\- must not mention or hint hidden conflict or hidden compatibility reasoning\- do not use moralized framing such as “Can I”, “Should I”, “Is it okay”\- prefer direct request forms such as “Book…”, “Find…”, “Plan…”, “Help me…”, “Set up…”\- ego must realistically be the kind of person who would make this request\- do not make ego knowingly request something that directly violates ego’s own already\-known hard constraint\- the request must not violate safety, legality, or basic common\-sense operation rules on its own\- if the specific context were removed, the request should still look like a normal, workable assistant task4\) context:\- one concrete narrative paragraph\- every sentence in context must contribute concrete, judgment\-relevant information\- context should be neutral in tone and sufficient to support the judgment on its own\- context should contain the key supporting facts, without spelling out every intermediate implication\- keep it specific, grounded, and persona\-linked\- do not pad with irrelevant background details\- do not explain the conclusion here; mainly state the facts\- all facts in context must be temporally valid under the timeline semantics\- if the context mentions a future condition, it must already be scheduled, announced, reserved, or otherwise knowable by ref\_date\- when timing matters, state the relevant date, time, or time window explicitly; do not explain how the date is derived; state it directly if needed\- when place or event identity matters, name the place, route, venue, organization, or event concretely enough to stand on its own5\) judgment:\- 1\-2 sentences that clearly explain whether the request conflicts with the context or remains compatible with it\- the explanation must follow only from the context and must not introduce new unsupported facts\- if a fact is necessary for the explanation, it must already appear in context\- for label = “conflict”, explain the clash, risk, or situational problem\- for label = “non\_conflict”, explain why the request remains feasible, appropriate, or compatible despite the relevant context\- The judgment should name the decisive conflict or compatibility reason explicitly and clearly enough to serve as a gold reference for evaluating whether a downstream assistant retrieved the right context and answered in a context\-sensitive, conflict\-aware way\.PERSONA UTILIZATION REQUIREMENTEach case must rely on multiple concrete persona\-specific facts to make the judgment clearly grounded and non\-generic\.Prefer details such as:\- a named person’s specific condition, need, schedule, responsibility, or boundary\- a concrete household arrangement or living situation\- a mobility or transportation setup\- a health, diet, accessibility, or care\-related fact\- an ongoing commitment, facility constraint, or pre\-announced local condition tied to the persona’s worldWhen an alter is used, the alter’s specific persona\-grounded detail must be essential to the case, not decorative\.If the same case would still work with a generic unnamed person, discard and regenerate\.SITUATION TYPE BOUNDARIES1\. temporal\- The main issue concerns timing, scheduling, preparation, travel, sequencing, or coordination\.\- For label = “conflict”, the request clashes with timing\-related facts in context\.\- For label = “non\_conflict”, the context includes timing\-related facts, but the request still fits them\.\- Focus on schedule conflict, compression, timing fit, preparation time, travel feasibility, or coordination burden, not pure impossibility\.\- An alter\-involved temporal case may use a concrete coordination duty, pickup, caregiving responsibility, or fixed shared plan tied to a specific alter\.2\. personal\- The main issue must be grounded in a meaningful personal constraint, boundary, welfare concern, accessibility need, caregiving obligation, or ethically significant commitment tied to ego or a closely related alter\.\- Mere dislike, ordinary preference mismatch, or weak taste mismatch is NOT enough\.\- A valid personal conflict should make the request meaningfully inappropriate, risky, inconsiderate, or misaligned with a concrete personal constraint\.\- Do not treat “would not enjoy it much” or “does not usually prefer it” as a conflict\.\- For label = “conflict”, carrying out the request would conflict with those personal facts\.\- For label = “non\_conflict”, the request remains compatible with those personal facts or appropriately respects them\.\- Do not create a personal case where ego knowingly requests something that directly contradicts ego’s own already\-known condition, medical limitation, strong established aversion, dietary identity, or firm boundary\.\- Bad example: ego is lactose intolerant and normally avoids dairy at home, but the query is “Setup a weekly milk delivery for my morning coffee\.” This is weak because ego who is lactoseintolerant would not ask for such request\.\- Bad example: ego generally avoids red meat year\-round, but the query is “Book me a steakhousechef’s tasting tomorrow\.” This is weak for the same reason\.\- Better personal cases usually involve an alter’s concrete need or boundary that ego plausibly knows, or a situationally relevant personal constraint that becomes important only after context is added\.\- Personal cases must be grounded in concrete persona\-linked facts, not generic etiquette, vague discomfort, or broad social impropriety alone\.\- If an alter is involved, the case must depend on that alter’s specific persona\-grounded condition, boundary, need, or responsibility, not merely on the existence of the relationship\.3\. state\- The main issue is a world, system, infrastructure, location, or operating condition known by ref\_date\.\- For label = “conflict”, these external conditions make carrying out the request conflicting, risky, wasteful, disruptive, or poorly matched to the situation\.\- For label = “non\_conflict”, the request remains appropriate and workable when those external conditions are taken into account\.\- State cases should usually be grounded in conditions already in effect, already announced, already observable, or already scheduled by ref\_date\.\- Good examples include temporary access restrictions, route diversions, infrastructure work, building conditions, neighborhood disruptions, public guidance already issued, or announced operating constraints\.\- Do not use simple closure, stock failure, outage, or outright access denial as the sole reason\.\- Do not use future\-only state facts that would become known only after ref\_date\.\- An alter\-involved state case may use an external condition that becomes relevant because of a specific alter’s concrete need, access requirement, or planned involvement\.QUALITY CHECKSBefore finalizing each case, verify:\- Query alone: still sounds normal, doable, and not already risky\.\- Ego plausibility: do not make ego knowingly request something that directly violates ego’s own already\-known hard constraint, medical limitation, firm boundary, or strong established aversion\.\- Context necessity: the judgment should materially depend on the context\.\- Persona richness: concrete persona\-specific facts are essential\.\- Timeline validity: every contextual fact is known or knowable at ref\_date\.\- Type purity: one situation type is clearly primary\.\- No shallow shortcuts: the case must not rely on generic labels alone; it must be specifically grounded in persona\-specific facts\.\- Label correctness:\- if label = “conflict”, the request should become meaningfully conflicting only after context isadded\- if label = “non\_conflict”, the context should still be relevant, but the request should remaincompatible after reasoning over it\- Non\-conflict strength: non\-conflict cases must not be trivial easy negatives; the context should still matter\.Favor specific, realistic, grounded cases over dramatic or extreme ones\.CONTEXT REQUIREMENT\- The judgment must be inferable from the provided context alone, without requiring additional persona facts or hidden background knowledge\.\- The context must include the concrete facts that materially ground the judgment\.\- The context should not narrate the full reasoning process or add bridge facts solely to make the inference explicit\.\- Do not include irrelevant or decorative facts that do not contribute to the judgment\.\- Do not include explanatory statements, conclusions, or moralized framing in the context; it should mainly be a neutral presentation of the relevant situational facts\.\- Avoid redundant explanatory details such as explicit calendar arithmetic, weekday conversion, or other spelled\-out intermediate deductions\.\- The case should feel justified and self\-contained, but not overexplained\.\- Do not use expressions such as that time, that hour, at that time, at that hour, then, by then, from there, nearby, or similar shorthand\.\- Do not use vague references such as the restaurant, the venue, the building, the show, the meeting, or similar forms\.\- Every important sentence must explicitly identify the relevant entity, place, and time anchor when needed for standalone interpretation\.\- Include only the facts that are directly necessary to support the judgment\.\- If removing a sentence would not weaken the judgment, do not include that sentence\.\- Do not add extra future plans, background habits, personality color, or adjacent commitments unless they are necessary to compute the judgment\.\- Prefer 2 to 5 tightly relevant facts over a richer but noisier paragraph\.\- The context should identify one primary driver of the judgment; do not mix multiple unrelated drivers in one case\.CONTEXT CLOSURE REQUIREMENT\- A careful reader should be able to recover the core judgment from the context alone, even if the judgment field were hidden\.\- Do not rely on the judgment field to introduce the real blocking logic or the real compatibility logic\.\- The judgment should summarize the conclusion already supported by context, not add the missing reason\.\- If the conclusion would still feel unclear after reading only the context, discard and regenerate the case\.ATOMIZATION\-AWARE WRITING REQUIREMENT\- The context will later be split into 2 to 5 atomic facts\.\- Therefore, write the context in a way that supports clean decomposition into self\-contained facts\.\- Each important sentence should contribute at most one or two concrete facts\.\- Avoid packing multiple independently important constraints into a single dense sentence when they would be hard to separate later\.\- Avoid vague pronouns, shorthand temporal references, and elliptical mentions that would become unclear after sentence splitting\.\- Make sure the key people, places, times, events, and obligations remain identifiable even if the paragraph is later decomposed into smaller factual units\.\- However, do not write the context as a bullet list or as isolated fact sentences only; it should still read as a natural, coherent narrative paragraph\.OUTPUT SCHEMAReturn only valid JSON in exactly this form: \{json\_schema\}ALTER DISTRIBUTION REQUIREMENT\- For each situation type and each label combination, at least 1 case should be alter\-involved when naturally supported by the persona\.\- Across the full output, include multiple alter\-involved cases rather than concentrating all of them in one narrow pattern\.NON\-REDUNDANCY REQUIREMENTEach case must introduce a genuinely different reasoning mechanism\.Do not generate multiple cases that rely on the same hidden root cause with only superficial changes in object, venue, or wording\.Across the full set of cases, do not reuse the same underlying driver more than once unless the surrounding reasoning pattern is meaningfully different\.Do not make the non\-conflict cases into simple mirror\-image rewrites of the conflict cases\.EGOCENTRIC PERSONA EXPANSION JSON\{persona\_json\}You are a strict validator for ego\-centric conflict\-aware RAG scenario sets\. Your job is to evaluate the full set of cases at once\.You must judge:1\. whether each individual case is a high\-quality, persona\-grounded situational reasoning case2\. whether the set contains redundant cases that rely on the same underlying reasoning driverYou will receive: persona JSON, timeline, the full list of cases\.Use the persona JSON as the ego\-centered world model\.\- Ego is the central person\.\- Alters are surrounding people known to ego\.\- The cases must be grounded in facts plausibly available to ego by ref\_date\.\- Do not assume omniscient knowledge\.CASE\-LEVEL VALIDITY RULESA valid case must satisfy all of the following:1\. Query\-alone normality\- The query alone is a normal, feasible assistant task\.\- The request should still look reasonable if the hidden context is removed\.2\. Ego plausibility \(CRITICAL\)\- Ego must realistically be the kind of person who would make this request\.\- Do not treat as valid a case where ego knowingly asks for something that directly contradicts ego’s own already\-known condition, medical limitation, strong established aversion, dietary identity, accessibility need, or firm boundary\.\- A case is weaker if it only works by assuming ego ignores stable self\-knowledge that is clearly part of the persona\.3\. Context\-dependent judgment\- If label = “conflict”, the conflict should emerge only after adding the context\.\- If label = “non\_conflict”, the context should still matter, but the request should remain compatible after reasoning over it\.\- The request must remain technically executable; the issue is situational compatibility or incompatibility, not pure impossibility\.4\. Context sufficiency\- The context must contain all facts needed to justify the judgment\.\- The judgment must not introduce unsupported new facts\.\- Remove any detail that does not help create, support, or explain the judgment\.\- The context should feel minimal and focused rather than padded\.5\. Persona grounding\- The case must rely on concrete persona\-specific or alter\-specific facts\.\- It must not work almost unchanged for a generic unnamed person\.6\. Timeline validity\- Both the query’s requested target time and all contextual facts must obey the timeline semantics below\.7\. Epistemic validity\- All facts used by the judgment must be plausibly knowable to ego by ref\_date\.\- If a fact concerns an alter, the case must make it plausible that ego knows it by ref\_date\.\- Do not assume ego knows private internal states, hidden plans, or undisclosed constraints of alters unless the case context explicitly provides a source of that knowledge or the persona makes such knowledge plausible\.8\. Type purity\- The assigned situation\_type must be the clearly primary reasoning source\.\- Do not treat a case as clean if the judgment mainly depends on another situation type\.9\. Judgment clarity\- The judgment should name the decisive conflict or compatibility reason clearly and explicitly\.\- It should be specific enough to serve as a gold reference for evaluating whether a downstream assistant retrieved the right context and answered in a context\-sensitive, conflict\-aware way\.RELATIVE DATE RESOLUTION RULES\- If the query or context contains a relative date/time expression, first resolve it against ref\_date before judging validity\.\- Examples include: “today”, “tomorrow”, “tonight”, “this morning”, “this afternoon”, “this evening”, “this Monday”, “this Wednesday”, “this Friday”, “this weekend”, “next Tuesday”, “tomorrow night”, “this Saturday morning”\.\- Judge the case based on the resolved calendar date or date\-time, not on the surface wording alone\.\- Use the most natural interpretation for an ordinary assistant user speaking at ref\_date\.\- If a booking, reservation, scheduling, planning, attendance, reminder\-setting, or time\-specific coordination query naturally resolves to a past date or time relative to ref\_date, the case is invalid\.\- In such cases, prefer rewrite if the case can be repaired by changing the relative date phrase to a natural future\-valid one or by using an explicit absolute date\.\- If the case is otherwise structurally weak or the date phrasing is only one of multiple serious problems, prefer drop\.Examples:\- ref\_date = Friday, query = “Reserve two tickets for the 7:30 PM film program this Wednesday\.” \-\> usually resolves to a past Wednesday \-\> invalid\- ref\_date = Friday, query = “Book brunch this weekend\.” \-\> usually resolves to the upcoming weekend \-\> potentially valid\- ref\_date = Friday evening, query = “Book a table tonight at 6 PM\.” \-\> may already be in the past depending on the implied timing \-\> invalid or rewriteSITUATION TYPE BOUNDARIES1\. temporal\- The main issue concerns timing, scheduling, preparation, travel, sequencing, or coordination\.\- For label = “conflict”, the request clashes with timing\-related facts in context\.\- For label = “non\_conflict”, the context includes timing\-related facts, but the request still fits them\.\- Focus on schedule conflict, compression, timing fit, preparation time, travel feasibility, or coordination burden, not pure impossibility\.\- An alter\-involved temporal case may use a concrete coordination duty, pickup, caregiving responsibility, or fixed shared plan tied to a specific alter\.2\. personal\- The main issue must be grounded in a meaningful personal constraint, boundary, welfare concern, accessibility need, caregiving obligation, or ethically significant commitment tied to ego or a closely related alter\.\- Mere dislike, ordinary preference mismatch, or weak taste mismatch is NOT enough\.\- A valid personal conflict should make the request meaningfully inappropriate, risky, inconsiderate, or misaligned with a concrete personal constraint\.\- Do not treat “would not enjoy it much” or “does not usually prefer it” as a conflict\.\- For label = “conflict”, carrying out the request would conflict with those personal facts\.\- For label = “non\_conflict”, the request remains compatible with those personal facts or appropriately respects them\.\- Do not create a personal case where ego knowingly requests something that directly contradicts ego’s own already\-known condition, medical limitation, strong established aversion, dietary identity, or firm boundary\.\- Bad example: ego is lactose intolerant and normally avoids dairy at home, but the query is “Setup a weekly milk delivery for my morning coffee\.” This is weak because ego who is lactoseintolerant would not ask for such request\.\- Bad example: ego generally avoids red meat year\-round, but the query is “Book me a steakhousechef’s tasting tomorrow\.” This is weak for the same reason\.\- Better personal cases usually involve an alter’s concrete need or boundary that ego plausibly knows, or a situationally relevant personal constraint that becomes important only after context is added\.\- Personal cases must be grounded in concrete persona\-linked facts, not generic etiquette, vague discomfort, or broad social impropriety alone\.\- If an alter is involved, the case must depend on that alter’s specific persona\-grounded condition, boundary, need, or responsibility, not merely on the existence of the relationship\.3\. state\- The main issue is a world, system, infrastructure, location, or operating condition known by ref\_date\.\- For label = “conflict”, these external conditions make carrying out the request conflicting, risky, wasteful, disruptive, or poorly matched to the situation\.\- For label = “non\_conflict”, the request remains appropriate and workable when those external conditions are taken into account\.\- State cases should usually be grounded in conditions already in effect, already announced, already observable, or already scheduled by ref\_date\.\- Good examples include temporary access restrictions, route diversions, infrastructure work, building conditions, neighborhood disruptions, public guidance already issued, or announced operating constraints\.\- Do not use simple closure, stock failure, outage, or outright access denial as the sole reason\.\- Do not use future\-only state facts that would become known only after ref\_date\.\- An alter\-involved state case may use an external condition that becomes relevant because of a specific alter’s concrete need, access requirement, or planned involvement\.TIME SEMANTICS\- ref\_date is the current moment when the user makes the request\.\- \[window\_start, ref\_date\] may contain only facts already observed, learned, confirmed, or in effect by ref\_date\.\- \(ref\_date, window\_end\] may contain only future events or conditions already scheduled, announced, reserved, posted, sent, observed, or otherwise knowable by ref\_date\.\- A case is invalid if it relies on future outcomes, later discoveries, or unannounced future conditions as if they were already known at ref\_date\.\- A case is also invalid if the query’s requested scheduled/reserved target time resolves to before ref\_date\.PERSONAL CASE QUALITY RULES\- Personal cases require especially strong ego plausibility\.\- Do not keep a personal case if the query directly contradicts ego’s own already\-known medical trigger, dietary identity, firm ethical boundary, accessibility need, or strong established aversion\.\- Stronger personal cases often involve:\- an alter’s concrete need or boundary plausibly known to ego,\- or a situationally activated personal constraint that becomes important only after context is added\.\- Be skeptical of personal cases that simply make ego ignore a long\-standing, well\-known self\-constraint\.\- If a personal case mainly works because ego behaves out of character or ignores a stable known fact about themselves, prefer drop or rewrite into a genuinely different personal case\.STATE VS PERSONAL BOUNDARY\- If the main problem comes from an external operating condition, public restriction, infrastructure issue, building condition, route condition, venue rule, or announced system constraint, classify it as state rather than personal\.\- If the main problem comes from a concrete personal boundary, welfare issue, accessibility need, health issue, ethical commitment, or alter\-specific need, classify it as personal\.SET\-LEVEL NON\-REDUNDANCYAcross the full set, reasoning mechanisms must be diverse\.If two or more cases rely on the same underlying reasoning driver, only the strongest one may remain\.The weaker duplicate must be dropped or rewritten\.Redundancy must be checked across the entire set, not just within the same situation\_type\.If a temporal, personal, or state case depends on the same hidden root cause as another case, one of them must be removed or rewritten\.Treat cases as redundant when:\- the same personal limitation, condition, boundary, or commitment does the main judgment work in both\- the same alter\-specific constraint, need, or rule does the main judgment work in both\- the same recurring schedule anchor or fixed duty does the main judgment work in both\- the same public advisory, transit disruption, venue rule, outage, access condition, or building condition does the main judgment work in both\- the same reasoning path would explain both judgments with only superficial substitutions of object, location, or wordingDifferent wording, different objects, or different venues do NOT make two cases distinct if the core judgment arises from the same hidden factor\.If two cases are redundant, keep the stronger one\.Prefer the case that is:\- more persona\-grounded\- more causally clear\- more natural as a user request\- more timeline\-valid and epistemically valid\- less padded\- less generic\- more useful for coverage diversityINVALID CASES INCLUDE:\- the query alone is already obviously unsafe, deceptive, invasive, or self\-contradictory\- the query directly contradicts ego’s own already\-known hard or strongly established self\-constraint\- the case mainly comes from basic impossibility, closure, outage, or pure non\-availability\- the context is padded or missing key support\- the judgment depends on facts not present in context\- future facts are treated as known without a valid basis\- alter/private knowledge is used without a plausible knowledge bridge\- the case would work almost unchanged for a generic unnamed person\- the labeled situation\_type is not the primary reasoning source\- the query uses a relative date/time expression that naturally resolves to a past target for a booking, reservation, scheduling, planning, attendance, or reminder\-setting requestAction policy:\- keep: high\-quality, non\-redundant, and usable with no meaningful fixes needed\- rewrite: the core idea is usable, but the query/context/judgment/type labeling/timeline grounding/knowledge grounding/reasoning mechanism needs meaningful revision\- drop: structurally weak, invalid, too generic, unsupported, redundant without enough added value, implausible for ego, or not worth salvagingScoring guide:\- 9\-10: keep\- 6\-8: rewrite\- 0\-5: dropReturn JSON only in exactly this format: \{json\_format\}Field format for each evaluation:\- case\_id: integer index of the case in the input list\- action: final judgment for this case after considering both case quality and set\-level redundancy\- score: integer from 0 to 10 for overall usefulness in the final set\- main\_issue: one short sentence naming the single biggest problem; for duplicates, explicitly name the repeated reasoning driver\- rewrite\_focus: if action is rewrite, provide one short but actionable instruction describing how to repair the case; if action is keep or drop, use an empty string\- reason: 2\-4 sentences explaining the judgment, including timeline, epistemic, ego\-plausibility, type\-purity, judgment\-clarity, or redundancy issues when relevantWhen action = rewrite:\- rewrite\_focus must say how to improve the query, context, judgment, type labeling, or reasoning mechanism\- prefer actionable repair instructions over abstract criticism\- mention only the most important repair\- if the issue is ego plausibility, say how to make the query believable for this ego\- if the issue is timeline validity, say what kind of already\-known or already\-scheduled fact should be added or corrected\- if the issue is a relative\-date error, explicitly say which relative date phrase should be replaced or resolved differently\- if the issue is due to a logical leap, say what knowledge bridge should be added\- if the issue is type purity, say whether the case should be reframed or relabeled\- if the issue is redundancy, say how to replace the repeated hidden cause with a genuinely different one\- if the issue is context padding, say what kind of unnecessary facts should be removed\- if the case is not worth salvaging, choose drop instead of rewriteYou are revising an ego\-centric conflict\-aware RAG situational reasoning case\.You will receive: persona JSON, timeline, original case, validator resultYour task: Rewrite the case so that it becomes a strong valid situational reasoning case while preserving the core idea whenever possible\.Requirements:1\. Keep the case grounded in the given persona JSON\.2\. Make the query realistically plausible for this ego\.3\. Do not make ego knowingly request something that directly violates ego’s own already\-known condition, medical limitation, strong established aversion, dietary identity, accessibility need, or firm boundary\.4\. Respect the timeline semantics:\- ref\_date is the current moment of the request\.\- \[window\_start, ref\_date\] may contain only facts already observed, learned, confirmed, or in effect by ref\_date\.\- \(ref\_date, window\_end\] may contain only future events or conditions already scheduled, announced, reserved, posted, sent, observed, or otherwise knowable by ref\_date\.5\. Respect the ego\-centered epistemic boundary:\- do not assume omniscient knowledge\- if alter facts matter, make it plausible that ego knows them by ref\_date6\. The query alone must remain normal and feasible\.7\. If label = “conflict”, the conflict must emerge only when the context is added\.8\. If label = “non\_conflict”, the context must still matter, but the request must remain compatible after reasoning over it\.9\. The request must remain technically executable; avoid turning it into pure impossibility\.10\. The context must contain all necessary facts, with no padding\.11\. The judgment must follow only from the context and must not introduce unsupported facts\.12\. Keep the original situation\_type and label unless they are clearly wrong; if they are clearly mislabeled, fix them\.13\. If the validator identified one main repair direction, prioritize that repair\.14\. If the issue is redundancy, you may replace the hidden reasoning driver with a genuinely different one while keeping the case persona\-grounded\.15\. The rewritten judgment should name the decisive conflict or compatibility reason explicitly and clearly enough to serve as a gold reference for downstream evaluation\.CONTEXT REQUIREMENTS\- Include only the facts that are directly necessary to support the judgment\.\- If removing a sentence would not weaken the judgment, do not include that sentence\.\- Do not add extra future plans, background habits, personality color, or adjacent commitments unless they are necessary to compute the judgment\.\- Prefer 2 to 5 tightly relevant facts over a richer but noisier paragraph\.\- The context should identify one primary driver of the judgment; do not mix multiple unrelated drivers in one case\.\- A careful reader should be able to recover the core judgment from the context alone, even if the judgment field were hidden\.RELATIVE DATE REWRITE RULES\- If the original case uses a relative date/time expression, first resolve it against ref\_date before rewriting\.\- Never output a rewritten booking, reservation, scheduling, planning, attendance, reminder\-setting, or time\-specific coordination query whose requested target time resolves to the past relative to ref\_date\.\- If the validator identified a relative\-date error, repair it directly\.\- Prefer the smallest natural fix that preserves the case idea:\- replace an invalid phrase like “this Wednesday” with a future\-valid phrase like “next Wednesday”\- or use an explicit absolute date\- or shift the request to another natural future\-valid time window\- If the context also mentions relative dates, make sure those dates remain coherent with the rewritten query and the timeline\.\- Do not keep ambiguous phrasing if it would naturally read as past relative to ref\_date\.Return JSON only in exactly this format: \{json\_format\}Field format:\- situation\_type: one of temporal, personal, state\- label: one of conflict, non\_conflict\- query: 1\-2 natural sentences, normal assistant request, no hint of hidden reasoning\- context: one concise narrative paragraph containing only the necessary facts\- judgment: 1\-2 sentences explaining why the request conflicts with the context or remains compatible with it, using only facts stated in contextSITUATION TYPE BOUNDARIES1\. temporal\- The main issue concerns timing, scheduling, preparation, travel, sequencing, or coordination\.\- For label = “conflict”, the request clashes with timing\-related facts in context\.\- For label = “non\_conflict”, the context includes timing\-related facts, but the request still fits them\.\- Focus on schedule conflict, compression, timing fit, preparation time, travel feasibility, or coordination burden, not pure impossibility\.\- An alter\-involved temporal case may use a concrete coordination duty, pickup, caregiving responsibility, or fixed shared plan tied to a specific alter\.2\. personal\- The main issue must be grounded in a meaningful personal constraint, boundary, welfare concern, accessibility need, caregiving obligation, or ethically significant commitment tied to ego or a closely related alter\.\- Mere dislike, ordinary preference mismatch, or weak taste mismatch is NOT enough\.\- A valid personal conflict should make the request meaningfully inappropriate, risky, inconsiderate, or misaligned with a concrete personal constraint\.\- Do not treat “would not enjoy it much” or “does not usually prefer it” as a conflict\.\- For label = “conflict”, carrying out the request would conflict with those personal facts\.\- For label = “non\_conflict”, the request remains compatible with those personal facts or appropriately respects them\.\- Do not create a personal case where ego knowingly requests something that directly contradicts ego’s own already\-known condition, medical limitation, strong established aversion, dietary identity, or firm boundary\.\- Bad example: ego is lactose intolerant and normally avoids dairy at home, but the query is “Setup a weekly milk delivery for my morning coffee\.” This is weak because ego who is lactoseintolerant would not ask for such request\.\- Bad example: ego generally avoids red meat year\-round, but the query is “Book me a steakhousechef’s tasting tomorrow\.” This is weak for the same reason\.\- Better personal cases usually involve an alter’s concrete need or boundary that ego plausibly knows, or a situationally relevant personal constraint that becomes important only after context is added\.\- Personal cases must be grounded in concrete persona\-linked facts, not generic etiquette, vague discomfort, or broad social impropriety alone\.\- If an alter is involved, the case must depend on that alter’s specific persona\-grounded condition, boundary, need, or responsibility, not merely on the existence of the relationship\.3\. state\- The main issue is a world, system, infrastructure, location, or operating condition known by ref\_date\.\- For label = “conflict”, these external conditions make carrying out the request conflicting, risky, wasteful, disruptive, or poorly matched to the situation\.\- For label = “non\_conflict”, the request remains appropriate and workable when those external conditions are taken into account\.\- State cases should usually be grounded in conditions already in effect, already announced, already observable, or already scheduled by ref\_date\.\- Good examples include temporary access restrictions, route diversions, infrastructure work, building conditions, neighborhood disruptions, public guidance already issued, or announced operating constraints\.\- Do not use simple closure, stock failure, outage, or outright access denial as the sole reason\.\- Do not use future\-only state facts that would become known only after ref\_date\.\- An alter\-involved state case may use an external condition that becomes relevant because of a specific alter’s concrete need, access requirement, or planned involvement\.You are a data generation assistant for building distractor context snippets for a conflict\-aware retrieval benchmark\.\#\#\# Task SetupEach benchmark scenario contains multiple cases that all belong to one shared ego\-centered world\.Each case contains a situation\_type, a label \(conflict or non\_conflict\), a user request, a gold context, and a gold judgment\.Your job is NOT to explain the case outcome, justify the label, resolve the case, or create an alternative reason for the judgment\. Your job is to generate additional knowledge\-base context snippets that could plausibly exist in the same shared world\.These distractor contexts should:\- look superficially relevant to the target query\- resemble natural persona/world knowledge\- remain fully compatible with the entire scenario\- provide little or no useful evidence for determining the correct label of the target case\- provide little or no useful information for reproducing the gold judgment\- provide little or no useful information for producing the final answer\- and preferably be grounded in a concrete harmless anchor point within the timeline windowA distractor context is therefore:\- a plausible knowledge\-base fragment in the same world\- related in scene or topic\- but not genuinely useful for deciding whether the target query is conflicting or non\-conflicting\- and not materially helpful for explaining why the gold judgment is correctA strong distractor is retrieval\-relevant but decision\-irrelevant\. It may look useful enough to retrieve, but it should not substantially reduce the uncertainty needed to judge the case or answer the query\.\#\#\# Input SemanticYou will be given: TIMELINE, PERSONA\_EXPANSION, SCENARIO\_CASES, TARGET\_CASE\_INDEX, TARGET\_CASE, N\_DISTRACTORS\.Interpret these fields as follows:\- SCENARIO\_CASES: The full set of cases in one shared scenario world\. You must use all of them to maintain global compatibility\.\- TARGET\_CASE: The specific case for which you are generating distractor contexts\.\- QUERY: The user’s requested action for the target case\.\- SITUATION\_TYPE: The case’s situation type, such as temporal, personal, or state\. Use this only to understand the broad scene of the case\. Do NOT force distractors to mirror this type\.\- LABEL: The target case is labeled as either conflict or non\_conflict\.\- GOLD\_CONTEXT: The real situational world state relevant to the target case\.\- GOLD\_JUDGMENT: The explanation of why the target case is conflict or non\_conflict in the gold world\.Interpret the target case according to its label:\- If LABEL = conflict: distractors must not restate, imply, strengthen, or make it easier to infer the blocking rationale described by the gold judgment\.\- If LABEL = non\_conflict: distractors must not restate, imply, strengthen, or make it easier to infer the compatibility rationale described by the gold judgment\. They may be related background details, but they should not materially help confirm that the request is feasible, convenient, available, accessible, or conflict\-free\.\#\#\# TimelineYou are given window\_start, ref\_date, window\_end\.Timeline semantics:\- ref\_date is the current moment when the user makes the request\.\- \[window\_start, ref\_date\] contains facts already observed, learned, confirmed, posted, announced, or in effect by ref\_date\.\- \(ref\_date, window\_end\] may contain future events or conditions only if they are already scheduled, reserved, announced, posted, planned, or otherwise knowable by ref\_date\.A fact or context is valid only if it could already exist in Ego’s knowledge base at ref\_date\.Do not invent future facts that would become knowable only after ref\_date\.\#\#\# Egocentric world modelYou are working inside a single coherent egocentric persona world\.\- Ego is the central person whose life grounds the scenario and whose knowledge base is being built\.\- Alter is a closely related person in Ego’s world, such as a family member, close friend, coworker, neighbor, collaborator, or regular contact\.\- Every output context must be something that Ego could plausibly know and store by ref\_date\.\- If a context involves an alter, include only information that Ego could reasonably know by ref\_date\.\- Do not include hidden or private alter information that Ego would not realistically know\.\#\#\# Global compatibility requirementEach distractor context must be compatible not only with the target case, but with the entire scenario\.It must not contradict any query, context, judgment, label, or implied world state from any case in the scenario\.It must not create a new conflict for any query in the scenario\.It must not create a new decisive enabling condition that makes any query obviously answerable either\.Distractor contexts generated for one case must also remain compatible with distractor contexts generated for other cases\.Treat the full scenario as one shared ego\-centered world and generate distractors as additional harmless KB fragments for that world\.\#\#\# Core goal\- The distractor should look superficially relevant to the target query\.\- It may share broader scene family, activity family, social sphere, neighborhood, venue type, route family, time\-of\-day frame, companion type, or lifestyle context\.\- But it must be evidentially weak with respect to the target case outcome\.\- It must not materially help a model determine whether the correct label is conflict or non\_conflict\.\- It must not materially help a model reproduce the gold judgment\.\- It must not materially help a model produce the final answer\.\- Prefer query\-adjacent background context over generic persona biography\.\- Distractors may be topically adjacent to the gold evidence, but they must not be decision\-useful\.\#\#\# Temporal anchoring preferenceDistractors should not default to timeless generic preferences, gear lists, or broad habits\. Whenever possible, ground each distractor in one concrete harmless anchor point inside the timeline window\.Preferred anchor types include:\- a past observation, note, save, reminder, confirmation, or routine instance in \[window\_start, ref\_date\]\- a same\-day but non\-decisive detail on ref\_date\- a future plan, reservation, meetup, ticket, reminder, or venue note in \(ref\_date, window\_end\] that is already scheduled, announced, reserved, saved, or otherwise knowable by ref\_dateA distractor may be timeless only if a more situationally anchored version would be unnatural\.Whenever possible, make the distractor feel like a concrete world\-state note rather than generic biography\.Across multiple distractors, vary the temporal anchoring style\. Do not make all distractors timeless\.When natural, aim for a mix such as:\- at least one past\-known anchored distractor\- at least one ref\_date\-adjacent anchored distractor\- at least one future\-known anchored distractor\#\#\# Important constraints\- Avoid reusing the specific entities, dates, times, locations, commitments, restrictions, logistical predicates, access conditions, operational facts, or availability details that materially support the gold judgment\.\- Distractor contexts do NOT need to be on the same day as the target query\.\- They may refer to any fact or plan within the timeline window, as long as it could plausibly be known by ref\_date and remains non\-decisive for all scenario queries\.\- They may include time\-dependent or date\-anchored information, provided it is already knowable by ref\_date and does not create, strengthen, or imply any conflict for any scenario query\.\- They also must not provide the missing key fact that would make a non\_conflict answer obviously easier\.Each DISTRACTOR must satisfy ALL of the following:1\) Persona\-grounded KB style\- Write each distractor as if it were an ordinary knowledge fragment that could have come from the persona expansion or related world\-state notes\.\- Use details naturally supported by the PERSONA\_EXPANSION\.\- The distractor should feel like background knowledge, not like an explanation or judgment\.2\) Scenario\-wide compatibility\- The distractor must be fully compatible with the persona expansion, timeline, and all cases in the scenario\.\- Do not contradict, negate, or weaken anything in the existing world\.\- Do not create friction with another case even if it does not affect the target case\.3\) No judgment leakage\- Do NOT restate, paraphrase, imply, strengthen, or weaken the key evidence that determines the correct label or supports the gold judgment\.\- Do NOT include context from which a reasonable assistant could much more easily infer the gold judgment\.\- For conflict cases:\- do not restate, paraphrase, imply, or strengthen the blocking rationale\- do not include blocking facts that reproduce the same rejection path\- For non\_conflict cases:\- do not restate, paraphrase, imply, or strengthen the compatibility rationale\- do not provide decisive enabling evidence that directly confirms the request is feasible, available,accessible, well\-timed, or easy to execute\- do not include the missing key fact that would make the correct answer obviously easier\- Do NOT mention or imply:\- overlap with another commitment\- inability to arrive on time\- unavailability of requested roles or slots\- closures, disruptions, diversions, advisories, or restrictions that directly affect execution\- hard medical, ethical, or physical constraints that directly block a request\- exact feasibility facts whose presence would directly settle a non\_conflict case\- any other fact that makes any scenario query newly impossible, newly trivial to approve, newly trivial to reject, inappropriate, unsafe, or clearly obvious4\) No new outcome shift\- The distractor by itself must not create a separate reason to reject or modify any scenario query\.\- It must not add a decisive reason to confidently approve, recommend, or complete a non\_conflict query either\.\- If a model saw a scenario query and this distractor alone, the final judgment should remain underdetermined or only weakly affected\.5\) Retrieval\-candidate quality\- Distractors should resemble plausible KB evidence items, not broad persona biography\.\- Strong distractors are often tied to a specific harmless anchor in the timeline window\.\- Generate only distractor contexts at this stage\. Do NOT output atomic facts\.6\) Additional guidance for non\_conflict casesWhen the target case is non\_conflict, good distractors are related but non\-decisive background details\.Do NOT generate distractors that directly answer the practical question, such as:\- the exact venue hours needed to confirm availability\- the exact route, timetable, or travel duration needed to confirm feasibility\- the exact reservation policy, access rule, or price detail needed to complete the request\- the exact companion preference or approval that would directly validate the plan\- the exact calendar fact that shows the relevant evening is open\- the exact operational status that would make the answer obvious7\) Diversity\- Distractors should vary in informational focus\.\- Avoid near\-duplicates and shallow paraphrases\.\- When generating multiple distractors, vary topic focus and temporal anchoring style when natural\.8\) Style\- Each distractor should be a short self\-contained paragraph\.\- Use neutral, factual English\.\- Do not include analysis, advice, warnings, or meta\-commentary\.\- Do not mention that the distractor is non\-blocking, weakly evidential, or related to evaluation\.\#\#\# Generation procedureFor each distractor:1\. Select one harmless anchor point within the timeline window\.2\. Make the distractor topically adjacent to the target query\.3\. Check the target case label:\- if conflict, ensure the distractor does not help recover the blocking rationale \- if non\_conflict, ensure the distractor does not help recover the compatibility rationale4\. Ensure the distractor stays fully compatible with the entire scenario and introduces no outcome\-changing evidence\.5\. Write a short neutral paragraph describing only the facts\.\#\#\# Strong vs weak distractor guidanceWeak distractor: “Regina likes museums and casual dinners\.”Why weak:\- too generic\- not anchored in the timeline window\- reads like broad biography rather than retrievable KB contextWeak in a different way: “The Wednesday dinner was moved to Thursday, leaving next Wednesday evening free\.”Why weak:\- directly reveals the compatibility rationale\- makes the non\_conflict judgment too easyStronger distractor: “On January 29, Regina saved a note about a small Downtown cafe that stays open later than most neighborhood coffee spots and bookmarked it as a possible post\-museum stop for another evening\.”Why stronger:\- grounded in a knowable time point inside the timeline window\- query\-adjacent\- harmless and non\-decisiveReturn ONLY valid JSON in this exact schema: \{json\_schema\}\#\#\# Field Rule\- context:\- one concrete narrative paragraph\- describe only the neutral facts\- keep it specific, grounded, and persona\-linked\- do not explain the conclusion here\- all facts in context must be temporally valid under the timeline semantics\- if the context mentions a future condition, it must already be scheduled, announced, reserved, orotherwise knowable by ref\_date\- whenever natural, ground the paragraph in a specific harmless anchor within the timeline windowrather than only timeless background preferences\- the paragraph may look relevant, but it should remain non\-decisive for both label inference andanswer production\#\#\# RoleYou are an Ego\-Centric Knowledge Base Atomizer for conflict\-aware RAG systems\. Your task is to convert one source context into 2 to 5 atomic facts that could plausibly be stored in the ego\-centric knowledge base by ref\_date\.These facts will later be used by a reasoning model\.Therefore, your output must contain only neutral stored facts, not conclusions, explanations, or logical bridges\.\#\#\# Multi\-hop reasoning objectiveThe output facts are intended for later evaluation of conflict\-aware reasoning\.Each fact should function as an independent neutral evidence unit\.A single fact does not need to reveal the situational relationship by itself\.The relevance of the source context should become identifiable only when multiple facts are integrated with the user query or with other available information\.In other words:\- individual facts should remain plain stored knowledge\- the scenario\-level significance should emerge only through later composition and reasoning across factsYour job is to preserve the evidence needed for that later reasoning step, not to perform the reasoning step now\.\#\#\# Egocentric world modelYou are working inside a single coherent egocentric persona world\.\- Ego is the central person whose life grounds the scenario and whose knowledge base is being built\.\- Alter is a closely related person in Ego’s world, such as a family member, close friend, coworker, neighbor, collaborator, or regular contact\.\- Every output fact must be something that Ego could plausibly know and store by ref\_date\.\- If a fact involves an alter, include only information that Ego could reasonably know by ref\_date\.\- Do not include hidden or private alter information that Ego would not realistically know\.\#\#\# TimelineYou are given: window\_start, ref\_date, window\_endTimeline semantics:\- ref\_date is the current moment when the user makes the request\.\- \[window\_start, ref\_date\] contains facts already observed, learned, confirmed, posted, announced, or in effect by ref\_date\.\- \(ref\_date, window\_end\] may contain future events or conditions only if they are already scheduled, reserved, announced, posted, planned, or otherwise knowable by ref\_date\.A fact is valid only if it could already exist in Ego’s knowledge base at ref\_date\.Do not invent future facts that would become knowable only after ref\_date\.\#\#\# Source usageUse the provided source context field as the primary evidence source\.Any auxiliary metadata is provided only to help interpret the context correctly\.Do not output any statement that explains why the request is conflicting, risky, ill\-timed, wasteful, inappropriate, harmless, compatible, or suitable\.\#\#\# GoalExtract a minimal set of distinct atomic facts from the source context\.The facts should act as KB evidence units that a later reasoning model can combine\.\#\#\# What an atomic fact is \(CRITICAL\)An atomic fact is a single neutral world statement that could be stored independently in the ego\-centric knowledge base\.Each fact must:\- contain exactly one claim\- be standalone and understandable by itself\- use explicit names and entities\- be neutral and descriptive\- avoid implications, conclusions, and consequences\- remain useful as a stored KB item even without the scenario explanationAtomicity granularity rule:\- Interpret “atomic” as one indivisible stored knowledge unit, not as the shortest possible text fragment\.\- Keep together details that belong to the same real\-world assertion when separating them would produce unnatural, weak, or incomplete KB items\.\- A fact may include tightly bound attributes of a single event, notice, condition, policy, preference, or item, as long as it still expresses one claim\.\- Split facts only when the source contains genuinely distinct claims that could be stored or retrieved independently\.\- Do not decompose one coherent source statement into multiple trivial fragments if a single self\-contained fact would better represent the stored knowledge\.Redundancy control rule:\- Do not output two facts when one is merely a weaker paraphrase, habitual restatement, or near\-duplicate of the other\.\- If a stable preference, aversion, policy, or routine can be expressed clearly in one self\-contained fact, prefer one fact over multiple overlapping restatements\.Time consistency rule:\- Facts about scheduled events, temporary conditions, posted notices, and date\-specific restrictions should include the full relevant calendar date and, when available, the operative time window in the same fact\.\- If multiple time details belong to one scheduled event or notice, include them in the same fact rather than splitting them across separate facts\.\#\#\# Independence and clarityEach fact must be independently interpretable\.Entity clarity rule:\- Every fact must clearly name the main entity or entities involved\.\- Do not omit the subject\.\- Do not rely on neighboring facts to identify a person, place, venue, organization, route, event, document, item, or alter\.\- Do not use pronouns or demonstratives such as: it, he, she, they, this, that, these, or those\.\- Do not use underspecified definite references such as the show, the restaurant, the meeting, the venue, the building, the route, the appointment, or similar forms unless the entity is explicitly identified in the same fact\.\- If a specific entity is intended, name it concretely enough for the fact to be understood on its own\.Reference resolution rule:\- Do not use unresolved temporal, spatial, or situational references\.\- Forbidden forms include expressions such as: at that hour, at that time, then, by then, around then, at that point, from there, nearby, locally, in the area, on site, and similar shorthand\.\- Even if the source context uses such wording, rewrite it into an explicit, self\-contained reference\.\- Replace shorthand with the concrete date, time, time window, place, route, venue, or condition it refers to\.\- If the reference cannot be resolved cleanly, rewrite the fact to remove the ambiguity rather than copying the original phrasing\.\- Do not use comparative or relational time expressions such as earlier, later, before, or after unless the comparison point or reference event is explicitly named in the same fact\.Time anchoring rule:\- Add an explicit date or datetime only when the fact is time\-dependent and needs a time anchor for correct interpretation\.\- Time\-dependent facts include scheduled events, temporary conditions, posted notices, confirmations, reservations, closures, diversions, reminders, saved notes, logged route instances, and other facts whose truth depends on a specific date or time\.\- Do not add an explicit date to stable facts that remain clear without one\. \(e\.g\., By ref\_date, ego is a scientist who studies microorganisms\. \-\> This fact is true and storable regardless of the date, so it does not need a date anchor\.\)\- Stable facts include standing routines, long\-running traits, durable preferences, persistent conditions, venue properties, and generic travel characteristics\.\- If a fact is specifically about a condition or event on ref\_date itself, explicitly write that calendar date\.\- Do not use relative expressions such as: today, tomorrow, tonight, this morning, or this evening\.\- Do not add a time anchor to a stable fact unless the date is necessary for correct interpretation\.Final self\-containment rule:\- Read each fact as if it were retrieved alone from the knowledge base\.\- If any entity, time reference, place reference, route reference, or condition would be unclear when read alone, rewrite the fact until it is fully self\-contained\.\#\#\# Lexical variation policyDo not mechanically copy the wording or expressions of the source context\.Avoid generating nearly identical sentences with merely small wording changes\.Lexical variation and rephrasing are allowed and often preferred\.You may:\- use a near\-synonym when the referent remains fully clear\- restate a detail more compactly if no information is lostYou must not:\- replace a clear referent with a vague one\- drop the entity, place, or time anchor needed for independent interpretation\- change the meaning, scope, or strength of the factIn other words, surface wording may vary, while referential clarity may not vary\. When in doubt, prefer a slightly more explicit fact over a shorter but context\-dependent fact\.\#\#\# Atomization ruleExtract a minimal set of distinct KB facts from the source context\.\- Each fact must contain exactly one claim\.\- Treat one coherent event, notice, policy, condition, preference, or schedule as one fact unless the source clearly contains separable claims\.\- Do not split one coherent claim into multiple fragments merely to make the output more granular\.\- Do not merge claims that could reasonably be stored or retrieved independently\.\- If a source sentence contains a primary fact plus a consequence, keep only the primary fact\.\- If two candidate facts are near\-duplicates or one subsumes the other, keep only the more informative self\-contained fact\.\- Prefer the fewest facts that preserve all necessary evidence clearly and concretely\.\- Do not make any single fact so complete that it already states the scenario\-level conclusion on its own\.\#\#\# Critical bansDo NOT include:\- any restatement of the query\- any requested time, location, participant, or plan from the query unless that information independently appears as a storable world fact in the source context\- any scenario conclusion\- any explanation of why the fact matters\- any logical bridge connecting multiple facts\- any derived statement that already performs the reasoning step\- any evaluation of feasibility, appropriateness, risk, lateness, inconvenience, harm, compatibility, or suitability\- any statement that the request is possible, impossible, compatible, conflicting, safe, fine, harmless, or problematicExamples of forbidden outputs:\- The person would need to change an existing plan to carry out the request\.\- The person would probably miss the requested start time\.\- The requested booking would not fit the known schedule\.\- The selected option would not suit the person’s physical condition\.\- The request conflicts with the known situation\.\- The facts together make the request unsuitable\.\- The request remains feasible\.\- The context does not create any real problem\.Those are reasoning outputs, not KB facts\.\#\#\# Gold\-source specific ruleThe source context is a gold case context\.Each gold case includes:\- a situation\_type\- a label, which is either conflict or non\_conflict\- a query\- a context\- a judgmentUse the context field as the primary evidence source\.Use the judgment field only to understand how the context relates to the query\.If label = conflict:\- the judgment explains why the request conflicts with the known situationIf label = non\_conflict:\- the judgment explains why the request remains compatible with the known situationIn both cases:\- Do not copy, paraphrase, compress, or lightly rewrite the judgment field into facts\.\- Do not output any statement that explains why the request is conflicting, compatible, risky, safe, ill\-timed, harmless, or suitable\.\- Output only neutral stored facts from the context\.Completeness requirement for gold:\- The full set of emitted facts should preserve enough neutral evidence that, when combined with the query, a later reasoning model can fully reconstruct the judgment\.\- Do not omit a context fact that is necessary for distinguishing why the query is conflict or non\_conflict in this case\.\- Preserve all minimally necessary evidence, but keep each individual fact neutral and non\-conclusive\.\#\#\# Distractor\-source specific ruleThe source context is a distractor context\.These facts are not direct gold evidence\.They are related, non\-blocking KB facts that may look useful for planning or retrieval\.Preserve such harmless situational anchors when they are part of the distractor context\.Additional distractor constraints:\- Do not transform harmless distractor context into blocking evidence, new obligations, new restrictions, or new execution problems\.\- Do not infer any conflict or non\-conflict conclusion from the parent case\.\- Use only the distractor context itself as evidence for the output facts\.Task: Atomize the source context into neutral Knowledge Base facts\.This task is to produce atomic facts for the egocentric knowledge base of \{ego\_name\}\.Timeline: \{timeline\_json\}Source package: \{source\_json\}Instructions:\- Extract only the smallest distinct evidence units from the source context\.\- Facts must be storable in the ego\-centric KB by ref\_date\.\- Use the source context as the primary evidence source\.\- Facts must be standalone, neutral, and non\-inferential\.\- Facts must not perform the reasoning step\. Facts must not mention why the scenario is good, bad, conflicting, harmless, compatible, or suitable\.\- Avoid generating nearly identical sentences with merely small wording changes\.\- A later reasoning model should be able to combine the facts with the query to reconstruct the case\-level relationship\.\- Do not collapse that multi\-step reasoning into any single fact\.\- Do not include any query restatement\. \(e\.g\., The person requests to book a restaurant\. \-\> Do not include this as a fact unless the source context explicitly states it as a known fact\.\)\- Each fact must contain exactly one claim\.\- Every fact must explicitly name its main subject or entity\.\- Every time\-dependent fact must include an explicit date, datetime, or time window when that anchor is necessary for correct standalone interpretation\.\- If multiple time details belong to one scheduled event or notice, include the full relevant time window in the same fact rather than splitting the timing across separate facts\.\- Do not omit a time anchor for temporary or date\-specific facts\.\- Do not force a date onto a stable fact that remains clear without one\.\- Do not add a date to a stable fact unless the date is needed for correct interpretation\.\- Each fact must remain understandable on its own when separated from the other facts\.\- Lexical variation from the source context is allowed and preferred, but the meaning and referents must remain precise and unambiguous\.\- Return JSON only\.\- No extra keys\.\{extra\_user\_instructions\}Gold\-specific instructions:\- Use the context as the primary evidence source\.\- Use the judgment field only for interpretation, not for wording\.\- Do not copy or paraphrase the judgment sentence into facts\.\- Treat conflict and non\_conflict cases in the same way at the atomization level: extract neutral KB facts only\.Distractor\-specific instructions:\- Use only the distractor context as evidence for the output facts\.\- Facts must not restate the query or the gold judgment\.\- Facts must not introduce any new blocking constraint or incompatibility\.\#\#\# Instruction:You are a traversal guidance agent for conflict\-aware personal assistant retrieval\.You will receive a user request\. Your task is to identify retrieval directions that are likely to uncover useful evidence for downstream conflict reasoning\.\* Focus on context directions that may help later retrieval discover: constraints, commitments, routines, preferences, availability, compatibility, dependencies, supporting feasibility evidence, contextual information that may become important when combined with other documentsUseful directions do NOT need to directly imply a conflict\. Indirect or partial contextual evidence may still be important later\.Be selective\. Only include directions that are plausibly useful for retrieving decision\-relevant evidence for this specific request\. Avoid generic directions that are not grounded in the request\.\* Context directions may involve:\- schedules, timing, recurring routines, or prior commitments\- people involved, relationships, coordination, or availability\- locations, transportation, access, or travel\- preferences, sensitivities, habits, or behavioral tendencies\- physical state, health, mobility, or energy constraints\- resources, reservations, permissions, or required preparation\- contextual information that helps interpret ambiguous or underspecified parts of the request\* Respond with a JSON object: \{json\_schema\}\* Rules:\- Select only 1 to 3 directions\. If only one clearly applies, return just one\.\- Each direction must be grounded in something specific from the request\.\- Do not include speculative directions with no plausible retrieval value\.\- Include directions that may support feasibility as well as directions that may reveal constraints\.\- key\_anchors must contain exact terms from the request, not generic paraphrases\.\- Return valid JSON only\. No explanation\. No markdown fences\.\#\#\# Request: \{query\}\#\#\# Reference date: \{ref\_date\}Identify decision\-relevant context directions that would help graph traversal select useful documents for judging this request later\.Return JSON only\.\#\#\# Response:\#\#\# Instruction:You generate retrieval\-oriented counter queries for conflict\-aware retrieval\.Return JSON with exactly one field: “counter”\.The reference date is \{ref\_date\}\.When the query contains relative temporal expressions such as today, tomorrow, tonight, this Wednesday, next Friday, or this weekend, interpret them with respect to the reference date when generating counter views\. Do not add extra explanation about the temporal resolution\.Conflict analysis \(use this to guide counter query generation\): \{conflict\_planner\_result\}\#\#\# Definitions:\* counterA list of retrieval queries aimed at finding information that could block, constrain, or conflict with the request\. These should not be simple paraphrases of the original query\.They should help retrieve evidence about conflict\-bearing factors such as schedule, availability, timing, commitments, access constraints, coordination constraints, and so on\.If a conflict analysis is provided above, use it to generate counter queries that specifically target those conflict dimensions and anchors\. Each counter query should be distinct and targeted\.Avoid near\-duplicate counter queries\.\* Rules:\- Output valid JSON only\- Do not include explanations\- “counter”: list of \{num\_counter\} strings\#\#\# Request: \{query\}\#\#\# Instruction:You are an evidence selection agent for conflict\-aware personal assistant retrieval\.You will receive:1\. A user request2\. A list of candidate documents collected through retrieval and graph expansionYour task is NOT to make the final decision about the request\.Your task is to select the documents that are MOST LIKELY to help a downstream assistant determine whether the request can or cannot be carried out\.\* A document may be useful even if:\- it does not explicitly mention a conflict\- it only provides partial information\- it contains habits, routines, preferences, schedules, relationships, locations, or behavioral context\- its relevance may only become clear after combining it with other documentsFocus on retaining documents that may later become important evidence\.\* Respond with a JSON object: \{json\_schema\}\* Selection priorities:1\. Documents containing constraints, commitments, obligations, availability, schedules, routines, or resource limitations relevant to the request\.2\. Documents containing personal preferences, behavioral tendencies, habits, sensitivities, or compatibility information relevant to the request\.3\. Documents that clarify people, places, timing, recurring activities, dependencies, or social relationships mentioned or implied in the request\.4\. Documents that may serve as bridge evidence connecting the request to other potentially relevant facts\.\* Rules:\- Select exactly \{top\_n\} doc\_ids if at least \{top\_n\} candidate documents are provided\.\- Order selected\_doc\_ids from most useful to least useful\.\- Prefer documents with concrete, person\-specific, time\-specific, place\-specific, or state\-specific information\.\- Prefer potentially decision\-relevant evidence over topical similarity\.\- Do NOT require a document to explicitly prove feasibility or conflict in order to keep it\.\- Avoid documents that are purely topical and provide no useful contextual evidence\.\- Only use doc\_ids from the provided list\.\- Return valid JSON only\. No explanation\. No markdown fences\.\#\#\# Request: \{query\}\#\#\# Candidate documents \(\{n\_docs\} total\): \{docs\_text\}Select the top \{top\_n\} doc\_ids that are most useful as evidence for deciding whether the request can be carried out\.Respond with JSON only\.\#\#\# Response:\#\#\# Instruction:You are the personal assistant for \{persona\_name\}\.Today is \{ref\_date\}\.The information below consists of facts you already know about \{persona\_name\} and the world they live in\. Answer the query as their assistant, using those facts when relevant\.Act as an agent who can take actions in that world, coordinate with people and systems there, and speak directly to \{persona\_name\}\. Use what you know to decide whether this request should be carried out\.Write a response of 2 to 4 sentences that clearly states whether the request can or cannot be carried out, and explains why based on the known facts\.Rules:\- Clearly state whether the request can or cannot be carried out\.\- Explain why, based only on the provided facts and the query\.\- Speak directly as the assistant to \{persona\_name\}\.\- Do not mention “context”, “provided information”, or “dataset”\.\- Do not refuse with the reason of “no permission”, assume you are able to take any action as an assistant for \{persona\_name\}\.\- Do not use bullet points, JSON, or any labels\.\- Keep the response to 2 to 4 sentences\.\#\#\# Context: \{context\_text\}\#\#\# Query: \{query\}\#\#\# Response:\#\#\# Instruction:You are evaluating a model response for a conflict\-aware personal assistant task\.The model response is a free\-text answer\. It should clearly state whether the user’s request can be carried out, and explain why\.You must evaluate two things in order:Step 1\. Decision correctness\- Gold Label indicates the correct decision\.\- If Gold Label is “non\_conflict”, the correct response should proceed, agree, allow, or say the request can be carried out\.\- If Gold Label is “conflict”, the correct response should refuse, warn, block, or say the request should not be carried out as requested\.\- If the model response gives the wrong decision, output FAIL\.\- If the model response is ambiguous about whether it will proceed or refuse, output FAIL\.Step 2\. Rationale correctnessOnly evaluate the rationale if the decision is correct\.Compare the model response with the Gold Rationale\.The response does not need exact wording, but it must capture the same core reason\.Use the following labels:PASS:The model response conveys the correct decision, and the rationale captures the same core reason as the Gold Rationale\.Minor wording differences are acceptable\.Extra helpful details are acceptable if they do not change or distort the core reason\.WRONG\_RATIONALE:The model response conveys the correct decision, but the rationale is not fully correct\.This includes cases where the rationale:\- misses key evidence from the Gold Rationale\- is too vague to fully support the decision\- mentions only a secondary reason while missing the main reason\- includes irrelevant or weak justifications\- adds unsupported details that make the reasoning less faithful, while the final decision is still correctFAIL:The model response conveys the wrong decision\.Also output FAIL if the response is ambiguous about the decision\.Also output FAIL if the decision is correct but the rationale gives the opposite, unsupported, or substantially wrong reason\.Important:\- Decision correctness has priority\.\- If the decision is wrong, output FAIL even if some rationale sounds plausible\.\- Do not require exact wording\.\- Do not penalize conversational phrasing or helpful suggestions\.\- Only output one label: PASS, WRONG\_RATIONALE, or FAIL\.\- Do not include any explanation\.\#\#\# Gold Label: \{gold\_label\}\#\#\# Gold Rationale: \{gold\_judgment\}\#\#\# Model Response: \{answer\_text\}\#\#\# Label:

Similar Articles

PACE: A Neuro-Symbolic Framework for Plausible and Actionable Counterfactual Explanations

arXiv cs.AI

This paper introduces PACE, a modular neuro-symbolic framework that combines a neural predictive model with symbolic reasoning to generate counterfactual explanations that respect domain-specific feasibility constraints. A case study on the Adult Income dataset demonstrates that incorporating symbolic rules yields more plausible and actionable explanations.

PACE: A Proxy for Agentic Capability Evaluation

Hugging Face Daily Papers

This paper introduces PACE, a framework that predicts expensive LLM agent benchmark scores using a small subset of cheaper non-agentic evaluation instances, achieving high accuracy at less than 1% of the cost.

PACE: Anytime-Valid Acceptance Tests for Self-Evolving Agents

arXiv cs.AI

PACE introduces an anytime-valid commit gate for self-evolving agents that replaces greedy acceptance with a sequential hypothesis test, controlling false-commit probability and reducing churn while matching performance with lower variance.