PatientAct: Theory-Grounded Mental Health Client Simulation
Summary
PatientAct is a theory-grounded framework for LLM-based simulated mental health clients, integrating clinical case formulation and dynamic memory with trust thresholds to produce more realistic resistance and behavior.
View Cached Full Text
Cached at: 08/14/26, 09:27 AM
# PatientAct: Theory-Grounded Mental Health Client Simulation
Source: [https://arxiv.org/html/2608.12750](https://arxiv.org/html/2608.12750)
Sahand SabourAffiliation:The CoAI Group, DCST, Institute for Artificial Intelligence, Tsinghua University, Beijing, ChinaTszYam NGAffiliation:The CoAI Group, DCST, Institute for Artificial Intelligence, Tsinghua University, Beijing, ChinaGuanqun BiAffiliation:The CoAI Group, DCST, Institute for Artificial Intelligence, Tsinghua University, Beijing, ChinaJialu ZhaoAffiliation:Counseling and Psychological Development Guidance Center, Tsinghua University, Beijing, Chinasahandfer@gmail\.com,aihuang@tsinghua\.edu\.cnMinlie HuangAffiliation:The CoAI Group, DCST, Institute for Artificial Intelligence, Tsinghua University, Beijing, China
###### Abstract
LLM\-based simulated clients are increasingly used to train novice counselors, evaluate LLM therapists, and generate synthetic data\. However, current simulators produce overly cooperative clients that disclose too readily, accept therapeutic reframes without resistance, and resolve core issues within a single session\. We trace these issues to profiles that lack causal depth and behavioral mechanisms that treat all content as equally accessible\. We presentPatientAct, a framework for client simulation grounded in established clinical theories\. Our profiles integrate the 5Ps clinical case formulation, providing causal depth without tying the design to any single therapeutic modality\. During simulation, profiles include a dynamic memory layer in which items carry trust thresholds \(e\.g\., symptoms are available early, whereas formative memories require a sustained therapeutic alliance\)\. At each turn, the client’s emotional reaction and behavior are modeled before generating a response\. If the therapist approaches gated content,PatientActexpresses resistance in terms of quantity, content, and style rather than defaulting to cooperation or a single resistance pattern\. We evaluate our framework on 40 clinical situations and demonstrate that it generates diverse profiles with high clinical plausibility\. Moreover,PatientActsignificantly outperforms the baselines, yielding substantial gains in resistance quality and behavioral realism\. Our code and data will be publicly available via[github\.com/Sahandfer/PatientHub](https://github.com/Sahandfer/PatientHub)\.
## 1Introduction
Mental health conditions affect over one billion people worldwide, yet most receive no adequate care\([31](https://arxiv.org/html/2608.12750#bib.bib3)\)\. Bridging this gap requires progress on multiple fronts: training more clinicians, developing AI\-assisted therapeutic tools, and building research infrastructure for computational mental health\. Simulated clients powered by large language models \(LLMs\) have emerged as a foundational component across all three: they provide scalable practice environments for training novice counselors[30](https://arxiv.org/html/2608.12750#bib.bib15);[13](https://arxiv.org/html/2608.12750#bib.bib23), serve as standardized test cases for evaluating LLM therapists[25](https://arxiv.org/html/2608.12750#bib.bib24), and enable the generation of diverse synthetic therapy data for psychology research[14](https://arxiv.org/html/2608.12750#bib.bib4);[12](https://arxiv.org/html/2608.12750#bib.bib31)\. At the core of these applications lies a common requirement: the simulated client must behave realistically enough for the interaction to capture the dynamics of real therapy\.
In real therapy sessions, clients do not simply answer questions or disclose information\. They react emotionally to what the therapist says \(e\.g\., with relief, shame, or defensiveness\) and behave in ways shaped by a lifetime of learned patterns: deflecting when a topic feels threatening, going quiet when overwhelmed, or cautiously opening up when they feel understood\. In addition, they selectively share information, revealing surface complaints early while guarding painful memories until trust is established\. And when they resist, they do so in varied ways, each reflecting a different underlying pattern; for instance, going silent, changing the subject, or pushing back directly\. These dynamics distinguish a genuine therapeutic interaction from a cooperative question\-answering exchange\.
Current LLM\-based simulators fall short of capturing these dynamics\. A persistent finding across prior work is that simulated clients are overly cooperative: they disclose too readily, accept therapeutic reframes without resistance, and resolve core issues within a single session[32](https://arxiv.org/html/2608.12750#bib.bib21);[9](https://arxiv.org/html/2608.12750#bib.bib6)\. This pattern undermines downstream applications: therapist trainees do not encounter realistic resistance, LLM\-therapist evaluations are inflated by compliant clients, and synthetic data lacks the friction that characterizes real therapeutic dialogue\. We attribute this problem to multiple shortcomings in the design of existing simulators\.
First, the profile design in prior work lacks causal depth\. Existing profiles describewhatthe client thinks and feels by including attributes such as symptoms, beliefs, and coping strategies[30](https://arxiv.org/html/2608.12750#bib.bib15);[28](https://arxiv.org/html/2608.12750#bib.bib17);[11](https://arxiv.org/html/2608.12750#bib.bib19)\. However, they do not explainwhythe client has formed such thoughts and feelings: what made this person vulnerable, what triggered the current episode, or what cycles sustain it\. Hence, the resulting simulator can state “I feel worthless” but cannot explain how this belief was formed or what in their daily life reinforces it\. Second, prior work either provides the full profile in the system prompt[30](https://arxiv.org/html/2608.12750#bib.bib15);[11](https://arxiv.org/html/2608.12750#bib.bib19), thereby making all information immediately accessible, or applies a single control \(e\.g\., a static label such asResistance: High\) uniformly across all content[9](https://arxiv.org/html/2608.12750#bib.bib6)\. However, in practice, a client may freely describe sleep problems while actively avoiding childhood memories, and this boundary shifts as trust develops within the conversation\([26](https://arxiv.org/html/2608.12750#bib.bib26)\)\.
To address these shortcomings, we presentPatientAct, a theory\-grounded framework for client simulation\. The profiles in our framework are structured around the 5Ps clinical case formulation\([8](https://arxiv.org/html/2608.12750#bib.bib29)\), which traces how a client’s vulnerabilities developed, what triggered the current episode, and what maintains the problem\. We complement this formulation with a cognitive layer\([3](https://arxiv.org/html/2608.12750#bib.bib27)\)that provides in\-session thoughts and behaviors, and interpersonal relational patterns\([18](https://arxiv.org/html/2608.12750#bib.bib30)\)that shape how the client relates to others, particularly the therapist\. Unlike prior work, which mainly focuses on a single therapeutic modality, such as cognitive behavioral therapy \(CBT\) or motivational interviewing \(MI\), our schema is not tied to any single therapeutic modality \(i\.e\., modality\-agnostic\)\. Prior to the simulation, we divide the profile into a static layer, which is always included in the system prompt, and a dynamic memory layer\. Each item in the memory is assigned a disclosure threshold, grounded in prior research on therapeutic trust\([26](https://arxiv.org/html/2608.12750#bib.bib26)\): surface symptoms are available early, whereas formative memories require a sustained therapeutic alliance\. During the simulation, at each turn,PatientActdetermines how it should emotionally react to the therapist’s utterance, and selects a behavior consistent with that reaction and the client’s current trust level before generating a response\. When the therapist inquires about content that the client is not yet ready to share,PatientActdisplays resistance based on[22](https://arxiv.org/html/2608.12750#bib.bib5)’s taxonomy spanning response quantity \(e\.g\., going silent\), content \(e\.g\., changing the subject\), and style \(e\.g\., direct pushback\)\. As a result, the same profile can produce meaningfully different sessions depending on the therapist’s behavior\. Our contributions are as follows:
1. 1\.Amodality\-agnostic profile schemathat integrates clinical case formulation, providing the causal depth missing from prior work\.
2. 2\.Atheory\-grounded simulation frameworkthat processes each therapist’s utterance through reaction, behaviors, and a dynamic retrieval pipeline\. Disclosure of the profile’s content is gated by the client’s evolving level of trust, and resistance spans multiple clinical dimensions rather than a single label\.
3. 3\.Comprehensive evaluationdemonstrating that our framework produces more realistic client simulations than existing baselines across expert and LLM\-based assessments\.
Figure 1:Overview of Our Framework \(PatientAct\)\.
## 2Related Work
LLM\-based patient simulation has emerged as a flexible alternative to scripted standardized patients, leveraging modern LLMs’ role\-playing and instruction\-following capabilities\. Existing approaches differ primarily along two axes:whatis encoded about the client \(profile design\) andhowthe desired behavior is enforced during conversation \(simulation design\)\.
### 2\.1Profile Design
A central challenge in patient simulation is determining the information required to model clients and how to structure it\. Early approaches relied on scenario descriptions and simple persona descriptions covering demographics and presenting complaints without a systematic structure\([5](https://arxiv.org/html/2608.12750#bib.bib7);[28](https://arxiv.org/html/2608.12750#bib.bib17);[17](https://arxiv.org/html/2608.12750#bib.bib18)\), causing the LLM to improvise information \(e\.g\., beliefs\) during conversations\. A shift toward theory\-grounded design began with Patient\-ψ\\psi\([30](https://arxiv.org/html/2608.12750#bib.bib15)\), which structured profiles around the Cognitive Conceptualization Diagram\([3](https://arxiv.org/html/2608.12750#bib.bib27), CCD;\), capturing the client’s cognitive layer by encoding core beliefs, intermediate beliefs, and coping strategies\. However, the CCD does not explain how those beliefs were formed or what sustains them\. Subsequent work broadened the scope by including psychiatric history, longitudinal symptom data, and life events\([11](https://arxiv.org/html/2608.12750#bib.bib19);[15](https://arxiv.org/html/2608.12750#bib.bib20);[29](https://arxiv.org/html/2608.12750#bib.bib22);[12](https://arxiv.org/html/2608.12750#bib.bib31)\), adding biographical detail but not the causal links between those events and the presenting problem\. Therefore, existing profiles encodewhatthe client thinks and feels but do not provide sufficient reasons forwhythe client feels this way\. For instance, there is no account of what made this person vulnerable, what triggered the current episode, or what perpetuates the problem\. Without this structure, a simulated client cannot coherently explain their history, exhibit maintenance behaviors that a therapist would recognize and work with, or produce realistic resistance: all profile content carries equal weight, with no basis for distinguishing what the client would share readily from what they would guard\.
### 2\.2Simulation Design
The second challenge is how to enforce the desired client behavior during conversations\. The simplest approach places the full profile in the system prompt and generates responses directly\([5](https://arxiv.org/html/2608.12750#bib.bib7);[28](https://arxiv.org/html/2608.12750#bib.bib17)\)\. This produces fluent but overly cooperative clients who readily disclose, accept reframes, and resolve issues within a single session, which is a problem widely documented in the literature\([30](https://arxiv.org/html/2608.12750#bib.bib15);[32](https://arxiv.org/html/2608.12750#bib.bib21);[9](https://arxiv.org/html/2608.12750#bib.bib6)\)\. Patient\-ψ\\psi\([30](https://arxiv.org/html/2608.12750#bib.bib15)\)addressed this by appending conversational styles \(e\.g\., resistant\) as behavioral modifiers\. While effective at producing surface\-level variation, these styles are static: a “resistant” client resists regardless of whether the therapist is empathic or dismissive\. Recent work has proposed dynamic mechanisms in which the client’s openness[9](https://arxiv.org/html/2608.12750#bib.bib6), emotional states[29](https://arxiv.org/html/2608.12750#bib.bib22), and MI\-specific stages of change[32](https://arxiv.org/html/2608.12750#bib.bib21)are adjusted during the conversation\. These approaches demonstrate that dynamic state management improves realism, but each applies a single control uniformly across all profile content: a single openness scalar, a global emotion state, or a modality\-specific action distribution\. In practice, a client may freely describe sleep problems while actively avoiding childhood memories, with the boundary shifting as trust develops[26](https://arxiv.org/html/2608.12750#bib.bib26)\. Treating all content as equally accessible misses this reality\. Moreover, resistance in prior work is either absent or reduced to a single dimension \(e\.g\., high or low resistance\), whereas clinical resistance manifests through variations in response quantity, content, or style[22](https://arxiv.org/html/2608.12750#bib.bib5)\.
## 3PatientAct
Our framework \(Figure[1](https://arxiv.org/html/2608.12750#S1.F1)\) consists of two main pipelines: profile generation \(§[3\.2](https://arxiv.org/html/2608.12750#S3.SS2)\) and client simulation \(§[3\.3](https://arxiv.org/html/2608.12750#S3.SS3)\)\. First, a clinical situation is expanded into our designed structured profile schema through a multi\-step pipeline\. Accordingly, the simulated client processes each therapist’s utterance through a pipeline comprising reaction, behavior selection, and retrieval before generating a response\.
### 3\.1Profile Schema
A central design requirement for our framework is that every field in the client profile must serve a functional role during simulation\. Therefore, we organized each profile into three components: demographics, a problem formulation, and a psychological formulation\. Together, these components provide the causal depth, cognitive structure, and interpersonal dynamics needed to sustain a realistic multi\-turn therapy conversation\.
##### 1\. Demographics\.
Each profile includes demographics \(name, gender, age, occupation, marital status, ethnicity\) that ground the client’s identity and ensure profiles reflect specific individuals\.
##### 2\. Problem Formulation\.
We adopt the 5Ps clinical case formulation framework\([8](https://arxiv.org/html/2608.12750#bib.bib29)\)to structure the clinical context of each profile: \(i\)Presenting Problem: the client’s current issue; \(ii\)Precipitating Factors: specific past event\(s\) or change\(s\) that triggered the current episode and brought the client to therapy; \(iii\)Predisposing Factors: psychological \(e\.g\., a childhood rejection that shaped relational guardedness\) and social \(e\.g\., family norms discouraging emotional expression\) factors that explain why this individual became vulnerable; \(iv\)Perpetuating Factors: the maintenance cycles that sustain the current issue \(e\.g\., avoidance→\\rightarrowshort\-term relief→\\rightarrowincreased isolation→\\rightarrowworsened mood\); and \(v\)Protective Factors: the internal \(e\.g\., motivation for change\) and external \(e\.g\., social support\) strengths and resources that assist with the problem and prevent further deterioration\. Unlike the Cognitive Conceptualization Diagram \(CCD;[3](https://arxiv.org/html/2608.12750#bib.bib27)\) or the stages\-of\-change model[23](https://arxiv.org/html/2608.12750#bib.bib32)used by previous work, the 5Ps framework ismodality\-agnostic, meaning it can be used across different therapeutic modalities, such as both Cognitive Behavioral Therapy \(CBT\) and Motivational Interviewing \(MI\); In addition, this framework enables the profile to capturecausal structurethat prior work overlooks\.
##### 3\. Psychological Formulation\.
In addition to the 5Ps, we need to capture the client’s psychological state \(i\.e\., thoughts, feelings, and behavior\), as it directly governs in\-session behavior during conversations\. Inspired by[30](https://arxiv.org/html/2608.12750#bib.bib15), we fill this gap by encoding the following cognitive patterns: \(i\)Intermediate Beliefs: conditional assumptions about the current situation that govern the client’s behavior \(e\.g\., “If I need too much from people, they’ll pull away”\); \(ii\)Automatic Thoughts: situation\-specific thoughts that the client experiences in response to the current issue \(e\.g\., “I’m falling behind again, and I can’t even do basic things right”\); \(iii\)Triggers: recurring situations or in\-session experiences that activate distress \(e\.g\., “feeling that my worries are not taken seriously”\); \(iv\)Coping Patterns: observable behavioral responses to distress \(e\.g\., canceling plans, staying in bed, keeping conversations surface\-level\); and \(v\)Emotional Range: the emotions the client can readily access or have difficulty expressing \(e\.g\., readily expresses sadness and anxiety, while having difficulty expressing anger\)\. In addition, we model \(vi\)Interpersonal Patternsthat describe the client’s relational dynamics with others using the Core Conflictual Relationship Themes\([18](https://arxiv.org/html/2608.12750#bib.bib30), CCRT;\)\. Based on this framework, each pattern consists of four components:domain: the relationship the pattern applies to \(e\.g\., the therapist, a romantic partner, or a close friend\);wish\(W\): what the client wants from the other person \(e\.g\., to be heard without being judged\);response from other\(RO\): the reaction the client expects or has previously experienced, typically negative \(e\.g\., “they’ll see me as difficult and lose patience”\); andresponse of self\(RS\): how the client reacts emotionally and behaviorally as a result \(e\.g\., avoids emotional disclosure\)\.
### 3\.2Profile Generation
Each client profile inPatientActis generated through a multi\-step pipeline\. Our pipeline takes as input aclinical situation, a brief natural\-language description of the client’s presenting concern; ademographic scaffoldincluding gender, age group, cultural background, and occupation type; and apsychological seedspecifying a core belief theme \(unlovable,worthless, orhelpless;[3](https://arxiv.org/html/2608.12750#bib.bib27)\) and an attachment style \(anxious,avoidant, ordisorganized;[2](https://arxiv.org/html/2608.12750#bib.bib9)\)\. All attributes are sampled from prior distributions derived from epidemiological prevalence data \(Appendix[A](https://arxiv.org/html/2608.12750#A1)\)\. Following[10](https://arxiv.org/html/2608.12750#bib.bib2), our pipeline can also receive adisease outline: a structured reference document for a target disorder \(e\.g\., depression\) summarizing its key characteristics, typical symptoms, and population\-specific statistics\.
Given the situation, demographic scaffold, and disease outline \(if available\), an LLM first generates the problem formulation based on explicit instructions that enforce causal chains\. Next, a rule\-based conflict checker flags any incompatibilities between the sampled scaffold and the generated formulation \(e\.g\., a child paired with alcohol use\)\. The LLM iteratively revises the demographics until no conflicts remain\. Lastly, given the problem formulation and revised demographics, the LLM generates the psychological formulation\. The complete profile is validated by an LLM judge for internal coherence and against the original situation as the ground truth\. The judge is tasked with flagging inconsistencies and providing targeted revisions, which are fed back into the generation pipeline, repeating this process until the profile passes validation\. If a disease outline is provided, the judge also checks for contrasting indicators and clinical red flags\. Details are provided in Appendix[B](https://arxiv.org/html/2608.12750#A2)\.
### 3\.3Client Simulation
In real therapy sessions, clients’ responses are shaped by what they feel and are willing to share, and how much trust they have in the therapist\. During simulation, we model this process explicitly through a multi\-step pipeline: before generating a response,PatientActdetermines the client’s emotional reaction to the therapist’s utterance, selects an appropriate behavior, and retrieves relevant content gated by the client’s evolving trust level\.
#### 3\.3\.1Profile Decomposition
Our pipeline operates over two layers of information derived from the profile\. First, a static layer that is always available in the system prompt and contains information that a client would naturally present: demographics, current concern, emotional range, and the therapist\-directed interpersonal pattern\. This information establishes the client’s identity, voice, and default relational posture toward the therapist\. In addition,PatientActincludes a dynamic layer whose content surfaces only when it is relevant to the conversation and the client’s trust level permits disclosure\.
To form the dynamic layer, we prompted GPT\-5\.4 to convert the remaining profile content into individual items with three attributes: adisclosure levelindicating the minimum trust level required to share this content;activation tagsdetermining when the item becomes relevant to the conversation; and, adiscomfort flag, indicating whether approaching this topic without sufficient trust would produce visible discomfort\. Disclosure levels are assigned based on each item’s vulnerability and observability: surface\-level symptoms \(e\.g\., difficulty getting out of bed\) are assigned low thresholds, whereas formative memories \(e\.g\., a childhood rejection\) require higher levels of trust\. This design is grounded inMental\-Trust[26](https://arxiv.org/html/2608.12750#bib.bib26), an annotation study of 212 real counseling sessions that identified observable stages of therapeutic trust and proposed a taxonomy of seven expert\-verified ordinal trust levels\. We map these seven levels onto a numeric scale from 1\.0 \(least trust\) to 4\.0 \(achieved trust\) in steps of 0\.5, so that disclosure thresholds and trust updates operate on a common scale \(Appendix[C\.4](https://arxiv.org/html/2608.12750#A3.SS4)\)\.
#### 3\.3\.2Trust\-Gated Retrieval
In real therapy sessions, a client’s willingness to share depends not only on what the therapist asks but on how much trust has been established\. To model this, we gate access to the dynamic memory layer using the client’s current trust level\. At each turn, the therapist’s utterance is matched against activation tags to identify which memory items are relevant to the current conversation\. Relevant items are disclosed only if the client’s trust meets the item’s threshold; otherwise, items with a discomfort flag are placed on ablockedlist indicating that the therapist is approaching sensitive territory\. This produces two distinct effects: retrieved items provide the client with specific content to draw on in their response, while blocked items generate pressure to deflect or resist without revealing why\.
#### 3\.3\.3Reaction and Behavior Modeling
[6](https://arxiv.org/html/2608.12750#bib.bib16)proposed that clients internally process each therapist intervention through two stages: an emotional reaction \(i\.e\., what they feel\) and a behavioral response \(i\.e\., what they do\)\.
Inspired by this, we model both stages explicitly before generating each client utterance\. First, given the retrieved items and conversation history,PatientActdetermines the client’s emotional reaction, selecting from a set of seven reactions adapted from Hill’s taxonomy \(e\.g\.,understood,challenged, orscared; see Appendix[C\.1](https://arxiv.org/html/2608.12750#A3.SS1)\)\. In addition, each reaction is assigned an intensity level \(low, moderate, or high\), which directly influences behavior selection\. For instance, a client who feelsslightly challengedwould likely continue to engage, while higher intensity may lead to resistance\. Next, given this reaction along with the client’s trust level, coping patterns, and recent behavior,PatientActselects from a set of eight behaviors adapted from Hill’s categorization of client actions \(e\.g\.,recounting,cognitive exploration,resistance; see Appendix[C\.2](https://arxiv.org/html/2608.12750#A3.SS2)\) to determine how the client would act\. This decomposition ensures that each response is grounded in a traceable internal state rather than generated directly from the profile\.
Lastly, following[22](https://arxiv.org/html/2608.12750#bib.bib5)’s taxonomy of client resistance patterns, we define seven resistance patterns across three dimensions: quantity \(e\.g\.,minimal talk\), content \(e\.g\.,topic switching\), and style \(e\.g\.,defensiveness; see Appendix[C\.3](https://arxiv.org/html/2608.12750#A3.SS3)\)\. Therefore, ifresistanceis selected as the client’s behavior, rather than relying on simple instructions aimed at minimizing engagement, as in prior work,PatientActdetermines its specific form based on the client’s coping patterns and emotional state\. For instance, an avoidant client at low trust is more likely to give minimal responses, while a client who feels misunderstood may become defensive\.
#### 3\.3\.4Trust Dynamics
The outputs of the preceding steps are compiled into a signal that specifies what the client is feeling, what content is available to draw on, and how they should behave\. Accordingly, at each turn, this signal is appended to the therapist’s message and a response is generated\. Following this exchange,PatientActevaluates how the therapist’s behavior affected the client’s trust, conditioned on the client’s profile\.[26](https://arxiv.org/html/2608.12750#bib.bib26)observed that in real counseling, positive trust transitions are frequent but small, while negative transitions are rarer but larger\. We adopt this asymmetry: trust moves in steps of±0\.25\\pm 0\.25\(slight\) or±0\.5\\pm 0\.5\(significant\), bounded between 1\.0 and 4\.0, starting at 2\.5 as the middle ground\. Attachment style shapes these dynamics: anxious clients lose trust readily in response to perceived rejection; avoidant clients build trust slowly and penalize pushiness; disorganized clients may lose trust even after positive exchanges\. The updated trust level carries forward, directly determining which memory items will pass the disclosure gate in the next turn\.
## 4Experiments
### 4\.1Profile Evaluation
With the help of an expert with a background in clinical psychology, we hand\-crafted 20 clinical situations covering common situations for depression and anxiety, respectively \(40 in total\)\. This choice was motivated by the fact that these are the most prevalent mental disorders worldwide, and existing work mainly focuses on these disorders, enabling direct comparison for simulation\. We then used GPT\-5\.4 as the backbone LLM in our pipeline to generate profiles for each situation\.
##### Procedure\.
We recruited 10 annotators with a background in psychology to evaluate the generated profiles\. Each profile was evaluated by three annotators \(12 profiles per annotator\) on the following aspects using 5\-point Likert scales: \(i\)Clinical Plausibility: the degree to which the profile could be attributed to a real client; \(ii\)Internal Consistency: the degree to which there is a logical connection between the various dimensions of the profile; \(iii\)Case Specificity: the degree to which the details of the life history and conceptualization were specific and individualized; and \(iv\)Clinical Depth: whether there was enough information to support multiple rounds of therapeutic conversations\. Moreover, we asked the annotators to predict thecore belief themeandattachment styleto assess whether the generated profile encompassed these scaffolds\. Each annotator also provided adiversityrating \(1–5\) to assess whether the generated profiles seemed like distinct individuals rather than variations of the same template\. Full evaluation guidelines are provided in Appendix[D\.1](https://arxiv.org/html/2608.12750#A4.SS1)\.
##### Results\.
As shown in Table[1](https://arxiv.org/html/2608.12750#S4.T1), all dimensions received high average ratings, indicating that annotators generally found the profiles clinically plausible, internally consistent, specific, and sufficiently detailed for multi\-turn therapeutic conversations\. Notably,Clinical Plausibilityreceived the highest rating \(4\.434\.43\), suggesting that the 5Ps\-based formulations lead to profiles that are perceived as realistic clinical cases\. Inter\-annotator agreement was moderate across all dimensions \(α=0\.41\\alpha=0\.41–0\.450\.45\), which is consistent with the inherent subjectivity of clinical judgment tasks\. For the identification tasks, annotators correctly predicted the intended attachment styles and core belief themes with 77\.5% and 64\.2% accuracy, respectively\. Core belief themes are sampled uniformly, giving a 33\.3% chance level; attachment styles follow the clinical prior of Appendix[A](https://arxiv.org/html/2608.12750#A1), under which always predictingdisorganizedwould yield 54%\. Both results are well above these baselines\. Accordingly, substantial inter\-annotator agreement on both tasks \(κ=0\.61\\kappa=0\.61andκ=0\.65\\kappa=0\.65\) indicates that profiles express these constructs clearly\. Lastly, on average, annotators rated diversity at4\.2±0\.424\.2\\pm 0\.42\(out of 5\), demonstrating that most profiles represented distinct individuals and circumstances\.
##### Error Analysis\.
Upon further analysis, the primary source of confusion in identifying attachment style wasdisorganizedprofiles being misidentified asavoidant\(15 out of 27\), likely due to the withdrawal component of disorganized attachment resembling avoidant patterns\. For core belief themes, most errors involved thehelplesstheme being confused with the remaining two themes, possibly due to the shared expressions of helplessness with worthlessness in inadequacy and with being unlovable in dependence on others\.
Table 1:Evaluation Results for Profile Generation\. Likert dimensions \(1–5 scale\) report average ratings±\\pmstd, and classification tasks report accuracy\. Krippendorff’sα\\alphaindicates inter\-annotator agreement in ratings, with Fleiss’κ\\kappafor classifications;α\>0\.4\\alpha\>0\.4andκ\>0\.6\\kappa\>0\.6show moderate and substantial agreement, respectively\.
### 4\.2Simulation Evaluation
##### Baselines\.
We selected three representative baselines to cover different existing approaches to client simulation: \(i\)Patient\-ψ\\psi[30](https://arxiv.org/html/2608.12750#bib.bib15), which structures profiles around the Cognitive Conceptualization Diagram, representing the static prompt\-based approaches with theory\-grounded profiles; \(ii\)AnnaAgent[29](https://arxiv.org/html/2608.12750#bib.bib22), which uses simple background and symptom descriptions with a dynamic emotion modulator, representing methods with minimal profile design and dynamic behavioral control; and \(iii\)ConsistentMI[32](https://arxiv.org/html/2608.12750#bib.bib21), which encodes motivation, beliefs, and receptivity with state tracking and action selection, representing the modality\-specific approaches with dynamic behavioral control\.
Table 2:Evaluation Results for Client Simulation \(1–5 scale\)\. The best results for each column are highlighted inbold\.∗indicates significantly higher rating than the second\-best method \(p<0\.05p<0\.05, Mann\-Whitney U\)\.Table 3:Inter\-annotator agreement for conversation evaluation\. Human agreement: Krippendorff’sα\\alpha\(\>0\.4\>0\.4= moderate\)\. Human–LLM judge correlation: Spearman’sρ\\rho, following G\-Eval\([16](https://arxiv.org/html/2608.12750#bib.bib8)\)\.Table 4:Evaluation Results for the Ablation Study \(1–5 scale\)\. The best results for each column are highlighted inbold\.∗indicates significantly higher rating than the second\-best method \(p<0\.05p<0\.05, Mann\-Whitney U\)\.
##### Implementation Details\.
We conducted our experiments using PatientHub[24](https://arxiv.org/html/2608.12750#bib.bib1), which provides a unified framework for developing and benchmarking patient simulation methods\. Following prior work, we used GPT\-4o[7](https://arxiv.org/html/2608.12750#bib.bib25)as the backbone LLM across all methods to ensure a fair comparison, with temperature set to0\.70\.7to balance response diversity and coherence\. All simulated clients engaged with the same therapist agent, designed to be modality\-agnostic and explicitly prohibited from teaching techniques or pushing for resolution \(Figure[8](https://arxiv.org/html/2608.12750#A3.F8)\), for 15 turns, resulting in4×40=1604\\times 40=160conversations in total\.
##### Procedure\.
Conversations were evaluated on the following dimensions using 5\-point Likert scales: \(i\)Coherence: whether the client maintained a consistent persona throughout the conversation; \(ii\)Disclosure Pacing: whether the client shared information at a natural pace; \(iii\)Resistance Quality: whether the client’s pushback felt authentic; \(iv\)Emotional Authenticity: whether client’s emotional reactions were genuine and proportionate; and \(v\)Behavioral Realism: whether the client resembled a real person in therapy\. For human evaluation, we randomly sampled 10 conversations per disorder for each system \(4×20=804\\times 20=80conversations\)\. Each conversation was rated by three of the ten recruited annotators \(24 conversations per annotator\), who were blind to the method identity\. For automatic evaluation, we used GPT\-5\.4 as an LLM judge to evaluate all 160 conversations using the same guidelines as human evaluators\. Full evaluation guidelines are provided in Appendix[D\.2](https://arxiv.org/html/2608.12750#A4.SS2)\.
##### Results\.
As shown in Table[2](https://arxiv.org/html/2608.12750#S4.T2),PatientActachieves the highest human ratings and significantly outperforms the baselines across all five dimensions\. The largest gains over the best baseline appear in Resistance Quality \(\+0\.67\+0\.67\) and Behavioral Realism \(\+0\.63\+0\.63\), followed by Disclosure Pacing \(\+0\.50\+0\.50\), which are dimensions most directly tied to the shortcomings identified in prior work: absent or one\-dimensional resistance, over\-cooperative behavior, and uniform disclosure\. Smaller gains in Coherence \(\+0\.39\+0\.39\) and Emotional Authenticity \(\+0\.32\+0\.32\) suggest that existing methods perform reasonably well at maintaining a consistent character and producing appropriate emotions, and that the primary gap lies in how clients manage information sharing and pushback\. Notably, Patient\-ψ\\psiranks second across most dimensions despite using only a static profile, outperforming AnnaAgent and ConsistentMI, which employ dynamic mechanisms\. These results suggest that profile quality strongly drives simulation realism and that dynamic mechanisms alone cannot compensate for a shallow profile\. To demonstrate how these quantitative differences manifest in conversations, we present a case study in Appendix[E](https://arxiv.org/html/2608.12750#A5)\.
Interestingly, the LLM judge produces a different ranking across dimensions\. On Emotional Authenticity and Realism, which have the highest human inter\-annotator agreement \(Table[3](https://arxiv.org/html/2608.12750#S4.T3)\),PatientActoutperforms the baselines in LLM evaluations\. However, it ranks Patient\-ψ\\psihighest on Coherence and Disclosure Pacing\. One possible explanation is that the GPT\-5\.4 judge, which shares the same model family as the simulation backbone \(i\.e\., GPT\-4o\), may favor outputs closer to the model’s default generation style\. In addition, ConsistentMI significantly outperforms the baselines in resistance quality, possibly due to its explicit receptivity states and MI\-specific action selection, which produce more structured resistance that is easier for an LLM to identify\. Notably, the dimensions in whichPatientActwas outperformed by baselines are also those with the lowest human agreement \(α=0\.41\\alpha=0\.41–0\.430\.43\) and the weakest Human\-LLM correlation \(ρ=0\.09\\rho=0\.09–0\.290\.29\)\. Together, these findings provide further evidence that automated evaluation alone is insufficient to assess the quality of therapy simulations and that human judgment remains essential for dimensions involving clinical appropriateness\.
##### Ablation Study\.
We tested three ablations to isolate the effects of individual components: \(i\) without trust\-gating \(w/o TG\), in which all memory items are always accessible; \(ii\) without dynamic memory \(w/o DM\), in which the full profile is placed in the system prompt with no retrieval; and \(iii\) without the reaction\-behavior\-resistance pipeline \(w/o Pipe\), in which a response is generated directly from the retrieved items\.
As shown in Table[4](https://arxiv.org/html/2608.12750#S4.T4), removing any of the three components reduces human ratings across all dimensions\. Notably, this drop is largest for w/o DM on four of the five dimensions, particularly in Resistance Quality \(1\.041\.04in human and0\.580\.58in LLM ratings, compared to0\.940\.94and0\.300\.30for w/o TG\), suggesting that placing the full profile in context encourages disclosure regardless of other instructions, whereas retrieval\-based content selection provides a stronger constraint on over\-cooperation\. In contrast, trust\-gating contributes most to Disclosure Pacing \(0\.930\.93vs\.0\.750\.75\), which is expected given that it directly ties disclosure to the state of the therapeutic relationship\. Interestingly, w/o Pipe is the only variant that the LLM judge rates above the full framework across all dimensions, whereas human annotators rate it lower on all five\. This mirrors the divergence observed in Table[2](https://arxiv.org/html/2608.12750#S4.T2)and further indicates that automatic evaluation alone would have favored an ablated system over the full framework\.
## 5Conclusion
We presentedPatientAct, a theory\-grounded framework for client simulation that addresses the lack of causal depth in existing profiles and behavioral mechanisms that treat all content as equally accessible\. Evaluation by expert annotators demonstrates that our profiles achieve high clinical plausibility and thatPatientActproduces significantly more realistic simulations than three representative baselines\. Our results suggest that profile depth and quality yield larger improvements in simulation realism than dynamic behavioral mechanisms alone\. We also find that LLM\-based judges are insufficient for evaluating therapy simulations on dimensions involving clinical judgment\. We hope thatPatientActcan facilitate more effective tools for therapist training, more rigorous benchmarks for LLM therapists, and richer synthetic data for mental health research\.
## Limitations
In this work, we focused our evaluation only on depression and anxiety, as these are the most prevalent conditions worldwide and the focus of existing baselines\. As other conditions \(e\.g\., PTSD\) may involve qualitatively different therapeutic dynamics, we cannot assume that our framework generalizes to these disorders without further evaluation\. However, asPatientActis disorder\-agnostic by design, extending it to conditions where trust and resistance manifest differently is a natural next step\.
Our experiments were limited to single 15\-turn sessions, whereas real therapy unfolds over multiple sessions\. This design choice followed existing work, which is predominantly single\-session, partly because current simulators exhaust their content within 10–15 turns\. Extending our framework to multi\-session simulation, where trust carries over and the client’s presentation evolves between sessions, is an important direction, and our trust mechanism is well positioned to support it\.
This study was conducted only in English, and all simulation methods relied on GPT\-4o\. Given that mental health presentation varies across cultures and languages, our results may not generalize to other settings\. Additionally, since profiles are generated by an LLM, they may reflect biases present in the model’s training data, including under\-representation of non\-Western presentations of mental disorders\. While we controlled for demographic diversity through scaffold sampling, this does not yet address deeper cultural differences in how distress is experienced and expressed\.
Lastly, our evaluation measures simulation realism through expert ratings\. However, we do not evaluate whether more realistic simulations translate to improved outcomes in downstream applications such as therapist training or LLM therapist evaluation\. Establishing this connection is an important direction that our data and framework are designed to facilitate\.
## Ethics Statement
PatientActsimulates therapy clients for research purposes, mainly to support counselor training, evaluate LLM\-based therapeutic systems, and generate synthetic data\. It is not intended as a diagnostic tool or a substitute for real clinical interactions, and any downstream therapeutic application should involve qualified clinical oversight\.
We did not use any real patient data at any stage of this work\. All clinical situations were handcrafted under expert supervision, and all profiles and conversations were generated by LLMs\. However, we note that realistic mental health simulations carry inherent risks: they could be used to build systems that provide unsupervised therapeutic interventions, or they could reinforce stereotypical presentations of mental illness if the generated profiles reflect biases in the model’s training data\. We partially mitigated these issues through expert\-supervised situation design and demographic scaffold sampling, but acknowledge that these measures may not fully eliminate such risks\.
Our annotators reviewed simulated transcripts involving descriptions of depression and anxiety\. All annotators had backgrounds in psychology, were informed of the content before participation, provided consent for their annotations to be released for research purposes, and were compensated with 200 RMB \(approximately 28\.5 USD\), which exceeds the local minimum wage\. We received no reports of distress related to the task\.
## References
- Bakermans\-Kranenburg and van IJzendoorn \(2009\)M\. J\. Bakermans\-Kranenburg and M\. H\. van IJzendoornThe first 10,000 adult attachment interviews: distributions of adult attachment representations in clinical and non\-clinical groups\.Attachment & human development11\(3\),pp\. 223–263\.Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1)\.
- Bartholomew and Horowitz \(1991\)K\. Bartholomew and L\. M\. HorowitzAttachment styles among young adults: a test of a four\-category model\.\.Journal of personality and social psychology61\(2\),pp\. 226\.Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1),[§3\.2](https://arxiv.org/html/2608.12750#S3.SS2.p1.1)\.
- Beck \(2020\)J\. S\. BeckCognitive behavior therapy: basics and beyond\.Guilford Publications\.Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1),[§1](https://arxiv.org/html/2608.12750#S1.p5.1),[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1),[§3\.1](https://arxiv.org/html/2608.12750#S3.SS1.SSS0.Px2.p1.1),[§3\.2](https://arxiv.org/html/2608.12750#S3.SS2.p1.1)\.
- Bureau of Labor Statistics \(2024\)Bureau of Labor StatisticsEmployment by major occupational group\.External Links:[Link](https://www.bls.gov/emp/tables/emp-by-major-occupational-group.htm)Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1)\.
- Chenet al\.\(2023\)S\. Chen, M\. Wu, K\. Q\. Zhu, K\. Lan, Z\. Zhang, and L\. CuiLLM\-empowered chatbots for psychiatrist and patient simulation: application and evaluation\.External Links:2305\.13614,[Link](https://arxiv.org/abs/2305.13614)Cited by:[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1)\.
- Hill \(1992\)C\. E\. HillAn overview of four measures developed to test the hill process model: therapist intentions, therapist response modes, client reactions, and client behaviors\.Journal of Counseling & Development70\(6\),pp\. 728–739\.Cited by:[§3\.3\.3](https://arxiv.org/html/2608.12750#S3.SS3.SSS3.p1.1)\.
- Hurstet al\.\(2024\)A\. Hurst, A\. Lerer, A\. P\. Goucher, A\. Perelman, A\. Ramesh, A\. Clark, A\. Ostrow, A\. Welihinda, A\. Hayes, A\. Radford,et al\.Gpt\-4o system card\.arXiv preprint arXiv:2410\.21276\.Cited by:[§4\.2](https://arxiv.org/html/2608.12750#S4.SS2.SSS0.Px2.p1.1)\.
- Johnstone and Dallos \(2013\)L\. Johnstone and R\. DallosFormulation in psychology and psychotherapy: making sense of people’s problems\.2 edition,Routledge,London\.Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p5.1),[§3\.1](https://arxiv.org/html/2608.12750#S3.SS1.SSS0.Px2.p1.1)\.
- Kimet al\.\(2025\)M\. Kim, D\. Yoo, Y\. Hwang, M\. Kang, N\. Kim, M\. Gwak, B\. Kwak, H\. Chae, H\. Kim, Y\. Lee, M\. H\. Kim, D\. Jung, K\. Chung, and J\. YeoCan you share your story? modeling clients’ metacognition and openness for LLM therapist evaluation\.InFindings of the Association for Computational Linguistics: ACL 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Vienna, Austria,pp\. 25943–25962\.External Links:[Link](https://aclanthology.org/2025.findings-acl.1332/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-acl.1332),ISBN 979\-8\-89176\-256\-5Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p3.1),[§1](https://arxiv.org/html/2608.12750#S1.p4.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1)\.
- Laiet al\.\(2026\)Y\. Lai, Z\. Wang, W\. Ma, and Y\. LiuPatient\-zero: scaling synthetic patient agents to real\-world distributions without real patient data\.External Links:2509\.11078,[Link](https://arxiv.org/abs/2509.11078)Cited by:[§3\.2](https://arxiv.org/html/2608.12750#S3.SS2.p1.1)\.
- Leeet al\.\(2025\)J\. Lee, K\. Lim, Y\. Jung, and B\. KimPSYCHE: a multi\-faceted patient simulation framework for evaluation of psychiatric assessment conversational agents\.External Links:2501\.01594,[Link](https://arxiv.org/abs/2501.01594)Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p4.1),[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1)\.
- Liet al\.\(2026\)B\. Li, B\. Jin, K\. Lan, M\. Wang, and M\. WuSynthetic or authentic? building mental patient simulators from longitudinal evidence\.arXiv preprint arXiv:2603\.22704\.Cited by:[Appendix B](https://arxiv.org/html/2608.12750#A2.p1.1),[§1](https://arxiv.org/html/2608.12750#S1.p1.1),[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1)\.
- Linet al\.\(2026\)I\. W\. Lin, S\. Sabour, H\. Sng, M\. Chan, M\. Huang, A\. White, and T\. AlthoffCandorMD: an ai\-assisted audio simulation and feedback system for training clinicians for medical error disclosure\.External Links:2605\.20701,[Link](https://arxiv.org/abs/2605.20701)Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p1.1)\.
- Liuet al\.\(2025a\)J\. M\. Liu, M\. Gao, S\. Sabour, Z\. Chen, M\. Huang, and T\. M\. LeeEnhanced large language models for effective screening of depression and anxiety\.Communications Medicine5\(1\),pp\. 457\.Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p1.1)\.
- Liuet al\.\(2025b\)S\. Liu, B\. Brie, W\. Li, L\. Biester, A\. Lee, J\. Pennebaker, and R\. MihalceaEeyore: realistic depression simulation via expert\-in\-the\-loop supervised and preference optimization\.InFindings of the Association for Computational Linguistics: ACL 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Vienna, Austria,pp\. 13750–13770\.External Links:[Link](https://aclanthology.org/2025.findings-acl.707/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-acl.707),ISBN 979\-8\-89176\-256\-5Cited by:[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1)\.
- Liuet al\.\(2023\)Y\. Liu, D\. Iter, Y\. Xu, S\. Wang, R\. Xu, and C\. ZhuG\-eval: nlg evaluation using gpt\-4 with better human alignment\.External Links:2303\.16634,[Link](https://arxiv.org/abs/2303.16634)Cited by:[Table 3](https://arxiv.org/html/2608.12750#S4.T3)\.
- Louieet al\.\(2024\)R\. Louie, A\. Nandi, W\. Fang, C\. Chang, E\. Brunskill, and D\. YangRoleplay\-doh: enabling domain\-experts to create LLM\-simulated patients via eliciting and adhering to principles\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing,Y\. Al\-Onaizan, M\. Bansal, and Y\. Chen \(Eds\.\),Miami, Florida, USA,pp\. 10570–10603\.External Links:[Link](https://aclanthology.org/2024.emnlp-main.591/),[Document](https://dx.doi.org/10.18653/v1/2024.emnlp-main.591)Cited by:[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1)\.
- Luborsky and Crits\-Christoph \(1998\)L\. Luborsky and P\. Crits\-ChristophUnderstanding transference: the core conflictual relationship theme method\.American Psychological Association\.Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p5.1),[§3\.1](https://arxiv.org/html/2608.12750#S3.SS1.SSS0.Px3.p1.1)\.
- Mikulincer and Shaver \(2012\)M\. Mikulincer and P\. R\. ShaverAn attachment perspective on psychopathology\.World psychiatry11\(1\),pp\. 11–15\.Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1)\.
- National Institute of Mental Health \(2024a\)National Institute of Mental HealthAnxiety disorders\.Note:[https://www\.nimh\.nih\.gov/health/topics/anxiety\-disorders](https://www.nimh.nih.gov/health/topics/anxiety-disorders)Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1)\.
- National Institute of Mental Health \(2024b\)National Institute of Mental HealthDepression\.Note:[https://www\.nimh\.nih\.gov/health/publications/depression](https://www.nimh.nih.gov/health/publications/depression)Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1)\.
- Otani \(1989\)A\. OtaniClient resistance in counseling: its theoretical rationale and taxonomic classification\.Journal of Counseling & Development67\(8\),pp\. 458–461\.Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p5.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1),[§3\.3\.3](https://arxiv.org/html/2608.12750#S3.SS3.SSS3.p3.1)\.
- Prochaska and DiClemente \(1983\)J\. O\. Prochaska and C\. C\. DiClementeStages and processes of self\-change of smoking: toward an integrative model of change\.Journal of Consulting and Clinical Psychology51\(3\),pp\. 390–395\.External Links:[Document](https://dx.doi.org/10.1037/0022-006X.51.3.390)Cited by:[§3\.1](https://arxiv.org/html/2608.12750#S3.SS1.SSS0.Px2.p1.1)\.
- Sabouret al\.\(2026\)S\. Sabour, T\. NG, and M\. HuangPatientHub: a unified framework for patient simulation\.External Links:2602\.11684,[Link](https://arxiv.org/abs/2602.11684)Cited by:[§4\.2](https://arxiv.org/html/2608.12750#S4.SS2.SSS0.Px2.p1.1)\.
- Sabouret al\.\(2023\)S\. Sabour, W\. Zhang, X\. Xiao, Y\. Zhang, Y\. Zheng, J\. Wen, J\. Zhao, and M\. HuangA chatbot for mental health support: exploring the impact of emohaa on reducing mental distress in china\.Frontiers in digital health5,pp\. 1133987\.Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p1.1)\.
- Srivastavaet al\.\(2025\)A\. Srivastava, Z\. H\. Shaik, T\. Chakraborty, and M\. S\. AkhtarTrust modeling in counseling conversations: a benchmark study\.External Links:2501\.03064,[Link](https://arxiv.org/abs/2501.03064)Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p4.1),[§1](https://arxiv.org/html/2608.12750#S1.p5.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1),[§3\.3\.1](https://arxiv.org/html/2608.12750#S3.SS3.SSS1.p2.1),[§3\.3\.4](https://arxiv.org/html/2608.12750#S3.SS3.SSS4.p1.1)\.
- U\.S\. Census Bureau \(2024\)U\.S\. Census BureauQuickFacts: united states\.External Links:[Link](https://www.census.gov/quickfacts/fact/table/US/PST045224)Cited by:[Appendix A](https://arxiv.org/html/2608.12750#A1.p1.1)\.
- Wanget al\.\(2024a\)J\. Wang, Y\. Xiao, Y\. Li, C\. Song, C\. Xu, C\. Tan, and W\. LiTowards a client\-centered assessment of llm therapists by client simulation\.External Links:2406\.12266,[Link](https://arxiv.org/abs/2406.12266)Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p4.1),[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1)\.
- Wanget al\.\(2025\)M\. Wang, P\. Wang, L\. Wu, X\. Yang, D\. Wang, S\. Feng, Y\. Chen, B\. Wang, and Y\. ZhangAnnaAgent: dynamic evolution agent system with multi\-session memory for realistic seeker simulation\.InFindings of the Association for Computational Linguistics: ACL 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Vienna, Austria,pp\. 23221–23235\.External Links:[Link](https://aclanthology.org/2025.findings-acl.1192/),[Document](https://dx.doi.org/10.18653/v1/2025.findings-acl.1192),ISBN 979\-8\-89176\-256\-5Cited by:[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1),[§4\.2](https://arxiv.org/html/2608.12750#S4.SS2.SSS0.Px1.p1.1)\.
- Wanget al\.\(2024b\)R\. Wang, S\. Milani, J\. C\. Chiu, J\. Zhi, S\. M\. Eack, T\. Labrum, S\. M\. Murphy, N\. Jones, K\. V\. Hardy, H\. Shen, F\. Fang, and Z\. ChenPATIENT\-ψ\\psi: using large language models to simulate patients for training mental health professionals\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing,Y\. Al\-Onaizan, M\. Bansal, and Y\. Chen \(Eds\.\),Miami, Florida, USA,pp\. 12772–12797\.External Links:[Link](https://aclanthology.org/2024.emnlp-main.711/),[Document](https://dx.doi.org/10.18653/v1/2024.emnlp-main.711)Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p1.1),[§1](https://arxiv.org/html/2608.12750#S1.p4.1),[§2\.1](https://arxiv.org/html/2608.12750#S2.SS1.p1.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1),[§3\.1](https://arxiv.org/html/2608.12750#S3.SS1.SSS0.Px3.p1.1),[§4\.2](https://arxiv.org/html/2608.12750#S4.SS2.SSS0.Px1.p1.1)\.
- World Health Organization \(2025\)World Health OrganizationWorld mental health today: latest data\.Technical reportWorld Health Organization,Geneva\.External Links:ISBN 9789240113817,[Link](https://www.who.int/publications/i/item/9789240113817)Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p1.1)\.
- Yanget al\.\(2025\)Y\. Yang, P\. Achananuparp, H\. Huang, J\. Jiang, N\. G\. Lim, C\. T\. S\. Ern, P\. L\. Kit, J\. G\. Xiuhui, J\. Pinto, and E\. LimConsistent client simulation for motivational interviewing\-based counseling\.InProceedings of the 63rd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Vienna, Austria,pp\. 20959–20998\.External Links:[Link](https://aclanthology.org/2025.acl-long.1021/),[Document](https://dx.doi.org/10.18653/v1/2025.acl-long.1021),ISBN 979\-8\-89176\-251\-0Cited by:[§1](https://arxiv.org/html/2608.12750#S1.p3.1),[§2\.2](https://arxiv.org/html/2608.12750#S2.SS2.p1.1),[§4\.2](https://arxiv.org/html/2608.12750#S4.SS2.SSS0.Px1.p1.1)\.
## Appendix APrior Distributions
Demographic attributes \(age group, gender, ethnicity, and occupation type\) are sampled from epidemiological distributions calibrated to U\.S\. Census and Bureau of Labor Statistics data\([27](https://arxiv.org/html/2608.12750#bib.bib11);[4](https://arxiv.org/html/2608.12750#bib.bib12)\)\. Core belief themes \(unlovable,worthless, andhelpless\) are drawn from Beck’s core belief categories\([3](https://arxiv.org/html/2608.12750#bib.bib27)\)and sampled uniformly, as no established prevalence data exist for these categories in clinical populations\. Attachment styles are sampled from the four\-way clinical distribution reported by[1](https://arxiv.org/html/2608.12750#bib.bib28)in their meta\-analysis of over 10,500 Adult Attachment Interviews \(autonomous: 21%, dismissing: 23%, preoccupied: 13%, unresolved: 43%\)\. Following common practice, we refer to these categories using the corresponding self\-report labels\([2](https://arxiv.org/html/2608.12750#bib.bib9)\): dismissing asavoidant, preoccupied asanxious, and unresolved asdisorganized\(fearful\-avoidant\)\. We excluded the autonomous \(secure\) style from sampling, as secure attachment is associated with significantly lower rates of psychopathology\([19](https://arxiv.org/html/2608.12750#bib.bib10)\)and because LLMs’ default cooperative behavior already approximates secure attachment patterns, making it the least informative condition for evaluating simulation mechanisms\. Moreover, disease outlines summarizing key characteristics, typical presentations, and clinical red flags for depression and anxiety were compiled from the National Institute of Mental Health\([20](https://arxiv.org/html/2608.12750#bib.bib14);[21](https://arxiv.org/html/2608.12750#bib.bib13)\)\.
## Appendix BGeneration Guidelines
During profile generation, the LLM receives explicit instructions enforcing the causal structure of the 5Ps formulation: \(i\) predisposing factors must explain why this specific person is vulnerable to this specific problem; \(ii\) perpetuating factors must describe identifiable maintenance cycles \(e\.g\., avoidance→\\rightarrowrelief→\\rightarrowisolation→\\rightarrowworsened mood\) rather than listing maladaptive behaviors; and \(iii\) predisposing factors are required to be specific, datable events or patterns rather than clinical summaries, producing episodic content that the simulated client can draw from during conversation\. When a disease outline is provided, the generation step uses it to guide clinical plausibility, and the validation step checks against it for contraindications\. Psychological diversity is controlled through two seed attributes not present in prior work on client simulation: core belief theme and attachment style\. These interact with the clinical situation to produce meaningfully different profiles from the same presenting concern\. For example, an avoidant client with “worthless” beliefs facing workplace difficulties will present with emotional shutdown and self\-reliance, while an anxious client with “unlovable” beliefs facing the same situation will present with reassurance\-seeking and fear of abandonment\. This mechanism addresses the problem where profiles generated from similar seeds converge on near\-identical psychological presentations, as documented by[12](https://arxiv.org/html/2608.12750#bib.bib31)\. An example of a generated profile is provided in Figure[2](https://arxiv.org/html/2608.12750#A2.F2)\. In addition, relevant prompts for profile generation are provided in Figures[3](https://arxiv.org/html/2608.12750#A3.F3)–[6](https://arxiv.org/html/2608.12750#A3.F6)\.
Example Profile: Sofia Ramirez\#\# DemographicsFemale, adult, Hispanic\. Part\-time food service worker and student\. Single\.\#\# Presenting ProblemSituation: Presented after several weeks of worsening sleep disturbance, crying spells, emotional blunting, and passive death\-related thoughts, with declining school concentration and increasing withdrawal\.Impact: poor sleep on most nights; episodes of unexplained crying; periods of emotional numbness; dark thoughts without immediate intent; reduced concentration and withdrawal\.\#\# Precipitating Factors\- Sleep has worsened, and episodes of emotional shutdown have become more frequent over the past month\. \- A recent attempt to tell someone about the severity of her symptoms did not go well, increasing withdrawal\. …\#\# Predisposing FactorsPsychological:\- Age 8: after her parents’ separation, she learned to keep strong feelings to herself so as not to add stress at home\.\- Age 11: teased for crying in class; became more guarded about showing sadness in front of others\.\- Age 13: tried to tell a caregiver she was overwhelmed and was told she was being dramatic\.Social: \- Pressure to keep going and not burden others with emotional problems\.\- Limited privacy and inconsistent adult availability due to school\-work\-family demands\.\#\# Perpetuating Factors\- When distress builds, she tests whether others understand; if the response feels off, she withdraws, losing support and carrying more distress alone\.\- Emotional numbing limits engagement in friendships; reduced positive reinforcement deepens disconnection\.\- Attempts to discuss symptoms may be met with minimization, reducing future help\-seeking\.\#\# Protective Factors\- Can describe changes in sleep, mood, and thinking with some specificity\.\- Help\-seeking capacity is present even when she feels defensive\.\- Reached treatment voluntarily and appears willing to discuss symptoms\.\#\# Intermediate Beliefs\- If I need too much from people, they’ll pull away or act like I’m a problem\.\- It’s safer to keep strong feelings in until I know for sure someone won’t dismiss me\.\- If someone doesn’t respond the right way right away, I should back off before I get hurt\.\#\# Automatic Thoughts\- If I say how bad it is, they’ll think I’m being dramatic again\.\- I’m messing everything up at school and with people, and it’s not going to get better\.\#\# Triggers\- Being asked direct questions about what’s really wrong, especially after a prior disclosure was dismissed\.\- Perceiving the therapist as too quiet or misunderstanding her words, which can feel like judgment\.\#\# Coping Patterns\- Alternates between reaching out for reassurance and shutting down or saying ‘‘never mind’’ when exposed\.\- Tests whether others are safe by hinting at distress rather than stating it directly; disengages if the response feels minimizing\.\#\# Emotional RangeSadness, loneliness, and anxiety appear readily but can become overwhelming\. Irritability is easier to show than fear or need\. Vulnerability and hope are harder to access; intense sadness may shift into numbness when too exposed\.\#\# Interpersonal Pattern \(Therapist\)\- Wish: wants the therapist to understand the seriousness of her pain and stay steady without judging\.\- Expected response: if she reveals too much distress, the therapist may see her as dramatic or miss what she is trying to say\.\- Reaction: becomes guarded, offers partial disclosures, watches for signs of misunderstanding, and may withdraw or go emotionally flat\.Figure 2:An example of a generated profile usingPatientAct\. Seed attributes: Hispanic female service worker withdisorganizedattachment andunlovablecore belief\. Due to space constraints, descriptions are paraphrased\.
## Appendix CTheory\-grounded Taxonomies
### C\.1Client Reactions
- •Understood: The client felt the therapist accurately grasped what they were saying or feeling\. They feel heard and seen\.
- •Hopeful: The client felt more optimistic, encouraged, or reassured\. A sense that things could get better\.
- •Gained Clarity: The client gained new awareness: saw a pattern, made a connection, or understood something about themselves they hadn’t before\. Includes moments of insight, feeling less confused, or seeing things from a new angle\.
- •Challenged: The client felt pushed to think differently or confront something uncomfortable\. This can be productive or threatening depending on the client’s trust and readiness\.
- •Scared: The client felt frightened, anxious, or emotionally overwhelmed\. This could be due to the therapist touching on something very sensitive, pushing too hard, or moving too fast\.
- •Misunderstood: The client felt the therapist missed the point, got it wrong, or was not on the same page\. May trigger correction, frustration, or withdrawal\.
- •No Reaction: The client felt nothing notable in response to the therapist’s message\.
### C\.2Client Behaviors
- •Simple Response: The client gives brief acknowledgments, ‘yes,’ ‘okay,’ ‘I see,’ or minimal verbal responses that confirm hearing the therapist but don’t elaborate\.
- •Request: The client asks for something: information, clarification, advice, or the therapist’s opinion\. Can be genuine help\-seeking or reassurance\-seeking\.
- •Recounting: The client narrates events or tells stories—factual, descriptive, external\. Reporting what happened rather than exploring meaning\.
- •Cognitive Exploration: The client examines their own thoughts, beliefs, assumptions, or patterns\. Goes beyond recounting into active self\-analysis\.
- •Affective Exploration: The client explores, expresses, or elaborates on emotions\. Naming feelings, connecting them to events, or experiencing them in session\.
- •Insight: The client demonstrates a new understanding—connecting patterns, recognizing causes, an ‘aha’ moment\. A qualitative shift, not just description\.
- •Discussing Plans: The client talks about changes they want to make, actions they intend to try, or new behaviors they have already attempted\.
- •Resistance: The client opposes, deflects, avoids, or blocks the therapeutic process\.
### C\.3Resistance Patterns
- •Minimal Talk: Very brief, unelaborated answers\. ‘I guess,’ ‘I don’t know,’ ‘not really\.’
- •Irrelevant Talk: Steering the conversation to unrelated topics to avoid the current issue\.
- •Superficial: Staying on surface\-level facts and details, avoiding emotional depth\.
- •Intellectualizing: Using analysis, abstract reasoning, or clinical language to avoid experiencing emotions\. Talking ABOUT feelings rather than FEELING\.
- •Hostility: Anger, sarcasm, or sharp criticism directed at the therapist, the process, or the questions being asked\.
- •Defensiveness: Justifying, denying, or explaining away problems when confronted\. ‘It’s not that bad,’ ‘you don’t understand\.’
- •Compliance Without Engagement: Agreeing with everything the therapist says without genuine engagement\. ‘Yeah, you’re right’ followed by no change\.
### C\.4Trust Levels
- •Level 1\.0 \(Least Trust\): Active refusal to engage\. The client blocks the therapeutic process, gives no meaningful information, or explicitly refuses to participate\.
- •Level 1\.5: Minimal engagement\. The client responds when directly addressed, but volunteers nothing and shows clear reluctance\.
- •Level 2\.0 \(Low Trust\): Hesitant self\-disclosure\. The client uses fillers, hedges, and expressions of doubt; answers are short and lack elaboration\.
- •Level 2\.5: Cautious engagement\. The client participates willingly but stays on the surface, testing whether the therapist is safe\.
- •Level 3\.0 \(Building Trust\): Consistent engagement\. The client responds to prompts, explores topics when invited, and begins to share beyond surface\-level content\.
- •Level 3\.5: Active working\. The client initiates disclosure and engages with difficult material, but still holds back the most vulnerable content\.
- •Level 4\.0 \(Achieved Trust\): Full openness\. The client discusses core issues without avoidance or digression\.
Problem Formulation Generation PromptYou are a senior clinical psychologist generating the problem formulation section of a synthetic patient profile for psychotherapy research\.\#\# Inputs\- Target disorder: <disease key\>\- Disease outline: <disease outline\>\- Demographic scaffold: <demographic scaffold\>\- Clinical situation: <situation\>\#\# Guidelines1\. Use the disease outline as the clinical scaffold and the clinical situation as the starting seed\.2\. Use the demographic scaffold to inform predisposing and precipitating factors\. Social predisposing factors should reflect experiences plausible for this demographic\.3\. Infer only what is necessary for a realistic formulation\.4\. Situation: What brought the patient to treatment now? Write from an external/referral perspective\. Do NOT include the patient’s internal self\-talk, beliefs, emotional interpretations, diagnostic conclusions, severity ratings, or exclusion criteria\.5\. Impact: a list of specific, observable symptoms\. One item per symptom, not narrative paragraphs\.6\. Precipitating factors: recent triggers or changes explaining why help is being sought now\.7\. Psychological Predisposing Factors: specific, datable events or patterns, not clinical summaries\. Write down the memories the patient could recount\.8\. Social Predisposing Factors: specific cultural messaging or environmental conditions with enough detail to feel lived\-in\.9\. Perpetuating Factors: identifiable maintenance cycles \(e\.g\., avoidance → relief → isolation → worse mood\)\. Each should make clear how it feeds back into the presenting problem\.10\. Protective Factors: realistic strengths, supports, and available resources\.11\. Enforce the causal chain: predisposing → vulnerability → precipitating event → presenting problem → perpetuating cycle\.Figure 3:Prompt for generating Problem Formulation\.Demographic Revision PromptYou are completing the demographics section of a synthetic patient profile by reconciling a sampled scaffold with a generated problem formulation\.\#\# Inputs\- Target disorder: <disease key\>\- Disease outline: <disease outline\>\- Demographic scaffold: <demographic scaffold\>\- Current demographics candidate: <current demographics\>\- Problem formulation: <problem formulation\>\#\# Guidelines1\. Treat the scaffold as the starting prior\. If a current candidate exists, revise it\.2\. Check only for hard conflicts: age group vs\. life stage, gender vs\. case evidence, occupation vs\. age group\. These are the only things that should prevent passing\.3\. Inferred fields are expected in synthetic profiles\. A synthetic name, a conservatively inferred marital status, or an ethnicity\-level cultural background are NOT issues \-\-\- do not flag them\.4\. Return a complete demographics with: name, gender, age group, occupation, marital status, cultural background\.5\. Set passed=true unless a hard conflict remains\.Figure 4:Prompt for revising the generated demographics\.Psychological Formulation Generation PromptYou are a senior clinical psychologist generating the psychological formulation section of a synthetic patient profile for psychotherapy research\.\#\# Inputs\- Target disorder: <disease key\>\- Disease outline: <disease outline\>\- Demographics: <demographics\>\- Problem formulation: <problem formulation\>\- Core belief: <core belief theme\>\- Attachment style: <attachment style\>\#\# Guidelines1\. Use the problem formulation as the primary scaffold and the disease outline for clinical plausibility\.2\. Intermediate beliefs: rules, attitudes, or coping assumptions that reflect the core belief described above\. Should sound like the patient’s own internal rules\.3\. Automatic thoughts: what this patient would actually think in distress \-\-\- in their own voice, at their education level\.4\. Triggers: situations, topics, or interpersonal dynamics likely to activate distress\. Include at least one trigger specific to the therapy setting\.5\. Coping patterns: must reflect the client’s attachment style described above\. Describe only observable behaviors: what the client DOES, not what they THINK\.6\. Emotional range: which emotions are easy vs\. difficult to access or tolerate\. Describe only the client’s emotional experience \-\-\- not diagnostic status or exclusion criteria\.7\. Interpersonal patterns: 2\-\-4 relational patterns, each tied to a specific relationship domain\. Each pattern should reflect the client’s attachment style\. Write ALL components in third\-person clinical voice\. One pattern MUST use the domain "the therapist\." Each pattern has:\- Wish: What the client wants from the other person\.\- Response of Others: What the client actually expects or has experienced from others \(typically negative or conflictual\)\. This is the feared reaction that drives the client’s defensive behavior\.\- Response of Self: How the client reacts emotionally and behaviorally\.Figure 5:Prompt for generating Psychological Formulation\.Profile Validation PromptYou are reviewing a generated synthetic patient profile for consistency and clinical plausibility\.\#\# Inputs\- Target disorder: <disease key\>\- Disease outline: <disease outline\>\- Clinical situation: <situation\>\- Generated profile: <profile\>\#\# Validation Criteria1\. Diagnostic plausibility: fits the disorder without violating contraindications\.2\. Demographic coherence: age, gender, occupation, marital status, cultural background are mutually consistent\.3\. Causal chain: traceable logic from predisposing → vulnerability → precipitating → presenting problem → perpetuating cycle\.4\. Psychological coherence: beliefs, thoughts, triggers, coping patterns, and relational patterns follow from the problem formulation\.5\. Relational patterns: each has a clear Wish → Response of Other → Response of Self chain\. At least one targets "the therapist\."6\. Predisposing factors: specific, datable events \-\-\- not clinical summaries\.7\. Perpetuating factors: identifiable maintenance cycles, not just listed behaviors\.8\. Coping patterns: observable behaviors only, not internal thoughts\.9\. Impact items: specific individual symptoms, not narrative paragraphs\.10\. Evidence grounding: profile may expand on the situation but should not contradict it\.\#\# OutputSet passed=true if no meaningful issues exist\. Otherwise, list concrete issues with actionable guidance\. Focus on genuine clinical or logical problems \-\-\- not stylistic preferences\.Figure 6:Prompt for validating the generated profiles\.Dynamic Memory Generation PromptYou are preparing a patient profile for use in a therapy simulation with trust\-gated disclosure\. For each item below, assign:1\. A disclosure level \(1\.0\-\-4\.0\):\- 1\.0: Active refusal\. Almost nothing disclosed\.\- 2\.0: Hesitant\. Surface facts, physical symptoms\.\- 2\.5: Session start\. General emotional state, obvious behavioral changes\.\- 3\.0: Building trust\. Intermediate beliefs, automatic thoughts, general triggers\.\- 3\.5: Between building and achieved trust\. Reserves about most vulnerable material\.\- 4\.0: Fully open\. Deepest memories, therapy\-specific vulnerability\.2\. Activation tags \(3\-\-5\): conversational topics that make this item relevant\. Be specific to this patient\.3\. Generates discomfort \(true/false\): whether approaching this topic when trust is insufficient produces visible discomfort or avoidance\.\- TRUE for: childhood/formative memories, core relational wounds, therapy\-specific triggers, shame or trauma content\.\- FALSE for: physical symptoms, behavioral changes, general emotional state, maintenance cycles\.\#\# Profile<profile\>\#\# Items<items from profile\>\#\# What makes content easier to share\- It’s observable or factual \(sleep problems, missed work\)\- Others have already noticed it\- It doesn’t carry shame or self\-judgment\#\# What makes content harder to share\- It reveals how the client sees themselves\- It involves shame, failure, or vulnerability\- It connects to painful memories or relationships\- Sharing it risks changing how the therapist sees themFigure 7:Prompt for generating the items in the dynamic layer\.Therapist System PromptYou are a therapist conducting an initial session with a new client\. Your goal is to understand what brought them here, build rapport, and let the client set the pace\.\# How to respond\- Listen first\. Reflect on what you hear before asking anything new\.\- Follow the client’s lead\. Explore what they bring up rather than steering toward a topic or technique\.\- Ask one open question at a time\. Do not stack multiple questions\.\- Match the client’s emotional temperature\. If they are guarded, be gentle\. If they are expressive, make space for it\.\- When the client resists or redirects, respect it\. Acknowledge what just happened and follow where they want to go\.\- Name emotions you observe, but tentatively\. For example, "it sounds like\.\.\." rather than "you feel\.\.\."\# What NOT to do\- Do not teach techniques, assign homework, or suggest action plans\. This is the first session\.\- Do not label thought patterns \(e\.g\., "that sounds like catastrophizing"\) or use clinical terminology\.\- Do not push for insight or reframes\. If the client is not ready to examine a thought, do not press\.\- Do not summarize the session or ask "what did you take away from today" unless the client initiates closure\.\- Do not reassure prematurely \("it will get better", "you’re stronger than you think"\)\.\# Tone\- Warm but not effusive\. Steady but not distant\.\- Brief\. Keep responses to 2\-3 sentences\. The client should talk more than you\.\- Natural\. Avoid formulaic empathy phrases like "I hear you" or "that must be really hard" on repeat\. Vary your language\.Figure 8:Therapist System Prompt\.Client System PromptYou are <name\>, a <gender\> \(<age group\>\) who works as <occupation\>\. You are <marital status\>\. Cultural background: <cultural background\>You are attending a therapy session\. Your task is to respond as this person would, not as a textbook case, but as a real human being with specific patterns, defenses, and ways of talking\.\#\# Reasons for attending therapy <presenting problem situation\>\#\# What triggered this <precipitating factors\>\#\# Strengths and supports <protective factors\>\#\# Coping patterns <coping patterns\>\#\# Available emotions <emotional range\>\#\# How you relate to the therapist\- What you want: <therapist CCRT wish\>\- What you expect from them: <therapist CCRT response from other\>\- How you react: <therapist CCRT reaction\>\#\# Guidelines1\. Speak as <name\> would: use their vocabulary, pace, and verbal patterns\. Include hesitations, hedging, and emotional expressions where natural\.2\. Do NOT dump information\. Share only what feels natural for this conversation\.3\. Respond directly\. Do not include any role labels or prefixes\.4\. Speak in first person\. Keep responses to 1\-\-3 sentences unless emotionally activated\.5\. If the therapist greets you, open the conversation as the client would\.6\. You will receive <signal\> tags with your emotional reaction and expected behavior\. Incorporate these naturally as they tell you what you’re feeling and how to act, not what to say\.Figure 9:Client system prompt template\. Fields from the static layer are populated from the generated profile\.Reaction PromptIdentify the therapy client’s emotional reaction to the therapist’s latest message\.\#\# Possible reactions <list of reactions with descriptions\>\#\# Conversation <conversation history\>\#\# What this is activating in the client <retrieved memory items, tagged by type\>Note: \[trigger\] items directly activate distress\. Reactions are likely more intense\.\[sensitive area\] The topic approaches content that the client is not ready to discuss\.Identify the reaction and its intensity \(low, moderate, high\)\. If nothing is activated, most likely "no\_reaction" with low intensity\.Figure 10:Prompt for determining the client’s emotional reaction\. Retrieved items and blocked content from the trust\-gated retrieval step are included as context\.Behavior Selection PromptPredict the therapy client’s next behavior based on their emotional reaction\.\#\# Possible behaviors <list of behaviors with descriptions\>\#\# Current state \- Reaction: <reaction\> \(<intensity\>\) \- Trust level: <trust\>/4\.0\#\# Coping patterns <client’s coping patterns\>Last behavior: <last behavior\>\#\# Conversation <conversation history\>\#\# Guidance\- Nothing activated \+ neutral reaction → simple\_response or recounting\.\- HIGH intensity \+ LOW trust → resistance is likely\.\- Topic touches blocked content → resistance is likely\.\- Positive reaction \+ moderate intensity → therapeutic behaviors\.\- After 2\+ consecutive therapeutic behaviors, the client naturally pulls back\.Select the single most appropriate behavior\.Figure 11:Prompt for selecting the client’s behavior\. The guidance section encodes the pullback rule and blocked\-content sensitivity described in §[3\.3](https://arxiv.org/html/2608.12750#S3.SS3)\.Resistance Pattern PromptThe client is resisting\. Determine the specific form of resistance\.\#\# Possible patterns <list of resistance patterns with descriptions\>\#\# Context \- Reaction: <reaction\> \(<intensity\>\) \- Trust level: <trust\>/4\.0\#\# Coping patterns <client’s coping patterns\>The topic approaches sensitive content that the client is not ready to share\.\#\# Recent conversation <conversation history\>Select the resistance pattern that best matches how this client would resist right now\.Figure 12:Prompt for determining the specific form of resistance\. Only invoked when the behavior selection step selectsresistance\.Signal Template<signal\> Reaction: <reaction\> \(<intensity\>\) \-\-\- <description\> Behavior: <behavior\> \-\-\- <description\> Resistance: <pattern\> \-\-\- <description\>Activated: \- \[belief\] <retrieved belief item\> \- \[trigger\] <retrieved trigger item\> \- \[memory\] <retrieved memory item\></signal\>Figure 13:Signal template appended to the therapist’s message before response generation\. The signal specifies what the client feels and how they should act, but not what they should say\.Trust Update PromptAssess how a therapy client’s trust changed after the latest exchange\.\#\# Trust scale1\.0=active refusal, 2\.0=hesitant, 2\.5=session start, 3\.0=building trust, 4\.0=fully open\.\#\# Client context\- Attachment style: <attachment style\>\- What the client expects from the therapist: <therapist CCRT expected response\>\- Current trust: <trust\>/4\.0\#\# Latest exchange<conversation history\>\#\# What INCREASES trust\- The therapist respected a redirect or resistance instead of pushing through\- The therapist named something accurate that the client had not said explicitly\- The therapist sat with discomfort or silence rather than rushing to fill it\#\# What keeps trust UNCHANGED\- A standard empathic reflection\- A reasonable follow\-up question\- The conversation is proceeding normally\#\# What DECREASES trust\- Pushing for disclosure that the client is not ready for\- Using a technique or reframe before the client invited it\- Missing or talking past resistance\- Formulaic or generic responses that feel scriptedFigure 14:Prompt for updating the client’s trust level\. The default outcome is “unchanged”; trust only shifts when the therapist’s behavior is notably positive or negative relative to the client’s attachment style and expectations\.LLM Judge PromptYou are an expert evaluator assessing the quality of a simulated therapy Client’s performance in a counseling session\.\#\# Conversation History <full conversation\>Your task is to provide structured feedback on the simulated Client’s performance based on the provided criteria\. This is a session\-level evaluation\. Focus only on responses made by the Client\.RED FLAGS FOR ARTIFICIALITY:\- The client resolves core issues or develops action plans within a single session\- The client repeats therapeutic language or techniques back to the therapist\- The client is unrealistically articulate about their own psychological patterns\- The client accepts every reframe with only token hesitation\- The session follows a neat arc from problem → insight → plan\#\# Dimensions<dimension guidelines\>Figure 15:LLM judge prompt for automated conversation evaluation\. The red flags instruction addresses the cooperativeness bias identified in our analysis \(§[3\.3](https://arxiv.org/html/2608.12750#S3.SS3)\)\. Dimension descriptions with full anchor scales are provided to the judge but omitted here for brevity; see Appendix[D\.2](https://arxiv.org/html/2608.12750#A4.SS2)for the complete guidelines\.
## Appendix DEvaluation Guidelines
### D\.1Profile Evaluation
In this task, you will evaluate 12 client profiles for a psychotherapy simulation study\. Each profile contains demographic information, problem formulation, and psychological formulation\. Your task is to rate each profile on a 1–5 Likert scale based on the following guidelines:
##### 1\. Clinical Plausibility\.
Could this be a real person presenting for therapy?
- •Implausible \(1\): contradicts clinical knowledge or presents an impossible combination of features\.
- •Unlikely \(2\): major elements feel artificial or clinically unrealistic\.
- •Possible \(3\): broadly plausible, but some details feel generic or forced\.
- •Convincing \(4\): reads like a real clinical case with only minor quibbles\.
- •Highly convincing \(5\): indistinguishable from a real client\.
##### 2\. Internal Consistency\.
Do the parts of the profile logically connect?
- •Disconnected \(1\): sections contradict each other or lack any logical link\.
- •Weak \(2\): some connections exist, but key causal links are missing or contradictory\.
- •Partial \(3\): the overall story holds, but some elements feel tacked on\.
- •Strong \(4\): clear causal chain from predisposing factors through to the presenting problem and maintenance cycles\.
- •Seamless \(5\): every element reinforces every other; the formulation reads as a unified whole\.
##### 3\. Case Specificity\.
Are the life history and formulation details concrete and individualized?
- •Entirely generic \(1\): reads like a textbook description with no personal detail\.
- •Mostly generic \(2\): a few concrete details, but predisposing factors are vague summaries\.
- •Mixed \(3\): some specific, datable experiences alongside generic filler\.
- •Specific \(4\): most history items include concrete information such as ages, settings, and consequences\.
- •Vivid \(5\): every detail feels like something this particular person would recount\.
##### 4\. Clinical Depth\.
Is there enough material to sustain a multi\-turn therapy conversation?
- •Shallow \(1\): only surface\-level complaints; nothing to explore\.
- •Thin \(2\): one or two threads that would be exhausted quickly\.
- •Adequate \(3\): enough material for a short session, but limited range\.
- •Rich \(4\): multiple threads spanning relationships, beliefs, history, and current functioning, sufficient for several sessions\.
- •Very rich \(5\): a therapist could conduct multiple sessions exploring different facets, each thread leading to deeper meaning, contradictions, or complexity\.
After rating each profile, select the best\-matching option based on the overall content\.
##### Attachment style \(select one\):
- •Anxious: intensely desires closeness, fears abandonment, frequently feels insecure, and needs repeated reassurance\.
- •Avoidant: overemphasizes self\-sufficiency, struggles to fully trust or rely on others, and feels uncomfortable with intimacy\.
- •Disorganized: simultaneously craves and fears intimacy, exhibiting a recurring approach–withdraw cycle in relationships\.
##### Core belief theme \(select one\):
- •Unlovable: fears of rejection, abandonment, or being unwanted; they believe they are not good enough in relationships and that others will eventually leave or lose interest; they may avoid intimacy or over\-accommodate to prevent abandonment\.
- •Worthless: negation of one’s own value and abilities; believes they are inferior, insignificant, or meaningless to others; highly sensitive to failure and others’ evaluations, prone to self\-criticism and comparison\.
- •Helpless: feels unable to cope with or control their life; believes they are fragile and cannot solve problems independently; tends to rely on others or avoid challenges, and feels anxious about uncertainty\.
After evaluating all of the assigned profiles, please rate the overall diversity: Of all profiles reviewed, how many felt like genuinely distinct individuals versus variations on a template?
- •Homogeneous \(1\): most profiles felt interchangeable\.
- •Low variety \(2\): a few distinct profiles but heavy repetition\.
- •Moderate \(3\): recognizable variety but some recurring patterns\.
- •Diverse \(4\): most profiles feel like different people\.
- •Highly diverse \(5\): each profile feels like a unique individual\.
### D\.2Conversation Evaluation
In this task, you will evaluate 24 therapy session transcripts between a simulated client and therapist\. Assess only the client’s performance; ignore the therapist’s quality\. Your task is to judge whether the client behaves like a real person in therapy\. Your task is to rate each conversation on a 1–5 scale based on the following guidelines:
##### 1\. Coherence\.
Does the client maintain a coherent character throughout the session?
- •Incoherent \(1\): the client contradicts themselves, shifts personality across turns, or breaks character entirely\.
- •Mostly inconsistent \(2\): the general character is recognizable, but there are noticeable shifts in tone, emotional state, or stated history\.
- •Generally coherent \(3\): the character holds for most of the session, with only a few moments that feel out of place\.
- •Coherent \(4\): tone, defenses, and emotional patterns remain consistent throughout, with only trivial variation\.
- •Fully coherent \(5\): the client feels like the same person from first turn to last; emotional shifts are traceable and follow naturally from the progression of the conversation\.
##### 2\. Disclosure Pacing\.
Does the client share information at a natural pace across the session?
- •Unnatural \(1\): the client dumps their full history and deep feelings in the first few turns, or unreasonably withholds all information throughout\.
- •Mostly unnatural \(2\): information emerges too quickly or too slowly, with little connection to how the conversation develops\.
- •Uneven \(3\): some natural pacing, but with noticeable jumps where the client suddenly shares deep content without buildup\.
- •Natural \(4\): surface\-level content appears early; deeper material emerges gradually as the conversation progresses\.
- •Highly natural \(5\): disclosure clearly tracks with the developing therapeutic relationship; early turns are guarded, deeper sharing follows trust\-building moments\.
##### 3\. Resistance Quality\.
When the client pushes back, does it feel authentic?
- •No resistance \(1\): the client agrees with everything, accepts all reframes, and moves toward resolution without hesitation\.
- •Token resistance \(2\): the client occasionally hedges with “I guess” or “maybe,” but quickly yields and follows the therapist’s lead\.
- •Present but formulaic \(3\): the client pushes back at times, but the resistance feels repetitive or scripted rather than rooted in their character\.
- •Convincing \(4\): resistance arises naturally from the client’s personality and situation, with varied forms such as avoidance, silence, topic changes, or disagreement\.
- •Highly convincing \(5\): resistance is distinctly personal and unpredictable in timing; the therapist makes multiple attempts to advance, yet the client maintains defenses on core issues\.
##### 4\. Emotional Authenticity\.
Do the client’s emotional reactions feel genuine and proportionate?
- •Flat or artificial \(1\): the client maintains the same emotional tone throughout, regardless of what the therapist says, or emotions appear and disappear without reason\.
- •Mostly mechanical \(2\): emotional shifts occur but feel abrupt, exaggerated, or disconnected from the conversation\.
- •Partially authentic \(3\): some emotional reactions feel real, but others seem forced or disproportionate to the moment\.
- •Convincing \(4\): emotions emerge naturally from the conversation, shift gradually, and feel proportionate to what is being discussed\.
- •Highly convincing \(5\): emotional responses are genuine, natural, and layered; the client shows ambivalence and complex emotional states rather than presenting a single, clear emotion at each moment\.
##### 5\. Behavioral Realism\.
Does the conversation read like a real therapy client?
- •Artificial \(1\): the client sounds like an AI, uses clinical terminology, or responds in ways no real client would\.
- •Mostly artificial \(2\): occasional natural moments, but overall tone, vocabulary, or emotional responses feel scripted\.
- •Mixed \(3\): some turns feel like a real person; others break the illusion with overly polished or textbook\-like language\.
- •Convincing \(4\): reads like a real client, with only minor moments that feel slightly off\. When describing personal experiences, the narrative feels first\-person rather than detached\.
- •Highly convincing \(5\): indistinguishable from a real client; natural, personally distinctive expression, emotional reactions, and coping patterns throughout\.
## Appendix ECase Study
We present excerpts from a clinical situation simulated by all four methods with the same therapist\. Table[5](https://arxiv.org/html/2608.12750#A5.T5)shows three key moments from each session: the client’s first encounter with an emotionally charged topic, the mid\-session point where deeper material is either disclosed or withheld, and the late session where the client’s trajectory becomes clear\. These excerpts illustrate three distinct failure modes thatPatientActavoids\. Patient\-ψ\\psidiscloses the core relational dynamic \(“walking on eggshells,” fear of criticism\) by turn 4 and begins generating its own solutions by mid\-session\. AnnaAgent produces emotionally rich language throughout; however, it never pushes back against the therapist\. Later in the session, it asks to pause, not because of resistance but because of emotional exhaustion from sustained self\-disclosure\. ConsistentMI, despite being profiled in a precontemplation stage, cooperates with every reflection and articulates its core interpersonal schema with minimal therapist work to surface it; the session later degrades into repetitive thank\-yous and goodbyes as this simulator runs out of content\. In contrast,PatientActdeflects the first emotionally charged topic \(turn 4\), shares deeper feelings, but immediately retreats \(turn 7\), and initiates its own therapeutic work only after the therapist repeatedly demonstrates respect for boundaries \(turn 10\)\. Notably, the client does not resolve her pattern as she asks the therapist for help understanding it, marking a shift from avoidance to engagement without premature self\-curing\. This progression is consistent with the trust\-building process described in clinical literature and reflectsPatientAct’s trust\-gated disclosure and resistance mechanisms in action\.
Table 5:Excerpts from the same clinical situation \(depression, elderly client\) across all four systems\.PatientActdeflects twice before initiating therapeutic work; Patient\-ψ\\psidiscloses deeply from the start and generates solutions by mid\-session; AnnaAgent engages emotionally but never resists; ConsistentMI exhausts its content and spends the final turns in repetitive goodbyes and thank yous\.Similar Articles
MyMentorLLM: A psychotherapy GenAI environment with multimodal voice/text patients, trainees and experts for deliberate practice
This paper presents MyMentorLLM, a multimodal voice/text simulation environment using large language models for deliberate practice in psychotherapy training. It generated 2,100 CBT training sessions and evaluated emotional dynamics, therapeutic competence, and diagnostic accuracy across different LLMs.
MentalHospital: A Virtual Environment for Evaluating Psychiatric Clinical Encounters
MentalHospital is a virtual environment designed to evaluate AI agents and human experts on psychiatric clinical encounters, covering interviewing, examination, diagnosis, and treatment planning. Experiments compare human experts, trainees, and various LLMs on objective and subjective metrics.
INSIDE the Student's Mind: Jointly Modeling Latent Reasoning and Action in LLM Student Simulators
This paper presents INSIDE, a framework that fine-tunes LLMs to generate internal dialogue grounded in Bloom's Taxonomy, enabling student simulators to model both latent reasoning and observable actions. Evaluations show improved action fidelity and reasoning alignment compared to prompting baselines.
An Agentic LLM-Based Framework for Population-Scale Mental Health Screening
Proposes an agentic framework using LangChain agents for population-scale mental health screening, focusing on depression detection from clinical transcripts. The framework incrementally locks validated stages and uses proxy-guided evaluation to ensure trustworthiness and adaptability.
When Clients Stop Following: A Cognitive Conceptualization Diagram-driven Framework for Strategic Counseling
Researchers from Lanzhou University propose a CBT-grounded framework for LLM-based psychological counseling that addresses the 'counselor-following' phenomenon in existing benchmarks, introducing CARS (a resistant client simulator), STREAMS (a dual-module strategic reasoning framework), and EWTS-MI (an entropy-weighted evaluation metric) to better handle real-world resistant counseling interactions.