校准于谁？人格与语言对JEV文化价值观的影响

# Calibrated to Whom? Persona and Language Effectson Cultural Values in JEV
Source: [https://arxiv.org/html/2609.36399](https://arxiv.org/html/2609.36399)
###### Abstract

Decision\-only language models return a probability for every answer option instead of generating text, which makes them attractive as survey respondents and as judges\. We audit the cultural values of one such model, TypeSafe’s JEV, with the Values Survey Module 2013\. We asked it the 24 items as 12 matched Saudi and 12 matched American personas and without a persona, in English and Arabic, under eight ways of formulating the request \(288,000 answers\)\. JEV’s answers were highly repeatable \(ICC 0\.997\), and without a persona they resembled those of its own American personas\. When the persona was Saudi rather than American, the answers moved in the direction of the human Saudi–US difference, reproducing 87% of its size in English but 62% in Arabic, with long\-term orientation reversed\. A language cross shows that the smaller difference in Arabic comes from the language of the items, not from the language of the persona description\. Age shifted the profiles about as much as nationality, gender shifted them more for Saudi than for American personas, and JEV was less confident in Arabic and for Saudi personas\. These patterns held in every request design, although the model never generates text\.

## 1Introduction

Figure 1:Calibrated to whom? \(a\) Without a persona, JEV’s answers lie next to those of its own American personas, on a scale from its American \(0\) to its Saudi \(1\) personas\. \(b\) When the persona changes from American to Saudi, the answers move by 87% of the Saudi–US difference in Hofstede’s scores in English and by 62% in Arabic \(documented set\-up\)\.Figure 2:Study design\. \(1\) Matched Saudi and American personas and a no\-persona baseline, in English and Arabic, answer the 24 VSM 2013 items\. \(2\) Each prompt becomes a JEV request in eight set\-ups\. \(3\) JEV returns a probability for each answer option; the bars show its mean probabilities for item 9 \(“how important would it be to you to have a job respected by your family and friends”\) for a young Saudi and a young American woman \(documented set\-up, English; 1 = of utmost importance\)\. \(4\) Expected answers are scored on the six VSM dimensions and compared through measures in which the scoring constants cancel\.Value surveys have become a standard way to ask whose values a language model reflects\([Santurkar et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib17);[Durmus et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib18);[Cao et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib9);[AlKhamissi et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib11);[Tao et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib12)\)\. With generative models the procedure is indirect: many completions are sampled, free text is mapped back to answer options, refusals have to be handled, and the results move with the format of the prompt\([Röttger et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib14)\)\.

A new class of models removes these steps\. JEV, released by TypeSafe AI in September 2026, is described as a “System One” model: given a context and a question with fixed options, it returns a probability for every option and never generates text\([TypeSafe AI, 2026](https://arxiv.org/html/2609.36399#bib.bib1)\)\. Within weeks it was evaluated as an inexpensive first\-pass judge\([Li et al\., 2026](https://arxiv.org/html/2609.36399#bib.bib2)\)and used to predict the answers of described respondents in population experiments\([Li, 2026](https://arxiv.org/html/2609.36399#bib.bib3)\)\. Both studies worked in English, and neither asked whose values the model itself reports\.

For a model that stands in for respondents, three questions matter\. What does it answer when no respondent is described? When the respondent’s nationality is given, do its answers move in the direction of real national differences, and how far? And do the answers depend on the language of the questionnaire? Figure[1](https://arxiv.org/html/2609.36399#S1.F1)previews our answers\. The language can matter even for a single item: asked in English whether an organisation’s rules should never be broken, JEV’s Saudi personas agree more strongly than its American personas, whereas in Arabic the two answer alike\. Arabic makes the last question pressing: cultural biases in Arabic contexts are well documented for generative models\([Naous et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib13);[AlKhamissi et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib11)\), and JEV is trained mainly on English, with lower documented accuracy in other languages\([TypeSafe AI, 2026](https://arxiv.org/html/2609.36399#bib.bib1)\)\.

We answer these questions with the Values Survey Module 2013\([Hofstede and Minkov, 2013a](https://arxiv.org/html/2609.36399#bib.bib6), VSM 2013;\)\. We describe 12 matched Saudi and 12 matched American personas, or none, in English and in Arabic, and compare the Saudi–American difference in JEV’s answers with the human difference between the two countries \(Figure[2](https://arxiv.org/html/2609.36399#S1.F2)\)\. Because the absolute position of VSM scores depends on constants that are not published for the reference countries\([Bulté and Rigouts Terryn, 2026](https://arxiv.org/html/2609.36399#bib.bib4)\), every measure compares two of JEV’s own profiles, so that the constants cancel\. Each of the 1,200 prompts was sent 30 times under eight ways of formulating the request, 288,000 answers in total\.

Our contributions are:

- •the first audit of the cultural values of a decision\-only model, in English and Arabic, with constant\-free measures of the national difference and of the default profile;
- •evidence that JEV’s answers follow the human Saudi–US difference in direction and in 87% of its size in English but 62% in Arabic, that the language of the items rather than of the persona description carries this gap, and that age and gender shift the profiles in stereotyped ways;
- •a robustness analysis over eight request designs that separates findings that depend on how the model is asked from those that do not, including the effect of errors in a translated answer scale\.

## 2Related Work

#### Survey\-based cultural evaluation\.

Studies of cultural values in language models administer value surveys and compare the answers with national results, using Hofstede’s dimensions\([Cao et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib9);[Tao et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib12);[Masoud et al\., 2025](https://arxiv.org/html/2609.36399#bib.bib10)\)or the World Values Survey and related opinion polls\([Santurkar et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib17);[Durmus et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib18);[AlKhamissi et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib11)\)\. Recurring findings are that answers resemble those of the United States or other Western countries\([Cao et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib9);[Durmus et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib18);[Tao et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib12)\), also when the question is asked in another language\([Wang et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib15)\); that naming a country or using its language moves the answers only partway towards it\([Durmus et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib18);[AlKhamissi et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib11);[Tao et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib12)\); and that answers given for a group can reproduce stereotypes\([Durmus et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib18)\)\. In Arabic contexts, models favour Western entities and norms\([Naous et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib13)\), and GPT\-4’s answers to the VSM 2013 matched Chinese values better than American or Arab ones\([Masoud et al\., 2025](https://arxiv.org/html/2609.36399#bib.bib10)\)\. We use the same family of instruments, but for a model that does not generate text\.

#### Validity of survey measurement\.

Forced\-choice answers from language models can differ from their unconstrained responses and change with small variations of the prompt\([Röttger et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib14)\)\. For the VSM, each dimension index contains a constant chosen by the researcher, so the distance between a model’s scores and published country scores is not identified\([Bulté and Rigouts Terryn, 2026](https://arxiv.org/html/2609.36399#bib.bib4)\)\. Lacking these constants,[Masoud et al\. \(2025\)](https://arxiv.org/html/2609.36399#bib.bib10)compared the order of countries on each dimension with the order of their published scores instead\. We therefore compare profiles measured on the same scale and vary the request design systematically\.

#### Language models as respondents\.

Conditioning a model on demographic descriptions has been proposed as a way to simulate survey samples\([Argyle et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib16)\), while other work shows that model opinions match some groups better than others and that steering towards a group succeeds only in part\([Santurkar et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib17)\)\. Pluralistic alignment methods aim to represent several cultures at once\([Yuan et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib19)\)\.

#### JEV\.

JEV is a proprietary model released by TypeSafe AI in September 2026 as the first of what the company calls “System One” models, named after the fast, intuitive mode of thinking described by[Kahneman \(2011\)](https://arxiv.org/html/2609.36399#bib.bib20)\([TypeSafe AI, 2026](https://arxiv.org/html/2609.36399#bib.bib1)\)\. It does not generate text\. Given a context, the*state*, it answers typed questions: a Choice question returns a probability for each of up to 255 named options, a Score question a probability for each of two to ten ordered levels, and a yes/no question the probability of yes\. All probabilities are produced in a single non\-autoregressive pass, and each answer carries a confidence value\. TypeSafe trains the model with what it calls reinforcement learning for calibrated decisions, positions it as a fast and inexpensive decision component for software, and notes that it is trained mainly on English and is less accurate in other languages\.[Li et al\. \(2026\)](https://arxiv.org/html/2609.36399#bib.bib2)found it within three points of a frontier judge on preference and factuality judgements, and weaker where a judgement requires checking a derivation, at a fraction of a percent of the cost\.[Li \(2026\)](https://arxiv.org/html/2609.36399#bib.bib3)used it to predict how described respondents would answer in population experiments, with English text only\. Neither study examined cultural values or Arabic\.

## 3Experimental Setup

### 3\.1The Model

#### Typed questions and answers\.

We used two of JEV’s question types\. A*Choice*question lists named options with descriptions; its answer gives the most probable option, a probability for every option and a confidence value between 0 and 1 derived from the shape of the distribution\. A*Score*question lists ordered levels and returns a probability for each\. The state can be text or a JSON object, questions in one request are answered independently, and the model has no temperature or seed parameter\([TypeSafe AI, 2026](https://arxiv.org/html/2609.36399#bib.bib1)\)\.

#### Access\.

We sent all requests to TypeSafe’s API and asked explicitly for versionjev\-1\.13\.0, which every response reported\. The data were collected on 28 and 29 September 2026\. Probabilities are returned with two decimals; we renormalised them to sum to one\. Cost and software are listed in Appendix[G](https://arxiv.org/html/2609.36399#A7)\.

### 3\.2Instrument and Reference Values

#### VSM 2013\.

We used the 24 content items of the VSM 2013, each answered on a five\-point scale, and computed the six dimension indices \(power distance, individualism, masculinity, uncertainty avoidance, long\-term orientation, indulgence\) with the manual’s formulas \(Appendix[A](https://arxiv.org/html/2609.36399#A1)\)\.

#### Human references\.

We used Hofstede’s scores for Saudi Arabia and the United States\([Hofstede et al\., 2010](https://arxiv.org/html/2609.36399#bib.bib5)\)and, as an alternative Saudi profile, the VSM 2013 scores of[Almutairi et al\. \(2021\)](https://arxiv.org/html/2609.36399#bib.bib8)\. With Hofstede’s scores, the human Saudi\-minus\-US difference𝐡\\mathbf\{h\}is a vector of length 94\.3 \(Appendix[A](https://arxiv.org/html/2609.36399#A1)\)\.

#### Constant\-free comparisons\.

Each index contains an additive constant chosen by the researcher, and the constants behind published country scores are not reported, so the absolute distance between a model’s indices and a country’s scores is not identified\([Bulté and Rigouts Terryn, 2026](https://arxiv.org/html/2609.36399#bib.bib4)\)\. All our measures compare two profiles on the same scale, so the constants cancel\.

### 3\.3Personas, Prompts and Languages

#### Matched personas\.

For each country, a persona names the country alone, the country with a gender \(female, male\) or an age group \(young, middle\-aged, elder\), or the country with both\. The resulting 12 demographic profiles are the same for Saudi Arabia and the United States, so Saudi and American personas can be compared in matched pairs\. A baseline asks the items without a persona\.

#### Prompts\.

English items follow the official VSM 2013 wording, recast as questions \(“In choosing an ideal job, how important would it be to you to have sufficient time for your personal or home life?”\); Arabic items follow the official Arabic translation\([Hofstede and Minkov, 2013b](https://arxiv.org/html/2609.36399#bib.bib7)\), recast in the same way\. A check against the official Arabic questionnaire found three deviations in the answer options and opening line of items 15 to 20 in our first runs; we corrected them and asked these items again in every set\-up \(Appendix[C](https://arxiv.org/html/2609.36399#A3)\)\.

#### Repetitions\.

With 25 persona conditions, two languages and 24 items there are 1,200 prompts\. Each was sent 30 times in each of the eight set\-ups, giving 36,000 answers per set\-up\.

### 3\.4Request Set\-ups

JEV has no system and user roles, so a persona prompt can be passed to it in several ways \(Table[1](https://arxiv.org/html/2609.36399#S3.T1); texts in Appendix[B](https://arxiv.org/html/2609.36399#A2)\)\.

#### Documented set\-up\.

Our headline set\-up follows TypeSafe’s recommendation to give content as named fields of the state and the task in the question\. The state is\{"respondent": "a young female from Saudi Arabia"\}, and a Choice question contains the item wording with the note “Answer as the respondent described in ‘respondent‘ would answer” and the five answer labels as options\.

#### LLM\-style prompt and variations\.

Set\-up 2 passes a conventional persona prompt unchanged: the system prompt \(“Imagine you are a young female from Saudi Arabia\. Answer the following question from your perspective as a person from this cultural background\.”, followed by a format sentence\) as the state, and the user prompt, with the numbered options and the item, as the question\. Set\-ups 3 to 7 each change one element: they drop the format sentence, use a Score question with the levels in questionnaire or reverse order, describe the respondent in the third person and ask which answer they would choose, as in population experiments with JEV\([Li, 2026](https://arxiv.org/html/2609.36399#bib.bib3)\), or send the 24 items of a persona as 24 questions in one request\.

#### Language cross\.

Set\-up 8 takes the system prompt from the other language, so that English framing meets Arabic items and Arabic framing meets English items\.

Table 1:The eight request set\-ups\. Each covers the 1,200 prompts, each sent 30 times\.

### 3\.5Measures

#### Answers and profiles\.

For each call we computed the expected answerE=∑kk​pkE=\\sum\_\{k\}k\\,p\_\{k\}from the probabilitiesp1,…,p5p\_\{1\},\\dots,p\_\{5\}, averagedEEover the 30 calls of each prompt and computed the six indices for every persona condition and language\.

#### National difference\.

For each of the 12 demographic profilesiiand each language,𝐝i\\mathbf\{d\}\_\{i\}is the index vector of the Saudi persona minus that of the American persona\. From the mean𝐝¯\\bar\{\\mathbf\{d\}\}we computed the share of the human difference reproduced along its direction and the direction cosine,

s=𝐝¯⋅𝐡∥𝐡∥2,cos=𝐝¯⋅𝐡∥𝐝¯∥​∥𝐡∥\.s=\\frac\{\\bar\{\\mathbf\{d\}\}\\cdot\\mathbf\{h\}\}\{\\lVert\\mathbf\{h\}\\rVert^\{2\}\},\\qquad\\cos=\\frac\{\\bar\{\\mathbf\{d\}\}\\cdot\\mathbf\{h\}\}\{\\lVert\\bar\{\\mathbf\{d\}\}\\rVert\\,\\lVert\\mathbf\{h\}\\rVert\}\.A share of 100% is a difference of the human size in the human direction\.

#### Default position\.

The no\-persona profile𝐛\\mathbf\{b\}is placed between JEV’s own American and Saudi personas, with mean profiles𝐮¯\\bar\{\\mathbf\{u\}\}and𝐬¯\\bar\{\\mathbf\{s\}\}, byt=\(𝐛−𝐮¯\)⋅\(𝐬¯−𝐮¯\)/∥𝐬¯−𝐮¯∥2t=\(\\mathbf\{b\}\-\\bar\{\\mathbf\{u\}\}\)\\cdot\(\\bar\{\\mathbf\{s\}\}\-\\bar\{\\mathbf\{u\}\}\)/\\lVert\\bar\{\\mathbf\{s\}\}\-\\bar\{\\mathbf\{u\}\}\\rVert^\{2\}: 0 means that the default resembles the American personas, 1 the Saudi personas\.

#### Gender, age and detail\.

Female\-minus\-male differences compare personas matched on country, language and age \(four pairs per country and language\); elder\-minus\-young differences are matched on gender \(three pairs\)\. The sharessis also computed separately for country\-only personas and for personas with one or two further attributes\.

#### Confidence and reliability\.

Confidence is averaged over the 30 calls of each prompt and compared across matched prompts\. Test–retest reliability is the one\-way intraclass correlation ofEEacross the 30 calls\.

#### Rank agreement\.

We also applied the rank test of[Masoud et al\. \(2025\)](https://arxiv.org/html/2609.36399#bib.bib10), which asks whether a model orders countries on each dimension as their human scores do, using Kendall’sτ\\tauand the share of dimensions out of order\. With two countries, the order on a dimension is the sign of the Saudi\-minus\-US difference, soτ\\tauis\+1\+1or−1\-1for each dimension; we report the number of dimensions in the human order,kk, and the meanτ=\(2​k−6\)/6\\tau=\(2k\-6\)/6\. As in their model\-level comparison, we also let the language stand for the country and compared the no\-persona profile in Arabic with that in English\. The constants do not affect the order of two countries on a dimension\.

### 3\.6Statistical Analysis

Repeated calls return nearly identical answers and are not independent observations, so matched personas are the units of replication\. Intervals for dimension differences are 95%tt\-intervals across matched profiles or pairs; intervals for shares and their differences are percentile intervals from 4,000 bootstrap resamples of the 12 matched profiles\. Confidence differences are tested with Wilcoxon signed\-rank tests over matched prompts\. The analysis is exploratory and was not pre\-registered; as a safeguard, every finding was re\-estimated in all eight set\-ups\.

## 4Results

Unless stated otherwise, results are for the documented set\-up\.

### 4\.1Reliability

JEV’s answers were highly repeatable\. The intraclass correlation of the expected answer over 30 calls was 0\.997 in the documented set\-up and between 0\.995 and 0\.998 in the others, the standard deviation across calls averaged 0\.03 on the five\-point scale, and the most probable option was the same in all 30 calls for 83–89% of prompts \(Appendix[D](https://arxiv.org/html/2609.36399#A4)\)\. Mean confidence ranged from 0\.49 to 0\.58 across set\-ups, with the flattest distributions for Score questions\.

### 4\.2The Default without a Persona

Without a persona, JEV answered like its own American personas: the default profile lay at 0\.08 in English and 0\.06 in Arabic on the scale from its American \(0\) to its Saudi \(1\) personas\. In 15 of the 16 combinations of set\-up and language the position lay between−0\.26\-0\.26and 0\.13 \(Appendix[E](https://arxiv.org/html/2609.36399#A5)\); with the LLM\-style prompt, the English default lay beyond the American personas \(−0\.25\-0\.25\)\. The exception was the third\-person framing in Arabic, which placed an undescribed respondent midway between the two nationalities \(0\.53\)\.

### 4\.3The Saudi–American Difference

When the persona changed from American to Saudi, JEV’s answers moved in the human direction \(Figure[3](https://arxiv.org/html/2609.36399#S4.F3)\)\. In English, its Saudi–American difference amounted to 87\.1% of the Hofstede difference \(95% CI 80\.5–93\.9\), with a direction cosine of 0\.82; against the Saudi profile of[Almutairi et al\. \(2021\)](https://arxiv.org/html/2609.36399#bib.bib8)the share was 104\.1% \(94\.8–113\.6\)\.

Figure 3:Saudi minus American persona on the six VSM dimensions \(documented set\-up; means over the 12 matched profiles with 95% CIs\), with the human differences from Hofstede’s scores and from[Almutairi et al\. \(2021\)](https://arxiv.org/html/2609.36399#bib.bib8)\.Figure 4:Share of the human Saudi–US difference reproduced\. \(a\) By the language of the framing and of the item \(LLM\-style prompt and its language cross; 95% bootstrap intervals over matched profiles\)\. \(b\) By the detail in the persona \(documented set\-up\): country only \(one matched pair per language\), one further attribute \(five pairs\) and two \(six pairs\)\.#### By dimension\.

Four of the five dimensions on which the two countries differ came out in the human direction: Saudi personas scored higher on power distance \(\+36\.8\+36\.8; Hofstede\+55\+55\) and uncertainty avoidance \(\+15\.5\+15\.5;\+34\+34\) and lower on individualism \(−73\.6\-73\.6;−66\-66\) and indulgence \(−43\.2\-43\.2;−16\-16\)\. Masculinity, on which the countries barely differ \(−2\-2\), showed a small positive difference \(\+9\.6\+9\.6\)\.

#### Long\-term orientation\.

Saudi personas scored 33\.0 points lower on long\-term orientation \(−40\.6\-40\.6to−25\.4\-25\.4\), whereas Hofstede’s Saudi profile is 10 points higher\. The VSM index counts greater importance of doing a service to a friend and greater national pride towards short\-term orientation, and JEV’s Saudi personas gave both: on the 1–5 answer scale, their answers were 0\.48 points lower \(more important\) on the service item in both languages and 0\.77 \(English\) and 0\.84 \(Arabic\) points lower \(prouder\) on national pride\.

### 4\.4Language

Figure 5:Gender \(a\) and age \(b\) differences within Saudi and American personas \(documented set\-up; means over matched pairs in both languages, 8 gender and 6 age pairs per nationality, with 95% CIs\)\. The two panels use different scales\.In Arabic, JEV reproduced 62\.0% of the Hofstede difference \(56\.3–67\.9; cosine 0\.80\), 25\.1 points less than in English \(−31\.0\-31\.0to−20\.6\-20\.6\)\. The direction held on every dimension, but the gap narrowed on power distance \(\+26\.0\+26\.0\), individualism \(−54\.1\-54\.1\) and uncertainty avoidance \(\+5\.2\+5\.2\)\.

#### Item language, not framing\.

The language cross separated the two sources \(Figure[4](https://arxiv.org/html/2609.36399#S4.F4)a; LLM\-style prompt\)\. With English items, the share was 103\.5% under English framing and 97\.2% under Arabic framing; with Arabic items, it was 71\.6% and 70\.2%\. Averaged over framings, an Arabic item lowered the share by 29\.5 points \(26\.1–33\.1\), whereas an Arabic framing changed it by−3\.9\-3\.9points \(−8\.9\-8\.9to 1\.5\)\.

#### By item\.

The national difference disappeared in Arabic for two agree–disagree statements, on avoiding two bosses and on never breaking an organisation’s rules \(English−0\.30\-0\.30and−0\.54\-0\.54on the answer scale; Arabic0\.000\.00and−0\.06\-0\.06; Appendix[F](https://arxiv.org/html/2609.36399#A6)\)\.

#### Persona detail\.

More detail in the persona weakened the national difference in both languages \(Figure[4](https://arxiv.org/html/2609.36399#S4.F4)b\): in English from 95\.7% for country\-only personas to 88\.1% with gender or age and 84\.9% with both; in Arabic from 81\.4% to 63\.7% and 57\.3%\.

### 4\.5Gender and Age

Female Saudi personas were more individualist \(\+19\.0\+19\.0, 15\.1–22\.9; 8 of 8 matched pairs\), less masculine \(−16\.7\-16\.7; 8 of 8\) and less indulgent \(−20\.2\-20\.2; 7 of 8\) than male Saudi personas \(Figure[5](https://arxiv.org/html/2609.36399#S4.F5)\)\. Among American personas the gender pattern was weaker \(individualism\+8\.9\+8\.9, masculinity−11\.3\-11\.3\) and absent for indulgence \(−1\.6\-1\.6\)\. Age changed the profiles more, and alike for both nationalities: elder Saudi personas scored higher than young ones on power distance \(\+27\.4\+27\.4\) and uncertainty avoidance \(\+32\.9\+32\.9\) and lower on individualism \(−57\.6\-57\.6\), masculinity \(−87\.7\-87\.7\) and indulgence \(−49\.6\-49\.6\), each in 6 of 6 pairs, with similar values for American personas\. The age gap in individualism was as large as the national gap \(−73\.6\-73\.6in English,−54\.1\-54\.1in Arabic\), and the age gap in masculinity exceeded any national difference\.

### 4\.6Confidence

JEV was less confident in Arabic, by 0\.090 \(English higher in 72% of 600 matched prompts; Wilcoxonp=3\.3×10−33p=3\.3\\times 10^\{\-33\}\), and for Saudi personas, by 0\.024 \(American higher in 58% of 576 matched prompts;p=4\.4×10−5p=4\.4\\times 10^\{\-5\}\)\. The gap between American and Saudi personas appeared in all eight set\-ups and the gap between English and Arabic in seven\. The exception, the language cross, gave higher confidence to Arabic items under English framing than to English items under Arabic framing: confidence followed the language of the framing, whereas the national difference followed the language of the items\. Confidence was lowest for the agree–disagree items on managers \(0\.35\) and on rules \(0\.38\) and highest for how often one feels nervous or tense \(0\.75\)\.

### 4\.7Robustness to Request Design

The set\-up changed the size of the effects but not their direction \(Figure[6](https://arxiv.org/html/2609.36399#S4.F6); Appendix[E](https://arxiv.org/html/2609.36399#A5)\)\. The English share ranged from 87\.1% to 106\.8% and the Arabic share from 42\.1% \(third person\) to 72\.2%\. In every set\-up the Arabic share was smaller than the English share, the English difference pointed in the human direction \(cosine 0\.82–0\.85\), female Saudi personas were more individualist and less masculine than male ones, elder Saudi personas scored higher on power distance and lower on individualism than young ones, and confidence was lower for Saudi personas\. Sending the 24 items in one request left the results practically unchanged \(English 103\.8% against 103\.5%, Arabic 69\.9% against 70\.2%\)\. The Arabic answer options mattered as well: with the deviating options of our first runs, the Arabic share was 42\.7% instead of 62\.0%, and the power\-distance difference had the wrong sign \(−10\.5\-10\.5instead of\+26\.0\+26\.0; Appendix[C](https://arxiv.org/html/2609.36399#A3)\)\.

### 4\.8Rank Agreement

In the rank test of[Masoud et al\. \(2025\)](https://arxiv.org/html/2609.36399#bib.bib10), JEV ordered Saudi Arabia and the United States as Hofstede’s scores do on four of the six dimensions in both languages: power distance, individualism, uncertainty avoidance and indulgence, but not masculinity or long\-term orientation \(meanτ=0\.33\\tau=0\.33; 33% of dimensions mis\-ranked\)\. The profile of[Almutairi et al\. \(2021\)](https://arxiv.org/html/2609.36399#bib.bib8)gives the same result, as its differences have the same signs\. Across set\-ups, four or five dimensions were in order in English and four in Arabic \(Figure[6](https://arxiv.org/html/2609.36399#S4.F6); Table[8](https://arxiv.org/html/2609.36399#A5.T8)\)\. Long\-term orientation was out of order in every set\-up and language, and masculinity, on which Hofstede’s scores differ by 2 points, in all eight set\-ups in Arabic and in five in English\. No matched profile had all six dimensions in order in any set\-up\. Without a persona, the language alone did not produce the national order: the Arabic profile differed from the English one in the human direction on one dimension in the documented set\-up \(individualism;τ=−0\.67\\tau=\-0\.67\) and on three or four in the others\.

Figure 6:Rank test by set\-up\. Bars: Saudi minus American persona on each dimension \(means over the 12 matched profiles with 95% CIs\); black lines: the Hofstede difference\. A bar on the other side of zero from its line marks a dimension on which JEV orders the two countries differently from Hofstede’s scores\. Top right: dimensions in Hofstede’s order, of six\. PDI: power distance, IDV: individualism, MAS: masculinity, UAI: uncertainty avoidance, LTO: long\-term orientation, IVR: indulgence\. \*English and Arabic refer to the items; the framing is in the other language\.

## 5Discussion

### 5\.1Cultural Patterns without Text Generation

JEV shows patterns that have been reported for generative models: an American default, movement towards a named country, a weaker national difference in a language other than English, and stereotyped answers for demographic groups\([Durmus et al\., 2023](https://arxiv.org/html/2609.36399#bib.bib18);[Tao et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib12);[AlKhamissi et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib11);[Wang et al\., 2024](https://arxiv.org/html/2609.36399#bib.bib15)\)\. In JEV these patterns arise without decoding, sampling or refusals\. This suggests that they reside in what the model has learned about groups, languages and survey items rather than in the generation of text, and that replacing generation with calibrated decisions does not by itself remove them\.

### 5\.2Language: the Question, Not the Persona

The language cross places the Arabic effect in the item wording \(−29\.5\-29\.5points\) rather than in the language of the persona description \(−3\.9\-3\.9\)\. The largest item\-level losses were in agree–disagree statements about organisational hierarchy and rules, which suggests that the Arabic formulations of these statements carry less of the national contrast than their English counterparts\. For multilingual evaluation this means that the translation of the items, not only the language of the prompt, is part of what is measured\. Nor did the language stand in for the culture: without a persona, Arabic items did not move JEV towards the Saudi order, a caution for comparisons that let the prompt language represent a country\([Masoud et al\., 2025](https://arxiv.org/html/2609.36399#bib.bib10)\)\. Our first runs illustrate the stakes: deviating answer options in three Arabic items reversed the sign of the power\-distance difference\.

### 5\.3Personas as Population Proxies

Age shifted JEV’s profiles about as much as nationality, gender shifted them in stereotyped directions, and adding either attribute diluted the national difference \(in English from 96% to 85%, in Arabic from 81% to 57%\)\. Population experiments that condition JEV on several demographic attributes\([Li, 2026](https://arxiv.org/html/2609.36399#bib.bib3)\)should therefore expect the national signal to weaken as attributes are added, and age to carry stereotyped contrasts, such as a masculinity gap between elder and young personas larger than any national difference\. The larger gender contrast for Saudi than for American personas is a further stereotype that simulated Saudi samples would inherit\.

### 5\.4Confidence as a Signal

JEV was less confident in Arabic and for Saudi personas, and its confidence followed the language of the framing rather than of the items\. Lower confidence in these contexts could help to flag answers that rest on less evidence\. It does not show that the model is calibrated to the diversity of real respondents: a value question has no correct option, and confidence measures the model’s certainty, not the agreement among people\. Testing whether JEV’s probabilities match the answer distributions of Saudi respondents, for example in the World Values Survey or the Arab Barometer, is the natural next step\.

## 6Conclusion

We audited the cultural values of a decision\-only model with the VSM 2013, matched Saudi and American personas, two languages and eight request designs\. JEV’s answers are highly repeatable, American by default and responsive to nationality: in English they reproduce most of the human Saudi–US difference in its direction, and in Arabic less, because of the item wording rather than the language of the persona\. Age and gender shift the profiles in stereotyped ways, and confidence is lower in Arabic and for Saudi personas\. These findings hold across request designs\. A model that never writes text is thus not free of the cultural patterns known from generative models, and using it as a stand\-in for respondents calls for the same scrutiny\.

## Limitations

We studied one model in one version, whose training data and objectives are not public; later versions may behave differently\. JEV is trained mainly on English, and our Arabic results rest on the official translation of a single questionnaire\. The human references are country\-level index scores for two countries rather than answer distributions, so we can compare the direction and size of national differences but not the spread of opinions within a country\. With two countries, the rank test reduces to the sign of each difference and counts a near\-tie, such as the 2\-point gap in masculinity, as fully as a large difference\. The personas are short text labels combining nationality, gender and age\. The analysis is exploratory and was not pre\-registered; we re\-estimated each finding under eight request designs, but other formulations may give other effect sizes\. Finally, the scoring constants of the VSM rule out absolute comparisons with country scores: our constant\-free measures avoid the problem but do not replace a comparison with individual\-level human data\.

## Ethical Considerations

The study involves no human participants\. Asking a model to answer as members of national, gender and age groups elicits stereotyped portrayals; we report them to document the risk, not to endorse them, and we caution against using such outputs as substitutes for the views of the groups concerned\. The prompts, all responses and the analysis code will be released to allow verification\.

## References

- B\. AlKhamissi, M\. ElNokrashy, M\. AlKhamissi, and M\. DiabInvestigating cultural alignment of large language models\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 12404–12422\.External Links:[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.671)Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p1.1),[§1](https://arxiv.org/html/2609.36399#S1.p3.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1),[§5\.1](https://arxiv.org/html/2609.36399#S5.SS1.p1.1)\.
- Almutairiet al\.\(2021\)S\. Almutairi, M\. Heller, and D\. YenReclaiming the heterogeneity of the Arab states\.Cross Cultural & Strategic Management28\(1\),pp\. 158–176\.External Links:[Document](https://dx.doi.org/10.1108/CCSM-09-2019-0170)Cited by:[Table 2](https://arxiv.org/html/2609.36399#A1.T2),[Table 8](https://arxiv.org/html/2609.36399#A5.T8),[§3\.2](https://arxiv.org/html/2609.36399#S3.SS2.SSS0.Px2.p1.1),[Figure 3](https://arxiv.org/html/2609.36399#S4.F3),[§4\.3](https://arxiv.org/html/2609.36399#S4.SS3.p1.1),[§4\.8](https://arxiv.org/html/2609.36399#S4.SS8.p1.1)\.
- Argyleet al\.\(2023\)L\. P\. Argyle, E\. C\. Busby, N\. Fulda, J\. R\. Gubler, C\. Rytting, and D\. WingateOut of one, many: using language models to simulate human samples\.Political Analysis31\(3\),pp\. 337–351\.External Links:[Document](https://dx.doi.org/10.1017/pan.2023.2)Cited by:[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px3.p1.1)\.
- Bulté and Rigouts Terryn \(2026\)B\. Bulté and A\. Rigouts TerrynLLMs and cultural values: the impact of prompt language and explicit cultural framing\.Computational Linguistics52\(2\)\.External Links:[Document](https://dx.doi.org/10.1162/COLI.a.583)Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p4.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px2.p1.1),[§3\.2](https://arxiv.org/html/2609.36399#S3.SS2.SSS0.Px3.p1.1)\.
- Caoet al\.\(2023\)Y\. Cao, L\. Zhou, S\. Lee, L\. Cabello, M\. Chen, and D\. HershcovichAssessing cross\-cultural alignment between ChatGPT and human societies: an empirical study\.InProceedings of the First Workshop on Cross\-Cultural Considerations in NLP \(C3NLP\),pp\. 53–67\.External Links:[Document](https://dx.doi.org/10.18653/v1/2023.c3nlp-1.7)Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1)\.
- Durmuset al\.\(2023\)E\. Durmus, K\. Nguyen, T\. I\. Liao, N\. Schiefer, A\. Askell, A\. Bakhtin, C\. Chen, Z\. Hatfield\-Dodds, D\. Hernandez, N\. Joseph, L\. Lovitt, S\. McCandlish, O\. Sikder, A\. Tamkin, J\. Thamkul, J\. Kaplan, J\. Clark, and D\. GanguliTowards measuring the representation of subjective global opinions in language models\.Note:arXiv:2306\.16388Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1),[§5\.1](https://arxiv.org/html/2609.36399#S5.SS1.p1.1)\.
- Hofstedeet al\.\(2010\)G\. Hofstede, G\. J\. Hofstede, and M\. MinkovCultures and organizations: software of the mind\.3 edition,McGraw\-Hill,New York\.Cited by:[§3\.2](https://arxiv.org/html/2609.36399#S3.SS2.SSS0.Px2.p1.1)\.
- Hofstede and Minkov \(2013a\)G\. Hofstede and M\. MinkovValues survey module 2013 manual\.Note:[https://geerthofstede\.com/research\-and\-vsm/vsm\-2013/](https://geerthofstede.com/research-and-vsm/vsm-2013/)Cited by:[Appendix A](https://arxiv.org/html/2609.36399#A1.p1.1),[§1](https://arxiv.org/html/2609.36399#S1.p4.1)\.
- Hofstede and Minkov \(2013b\)G\. Hofstede and M\. MinkovValues survey module 2013: Arabic version\.Note:[https://geerthofstede\.com/research\-and\-vsm/vsm\-2013/](https://geerthofstede.com/research-and-vsm/vsm-2013/)Cited by:[Appendix C](https://arxiv.org/html/2609.36399#A3.p1.1),[§3\.3](https://arxiv.org/html/2609.36399#S3.SS3.SSS0.Px2.p1.1)\.
- Kahneman \(2011\)D\. KahnemanThinking, fast and slow\.Farrar, Straus and Giroux,New York\.Cited by:[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px4.p1.1)\.
- Li \(2026\)H\. LiKITE: scaling Jev population experiments with sparse flagship calibration\.Note:arXiv:2609\.27535Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p2.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px4.p1.1),[§3\.4](https://arxiv.org/html/2609.36399#S3.SS4.SSS0.Px2.p1.1),[§5\.3](https://arxiv.org/html/2609.36399#S5.SS3.p1.1)\.
- Liet al\.\(2026\)Y\. Li, Y\. Miao, R\. Krishnan, and R\. PadmanJEV\-as\-a\-Judge: accept when confident, escalate when unsure\.Note:arXiv:2609\.26550Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p2.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px4.p1.1)\.
- Masoudet al\.\(2025\)R\. I\. Masoud, Z\. Liu, M\. Ferianc, P\. Treleaven, and M\. RodriguesCultural alignment in large language models: an explanatory analysis based on Hofstede’s cultural dimensions\.InProceedings of the 31st International Conference on Computational Linguistics,Abu Dhabi, UAE,pp\. 8474–8503\.External Links:[Link](https://aclanthology.org/2025.coling-main.567/)Cited by:[Table 8](https://arxiv.org/html/2609.36399#A5.T8),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px2.p1.1),[§3\.5](https://arxiv.org/html/2609.36399#S3.SS5.SSS0.Px6.p1.1),[§4\.8](https://arxiv.org/html/2609.36399#S4.SS8.p1.1),[§5\.2](https://arxiv.org/html/2609.36399#S5.SS2.p1.1)\.
- Naouset al\.\(2024\)T\. Naous, M\. J\. Ryan, A\. Ritter, and W\. XuHaving beer after prayer? measuring cultural bias in large language models\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 16366–16393\.External Links:[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.862)Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p3.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1)\.
- Röttgeret al\.\(2024\)P\. Röttger, V\. Hofmann, V\. Pyatkin, M\. Hinck, H\. Kirk, H\. Schuetze, and D\. HovyPolitical compass or spinning arrow? towards more meaningful evaluations for values and opinions in large language models\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 15295–15311\.External Links:[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.816)Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px2.p1.1)\.
- Santurkaret al\.\(2023\)S\. Santurkar, E\. Durmus, F\. Ladhak, C\. Lee, P\. Liang, and T\. HashimotoWhose opinions do language models reflect?\.Note:arXiv:2303\.17548Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px3.p1.1)\.
- Taoet al\.\(2024\)Y\. Tao, O\. Viberg, R\. S\. Baker, and R\. F\. KizilcecCultural bias and cultural alignment of large language models\.PNAS Nexus3\(9\)\.External Links:[Document](https://dx.doi.org/10.1093/pnasnexus/pgae346)Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p1.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1),[§5\.1](https://arxiv.org/html/2609.36399#S5.SS1.p1.1)\.
- TypeSafe AI \(2026\)TypeSafe AIIntroducing System One models and Jev\.Note:[https://typesafe\.ai/blog/introducing\-system\-one\-models\-and\-jev](https://typesafe.ai/blog/introducing-system-one-models-and-jev)API documentation at[https://docs\.typesafe\.ai](https://docs.typesafe.ai/)\. Accessed 28 September 2026Cited by:[§1](https://arxiv.org/html/2609.36399#S1.p2.1),[§1](https://arxiv.org/html/2609.36399#S1.p3.1),[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px4.p1.1),[§3\.1](https://arxiv.org/html/2609.36399#S3.SS1.SSS0.Px1.p1.1)\.
- Wanget al\.\(2024\)W\. Wang, W\. Jiao, J\. Huang, R\. Dai, J\. Huang, Z\. Tu, and M\. LyuNot all countries celebrate thanksgiving: on the cultural dominance in large language models\.InProceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),pp\. 6349–6384\.External Links:[Document](https://dx.doi.org/10.18653/v1/2024.acl-long.345)Cited by:[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px1.p1.1),[§5\.1](https://arxiv.org/html/2609.36399#S5.SS1.p1.1)\.
- Yuanet al\.\(2024\)J\. Yuan, Z\. Di, S\. Zhao, Z\. Cui, H\. Wang, G\. Yang, and U\. NaseemCultural palette: pluralising culture alignment via multi\-agent palette\.Note:arXiv:2412\.11167Cited by:[§2](https://arxiv.org/html/2609.36399#S2.SS0.SSS0.Px3.p1.1)\.

## Appendix AVSM 2013 Scoring and Reference Values

The six indices are the following sums, each plus a constantCCchosen by the researcher\([Hofstede and Minkov, 2013a](https://arxiv.org/html/2609.36399#bib.bib6)\):

PDI=35​\(m7−m2\)\+25​\(m20−m23\),\\displaystyle=35\(m\_\{7\}\-m\_\{2\}\)\+25\(m\_\{20\}\-m\_\{23\}\),IDV=35​\(m4−m1\)\+35​\(m9−m6\),\\displaystyle=35\(m\_\{4\}\-m\_\{1\}\)\+35\(m\_\{9\}\-m\_\{6\}\),MAS=35​\(m5−m3\)\+35​\(m8−m10\),\\displaystyle=35\(m\_\{5\}\-m\_\{3\}\)\+35\(m\_\{8\}\-m\_\{10\}\),UAI=40​\(m18−m15\)\+25​\(m21−m24\),\\displaystyle=40\(m\_\{18\}\-m\_\{15\}\)\+25\(m\_\{21\}\-m\_\{24\}\),LTO=40​\(m13−m14\)\+25​\(m19−m22\),\\displaystyle=40\(m\_\{13\}\-m\_\{14\}\)\+25\(m\_\{19\}\-m\_\{22\}\),IVR=35​\(m12−m11\)\+40​\(m17−m16\),\\displaystyle=35\(m\_\{12\}\-m\_\{11\}\)\+40\(m\_\{17\}\-m\_\{16\}\),wheremkm\_\{k\}is the mean answer to itemkk\. Every measure in this paper is a difference between two profiles or a ratio of such differences, so the constantsCCcancel\. Table[2](https://arxiv.org/html/2609.36399#A1.T2)lists the reference scores\.

Table 2:Reference scores: Hofstede’s Saudi Arabia \(SA\) and United States \(US\) profiles and the Saudi profile of[Almutairi et al\. \(2021\)](https://arxiv.org/html/2609.36399#bib.bib8)\(Alm\.\), with the human Saudi\-minus\-US differences\.
## Appendix BPrompts and Requests

The English texts are given in Section[3\.4](https://arxiv.org/html/2609.36399#S3.SS4)and Table[1](https://arxiv.org/html/2609.36399#S3.T1)\. Table[3](https://arxiv.org/html/2609.36399#A2.T3)gives the Arabic wording of the persona prompt and of the texts written for set\-ups 1 and 6, and Figure[7](https://arxiv.org/html/2609.36399#A2.F7)shows a complete request in the documented set\-up\.

Table 3:English and Arabic wording of the persona prompt \(set\-up 2\) and of the texts written for set\-ups 1 and 6\. Brackets and ellipses mark where the persona description, the format sentence or the statement is inserted; the Arabic prompts use Arabic persona descriptions\.```
POST https://api.typesafe.ai/v1/systemone
{
  "model": "jev-1.13.0",
  "state": {"respondent": "a young female from Saudi Arabia"},
  "questions": {"answer": {
    "type": "choice",
    "instructions": {
      "question": "In choosing an ideal job, how important would it be to you
                   to have sufficient time for your personal or home life?",
      "note": "Answer as the respondent described in ‘respondent‘ would answer."},
    "criteria": {"1": "of utmost importance", "2": "very important",
                 "3": "of moderate importance", "4": "of little importance",
                 "5": "of very little or no importance"}}}
}
```

Figure 7:A request in the documented set\-up \(item 1, English\)\. The response gives the most probable option, a probability for each option and a confidence value\.
## Appendix CCorrection of the Arabic Questionnaire

A check of the Arabic prompts of our first runs against the official Arabic VSM 2013 questionnaire\([Hofstede and Minkov, 2013b](https://arxiv.org/html/2609.36399#bib.bib7)\)found three deviations \(Table[4](https://arxiv.org/html/2609.36399#A3.T4)\)\. Items 18 \(state of health\) and 19 \(national pride\) offered the frequency options of items 15 to 17 instead of their own scales\. Item 20 \(how often subordinates are afraid to contradict their boss\) listed its options in reverse order, so that its codes ran opposite to the English version and to the scoring formula\. Items 15 to 20 opened with a line asking the respondent to “determine the degree of importance of the topic below”, which suits items 1 to 14 but not these items and which the official questionnaire does not have for them\. We replaced the options of items 18 to 20 with the official ones and removed the opening line from items 15 to 20, leaving the item wording unchanged, and asked the Arabic items 15 to 20 again in every set\-up \(in the batched set\-up, the complete Arabic questionnaires, so that every request still held 24 items\)\. All results use the corrected answers; Table[5](https://arxiv.org/html/2609.36399#A3.T5)compares them with the first runs\.

Table 4:Arabic items 15 to 20 in our first runs and after the correction\. The item wording was not changed\. Options are listed from 1 to 5 \(the Arabic reads from right to left\); the English options are the official VSM 2013 wording\.Table 5:Arabic results with the answer options of the first runs and after the correction\. PDI gap: Saudi minus American persona on power distance\.
## Appendix DReliability by Set\-up

Table[6](https://arxiv.org/html/2609.36399#A4.T6)reports test–retest reliability and the shape of the answer distributions for each set\-up\.

Table 6:Test–retest reliability over the 30 calls of each prompt and the shape of JEV’s answer distributions, by set\-up \(1,200 prompts each\)\. \*Framing in the other language than the items\.
## Appendix EFindings by Set\-up

Table[7](https://arxiv.org/html/2609.36399#A5.T7)reports the share of the human difference, the default position and the confidence gaps for each set\-up, and Table[8](https://arxiv.org/html/2609.36399#A5.T8)the rank test\.

Table 7:Main findings by set\-up\. Default position: 0 = JEV’s American personas, 1 = its Saudi personas\. Confidence gaps: mean differences over matched prompts\. \*English and Arabic refer to the items; the framing is in the other language\.Table 8:Rank test of[Masoud et al\. \(2025\)](https://arxiv.org/html/2609.36399#bib.bib10)by set\-up: number of dimensions \(of six\) on which JEV orders Saudi Arabia and the United States as Hofstede’s scores do, with the mean Kendall’sτ\\tauin parentheses, and the dimensions out of order\. Personas: Saudi minus American personas \(means over the 12 matched profiles\)\. No persona: the Arabic minus the English no\-persona profile, with the language standing for the country\. The Saudi profile of[Almutairi et al\. \(2021\)](https://arxiv.org/html/2609.36399#bib.bib8)gives the same orders\. \*English and Arabic refer to the items; the framing is in the other language\.
## Appendix FAdditional Results

Table[9](https://arxiv.org/html/2609.36399#A6.T9)gives the Saudi–American differences by dimension for the LLM\-style prompt, and Table[10](https://arxiv.org/html/2609.36399#A6.T10)the item\-level differences and confidence in the documented set\-up\.

Table 9:Saudi minus American persona by dimension with the LLM\-style prompt \(means over 12 matched profiles, 95% CIs\), with the Hofstede difference\.Table 10:Item\-level results in the documented set\-up: mean difference between Saudi and American personas in the expected answer \(1–5 scale; negative = Saudi personas chose options nearer the first, e\.g\. more important or prouder\), and JEV’s mean confidence, by language\.
## Appendix GCost, Software and Reproducibility

The study used about 302,000 requests and 371,000 answers, including the re\-asked Arabic items, at a total cost of about US$7 \(US$0\.042 per million input tokens; output tokens are free\)\. Requests were sent with up to 16 in parallel per set\-up, and server errors were retried\. The analysis used Python 3\.12 with NumPy 1\.26, pandas 2\.2, SciPy 1\.16 and matplotlib 3\.10, with a fixed seed for bootstrap resampling\. The prompts, all responses and the analysis code will be released\.