Personalization, Personas, and Forecasting in Value Alignment

arXiv cs.AI Papers

Summary

This paper tests whether different prompt framings (personalization, role-play, third-person forecasting) are interchangeable in eliciting cultural values from LLMs, using the World Values Survey. Results show that prompt framing significantly affects model responses and measured cultural alignment, with third-person forecasting yielding the strongest directional alignment.

arXiv:2607.24782v1 Announce Type: new Abstract: LLM behavior may be conditioned by human identity in several ways: they may be asked to adapt to users, role-play populations, or forecast how people would answer value-laden questions. We test whether these framings are interchangeable using the World Values Survey (WVS). We evaluate GPT-5.4, Claude Sonnet 4.6, Gemini 2.5 Flash, and Qwen3-235B on 101 WVS-derived questions across 13 language-country slices, comparing a language-only baseline with user-country, persona-country, and third-person prompts. Across 21,008 model-response rows, prompt framing is a first-order determinant of cultural alignment: country cues often shift answers substantially, but not all shifts move toward matched human response distributions. Third-person forecasting yields the strongest directional alignment for three of the four hosted models, while personalization and role-play are weaker or less stable. Alignment gains concentrate on salient value dimensions such as religiosity, gender roles, and work-oriented material values, whereas institutional trust and democracy-related questions remain difficult. These results show that prompt framing is not a cosmetic choice in cultural value elicitation; it changes both model behavior and measured alignment.
Original Article
View Cached Full Text

Cached at: 07/29/26, 09:52 AM

# Personalization, Personas, and Forecasting in Value Alignment
Source: [https://arxiv.org/html/2607.24782](https://arxiv.org/html/2607.24782)
###### Abstract

LLM behavior may be conditioned by human identity in several ways: they may be asked to adapt to users, role\-play populations, or forecast how people would answer value\-laden questions\. We test whether these framings are interchangeable using the World Values Survey \(WVS\)\. We evaluate GPT\-5\.4, Claude Sonnet 4\.6, Gemini 2\.5 Flash, and Qwen3\-235B on 101 WVS\-derived questions across 13 language\-country slices, comparing a language\-only baseline with user\-country, persona\-country, and third\-person prompts\. Across 21,008 model\-response rows, prompt framing is a first\-order determinant of cultural alignment: country cues often shift answers substantially, but not all shifts move toward matched human response distributions\. Third\-person forecasting yields the strongest directional alignment for three of the four hosted models, while personalization and role\-play are weaker or less stable\. Alignment gains concentrate on salient value dimensions such as religiosity, gender roles, and work\-oriented material values, whereas institutional trust and democracy\-related questions remain difficult\. These results show that prompt framing is not a cosmetic choice in cultural value elicitation; it changes both model behavior and measured alignment\.

large language models, cultural modeling, survey response prediction, World Values Survey

\\bbl@luahyphenate\\directlua

if Babel\.locale\_mapped == nil then Babel\.locale\_mapped = true Babel\.linebreaking\.add\_before\(Babel\.locale\_map, 1\) Babel\.loc\_to\_scr = Babel\.chr\_to\_loc = Babel\.chr\_to\_loc or end Babel\.locale\_props\[2\]\.letters = false\\directluaif Babel\.script\_blocks\[’Arab’\] then Babel\.loc\_to\_scr\[2\] = Babel\.script\_blocks\[’Arab’\] Babel\.locale\_props\[2\]\.lg = 94 end\\directluaif Babel\.script\_blocks\[’Arab’\] then Babel\.loc\_to\_scr\[2\] = Babel\.script\_blocks\[’Arab’\] end\\bbl@luahyphenate\\directluaif Babel\.locale\_mapped == nil then Babel\.locale\_mapped = true Babel\.linebreaking\.add\_before\(Babel\.locale\_map, 1\) Babel\.loc\_to\_scr = Babel\.chr\_to\_loc = Babel\.chr\_to\_loc or end Babel\.locale\_props\[3\]\.letters = false\\directluaif Babel\.script\_blocks\[’Deva’\] then Babel\.loc\_to\_scr\[3\] = Babel\.script\_blocks\[’Deva’\] Babel\.locale\_props\[3\]\.lg = 75 end\\directluaif Babel\.script\_blocks\[’Deva’\] then Babel\.loc\_to\_scr\[3\] = Babel\.script\_blocks\[’Deva’\] end\\bbl@luahyphenate\\directluaif Babel\.locale\_mapped == nil then Babel\.locale\_mapped = true Babel\.linebreaking\.add\_before\(Babel\.locale\_map, 1\) Babel\.loc\_to\_scr = Babel\.chr\_to\_loc = Babel\.chr\_to\_loc or end Babel\.locale\_props\[4\]\.letters = false\\directluaif Babel\.script\_blocks\[’Cyrl’\] then Babel\.loc\_to\_scr\[4\] = Babel\.script\_blocks\[’Cyrl’\] Babel\.locale\_props\[4\]\.lg = 130 end\\directluaif Babel\.script\_blocks\[’Cyrl’\] then Babel\.loc\_to\_scr\[4\] = Babel\.script\_blocks\[’Cyrl’\] end rm\[ BoldFont = texgyretermes\-bold\.otf, ItalicFont = texgyretermes\-italic\.otf, BoldItalicFont = texgyretermes\-bolditalic\.otf \]texgyretermes\-regular\.otf \[arabic\]rm\[ BoldFont = Amiri\-Bold\.ttf, ItalicFont = Amiri\-Italic\.ttf, BoldItalicFont = Amiri\-BoldItalic\.ttf \]Amiri\-Regular\.ttf \[hindi\]rm\[ BoldFont = Eczar\-Bold\.otf \]Eczar\-Regular\.otf \[russian\]rm\[ BoldFont = DejaVuSerif\-Bold\.ttf, ItalicFont = DejaVuSerif\-Italic\.ttf, BoldItalicFont = DejaVuSerif\-BoldItalic\.ttf \]DejaVuSerif\.ttf\\setCJKmainfont\[ BoldFont = FandolSong\-Bold\.otf, ItalicFont = FandolKai\-Regular\.otf \]FandolSong\-Regular\.otf\\bbl@patterns@luaarabic\\bbl@patterns@luahindi\\bbl@patterns@luarussian

## 1Introduction

![Refer to caption](https://arxiv.org/html/2607.24782v1/images/example.png)Figure 1:An example of the four prompt conditions tested in this paper\. This is a real example showing responses supplied by GPT\-5\.4 and highlighting the most common trend in condition\-dependent directional alignment\. The WVS question text was simplified for clarity\.Large language models are increasingly deployed across countries, languages, and cultural contexts, making it important to understand not only whether their responses reflect a broad range of human values, but also how those responses change when models are given information about human identity\. This question matters both for practical deployment and for scientific evaluation: a model may be asked to adapt to an individual user, to simulate a population, or to predict how a person from a particular demographic group would answer\. These settings are closely related, but they are not identical, and treating them as interchangeable risks obscuring important differences in model behavior\.

In practical usage, one can broadly define three approaches to shaping LLM behavior with awareness of a description of a human identity\.Personalizationprovides information about the user interacting with the LLM to improve the user experience, either through a system prompt or through interactions with the user\. Apersonasets up a role play exercise, encouraging the LLM to respond as if*it is*a human with a given set of traits; this approach has been used, for example, in simulating population surveys, A/B tests, and focus groups\. Finally,forecastingasks the LLM to predict how someone from the target demographic would respond without asking it explicitly to act as if it belongs to that group; this approach may be used to study how a particular identity category is perceived and what assumptions are likely to be made about its members\.

Naïvely, one might expect consistency between these three modalities\. Consider the following example: an LLM with a persona of a woman aged 20 in the United States is queried “are you old enough to drive?”; a second LLM personalized to respond to a woman aged 20 in the United States is queried “am I old enough to drive?”; while a third LLM is asked simply “is a woman aged 20 in the United States old enough to drive?” Given the factual nature of this question, all three should respond in the same way\.

The expected outcomes are less clear in the context of value\-based questions that do not have factual answers, when simulating populations or predicting the values of users\. While a significant amount of attention\(Durmuset al\.,[2023](https://arxiv.org/html/2607.24782#bib.bib15); Taoet al\.,[2024](https://arxiv.org/html/2607.24782#bib.bib29); AlKhamissiet al\.,[2024](https://arxiv.org/html/2607.24782#bib.bib22)\)has been devoted to independently studying LLM personalization, personas, and forecasting, to our knowledge there is no work that evaluates consistency between the three\.

In this work, we use the World Values Survey \(WVS\)\(Haerpferet al\.,[2020](https://arxiv.org/html/2607.24782#bib.bib25)\)—the largest ever non\-commercial, cross\-national study of human beliefs and values— as a basis for studying consistency between persona\-based queries and personalized queries to elicit value judgments from LLMs\. Our focus is on LLM modeling of the value systems of different countries, and we study four settings: \(1\)Vanilla/Language: the survey question with no additional descriptor information, translated when applicable into the language matched to a given country; \(2\)User\-country: a prompt stating that the*user*is from the given country; \(3\)Persona\-country: a prompt asking the*model*to answer as though it were a person from the given country; and \(4\)Third\-person: a prompt asking the model to predict how a person from the given country*would answer*\. An illustrative example of these four prompt conditions is shown in Figure[1](https://arxiv.org/html/2607.24782#S1.F1)\.

It is not immediately clear what the desired behavior should be under these conditions\. For example, user\-country prompting does not explicitly ask the LLM to tailor its response, so one might expect that the responses should be the same as the vanilla case; on the other hand, a degree of conformity to perceived user opinions is likely desirable in some cases\. Even if we believe that the answers should be adjusted here, it is unclear whether language prompting should also result in modified responses relative to the English vanilla baseline: does a user merely speaking a particular language imply something about their identity and values? Meanwhile, the persona\-country and third\-person prompts, despite their differences in framing, are both asking that the LLM guess the response of an individual from a given country\. Should these responses be the same?

Regardless of one’s stance on these normative questions, several clear trends emerge in practice, largely consistently across the four models we survey\. First, country\-conditioned prompts generally move model responses more than language\-only prompts, but this movement is not always aligned with the corresponding WVS response distribution\. Second, explicit third\-person forecasting produces the clearest movement toward the matched human target for three of the four hosted models, suggesting that models are better at predicting country\-level survey responses when the task is framed as prediction rather than role play or personalization\. Third, the gains are concentrated on socially legible value dimensions such as religiosity, gender roles, security tradeoffs, and work\-oriented material values, while institutional trust and democracy\-related questions remain harder\.

Taken together, these results suggest marked differences among the three modalities of personalization, personas, and forecasting, which hold with remarkable consistency across model families\. In view of these findings, we encourage future research into LLM biases and cultural modeling to proceed with explicit acknowledgment of these discrepancies and to select the modality most appropriate to the given setting in a careful and principled way\.

## 2Related Work

#### Stereotyping, flattening, and the limits of cultural simulation\.

Demographic\-conditioned prompting can move model responses toward aggregate survey targets, but prior work cautions against interpreting such movement as faithful\.Durmuset al\.\([2023](https://arxiv.org/html/2607.24782#bib.bib15)\)find that cross\-national prompting can elicit stereotyped justifications, whileWanget al\.\([2025](https://arxiv.org/html/2607.24782#bib.bib21)\)argue that replacing human participants with LLMs can misportray identity groups\. We therefore treat country\-conditioned prompting as a descriptive object of study rather than as a general solution for cultural representation\.

#### Survey\-based evaluations of LLM values and cultural alignment\.

A growing literature evaluates language models against structured social surveys, using instruments such as the World Values Survey \(WVS\), Pew surveys, and Hofstede\-style cultural questionnaires\.Durmuset al\.\([2023](https://arxiv.org/html/2607.24782#bib.bib15)\)introduce GlobalOpinionQA using WVS and Pew questions,Caoet al\.\([2023](https://arxiv.org/html/2607.24782#bib.bib24)\)assess ChatGPT against Hofstede’s cultural dimensions, andTaoet al\.\([2024](https://arxiv.org/html/2607.24782#bib.bib29)\)place GPT responses on the Inglehart–Welzel cultural map\.AlKhamissiet al\.\([2024](https://arxiv.org/html/2607.24782#bib.bib22)\)simulate WVS respondents from Egypt and the United States, whileZhaoet al\.\([2024](https://arxiv.org/html/2607.24782#bib.bib28)\)introduce WorldValuesBench for predicting WVS responses conditioned on demographic attributes\. These studies typically choose a single elicitation frame rather than comparing the consequences of different frames\.

#### Personalization, personas, and forecasting\.

Prior work has used all three identity\-conditioning modalities considered here, often without making the choice of modality a central object of study\. Some work frames identity as user context, corresponding to personalization or first\-person prompting\(Venkata,[2026](https://arxiv.org/html/2607.24782#bib.bib32); Khanujaet al\.,[2026](https://arxiv.org/html/2607.24782#bib.bib33)\)\. Other work asks the model to adopt a persona:Taoet al\.\([2024](https://arxiv.org/html/2607.24782#bib.bib29)\)prompt models as an “average human being” in a target country,AlKhamissiet al\.\([2024](https://arxiv.org/html/2607.24782#bib.bib22)\)use demographic role\-play prompts, andSanturkaret al\.\([2023](https://arxiv.org/html/2607.24782#bib.bib31)\)study demographic opinion alignment under a PORTRAY condition\. A third set of work instead frames the task as forecasting another respondent’s answer:Durmuset al\.\([2023](https://arxiv.org/html/2607.24782#bib.bib15)\)ask how someone from a target country would respond,Zhaoet al\.\([2024](https://arxiv.org/html/2607.24782#bib.bib28)\)ask what a described “Person X” would answer, andLutzet al\.\([2025](https://arxiv.org/html/2607.24782#bib.bib34)\)compare several persona prompts\. Our work treats these framing choices as experimentally distinct rather than interchangeable\.

## 3Methods

### 3\.1Task Setting

We study whether country\-conditioned prompting moves LLM responses toward the response distributions observed for the corresponding country in the World Values Survey \(WVS\)\(Haerpferet al\.,[2020](https://arxiv.org/html/2607.24782#bib.bib25)\)\. WVS is a large\-scale, cross\-national survey program measuring people’s social, political, moral, and cultural values across many countries over multiple waves; in this paper, we use the most recent wave as of the time of writing \(2017–2022\)\. WVS has been widely used in the AI literature\(Durmuset al\.,[2023](https://arxiv.org/html/2607.24782#bib.bib15); Zhaoet al\.,[2024](https://arxiv.org/html/2607.24782#bib.bib28); Taoet al\.,[2024](https://arxiv.org/html/2607.24782#bib.bib29); Liuet al\.,[2025](https://arxiv.org/html/2607.24782#bib.bib30)\)due to its comprehensive scope and because it provides a structured way to compare model behavior against human value distributions across cultures, rather than treating “human preferences” as culturally uniform\.

We evaluate four frontier models—GPT\-5\.4, Claude Sonnet 4\.6, Gemini 2\.5 Flash, and Qwen3\-235B—on 101 WVS\-derived questions across 13 language\-country slices, selected to cover the world’s most widely\-spoken languages across countries with large populations of WVS respondents\. The slices include seven interview languages and thirteen country conditions: Arabic \(Egypt, Jordan, Morocco\), English \(Great Britain, Kenya, United States\), Spanish \(Argentina, Colombia, Mexico\), French \(Canada\), Hindi \(India\), Russian \(Russia\), and Chinese \(China\)\. This yields 21,008 model\-response rows across the sixteen model\-prompt combinations\.

### 3\.2Question Set and Selection Units

The benchmark is built from a manually curated WVS subset of 101*standalone question units*, selected for cross\-country portability and standalone interpretability\. A large majority of these question units correspond to individual WVS question IDs, but there are several cases in which WVS indexes each one of a series of checklist\-style answers as a separate question; in such cases, we grouped all answers together into a single unit\. For ease of notation, we will refer to these derived units simply as “questions\.”

In selecting questions, we excluded those whose wording includes country\-specific party systems, local institution lists, subjective self\-evaluation \(for example, life satisfaction or self\-rated health\), or references to local neighborhoods and communities, as such items are not applicable to LLM respondents \(i\.e\., in the persona setting\)\. The admissible answers for each question may be binary \(e\.g\. yes/no\), ordered multiple choice \(e\.g\. strongly agree / agree / disagree / strongly disagree\), or unordered multiple choice\. For more details on question definitions and selection, see Appendix[A](https://arxiv.org/html/2607.24782#A1)\.

To facilitate nuanced analysis, we divide the selected questions into seven mutually exclusive and collectively exhaustive categories: Morality and Worldview \(24 questions\); Democracy, Governance, and Public Authority \(20\); Trust, Civic Belonging, and Institutions \(14\); Economic Fairness, Work, and Material Conditions \(13\); Gender, Equality, and Social Inclusion \(11\); Religion and Science \(10\); and Public Order, Corruption, Migration, and Security \(9\)\.

### 3\.3Prompt Conditions

We evaluate four prompt conditions, as illustrated in Figure[1](https://arxiv.org/html/2607.24782#S1.F1):

1. 1\.Language: a language\-matched vanilla prompt with no country cue\.
2. 2\.User\-country: the prompt states that the user is from a specified country\.
3. 3\.Persona\-country: the model is asked to answer as if it were a person from that country\.
4. 4\.Third\-person: the model is asked to predict how a person from that country would answer\.

User\-country, persona\-country, and third\-person prompting respectively proxy the personalization, persona, and forecasting modalities discussed in Section[1](https://arxiv.org/html/2607.24782#S1)\. The user\-country and persona\-country variants still invite first\-person answering, and the user\-country prompt does not explicitly invite the model to personalize its answer\. The third\-person prompt, meanwhile, reframes the task as forecasting a respondent from the target country\. Appendix[B](https://arxiv.org/html/2607.24782#A2)gives the verbatim prompt wording across the four variants for all seven languages\.

### 3\.4Human Targets and Response Distributions

Each model response is compared to a matched human reference distribution derived from WVS responses\. For vanilla prompts in languageℓ\\ell, the human target is the weighted response distribution among respondents interviewed inℓ\\ell\. For country\-conditioned prompts in language\-country slice\(ℓ,c\)\(\\ell,c\), the human target is the weighted response distribution among respondents interviewed inℓ\\ellin countrycc\.

For each question, the human response distribution is the normalized share of respondent weight assigned to each answer option, excluding codes indicating that the respondent did not give a substantive answer\. For example, a value of0\.620\.62on one answer option means that 62% of substantive responses in the matched group selected that option\.

![Refer to caption](https://arxiv.org/html/2607.24782v1/images/overall_metrics_shift_alignment.png)

Figure 2:Overall prompt\-effect metrics for GPT\-5\.4, Claude Sonnet 4\.6, Gemini 2\.5 Flash, and Qwen3\-235B\. The chart provides a visual depiction of the final two columns of the table \(shift magnitude and directional alignment\), highlighting the Language ¡ User\-country ¡ Persona\-country ¡ Third\-person trend observed for all models on the shift magnitude metric, and for all models except Claude Sonnet 4\.6 on the directional alignment metric\.
### 3\.5Scoring

LetB​\(m,q\)B\(m,q\)denote modelmm’s English\-vanilla response for questionqq, which will be used throughout as a baseline representing the unconditioned “opinion” ofmmonqq\. LetR​\(m,q,ℓ,c,v\)R\(m,q,\\ell,c,v\)denote the response under languageℓ\\ell, countrycc, and prompt variantvvand letH​\(q,ℓ,c\)H\(q,\\ell,c\)denote the matched human response distribution for languageℓ\\elland countrycc\. For language prompting, we do not condition on country and instead compareR​\(m,q,ℓ,v\)R\(m,q,\\ell,v\)toH​\(q,ℓ\)H\(q,\\ell\), the matched human response distribution for languageℓ\\ell\. We score responses with normalized distances on\[0,1\]\[0,1\]:

baseline\_gap=d​\(B,H\),\\displaystyle=d\(B,H\),\(1\)response\_gap=d​\(R,H\),\\displaystyle=d\(R,H\),\(2\)shift\_magnitude=d​\(R,B\),\\displaystyle=d\(R,B\),\(3\)directional\_alignment=baseline\_gap−response\_gap\.\\displaystyle=\\text\{baseline\\\_gap\}\-\\text\{response\\\_gap\}\.\(4\)
Positive directional alignment means that prompting moved the response closer to the matched WVS distribution; negative values mean movement away from it\. Shift magnitude is reported separately because a large change is not necessarily movement toward the human target\. We refer to large positive directional alignment scores as “strong” throughout this paper\. However, it is worth noting that this terminology is descriptive and does not indicate a normative stance that high alignment is always positive under any prompt condition; such prescriptive questions are subjective and, as such, our position on them is agnostic\.

For ordered questions we use normalized Wasserstein distance over ordered answer positions\. For unordered single\-choice questions we use total variation distance\. We score bundled units on their member questions first and then average them back to the parent selection unit\.

### 3\.6Semantic Axes

Beyond question\-level distances, we analyze direction of movement on a fixed set of ten semantic axes: gender egalitarianism, outgroup inclusion, religiosity / faith primacy, science / technology optimism, traditional authority, civic integrity, economic interventionism, productivist materialism, institutional trust, and democratic pluralism\. Note that although there is some conceptual overlap between these semantic axes and the seven categories from Section[3\.2](https://arxiv.org/html/2607.24782#S3.SS2), they have different functions: the categories are used to segment questions for nuanced analysis, while the directionality of the semantic axes give a view into the tendencies of LLM versus human responses on broad issues, allowing us to make statements like “GPT\-5\.4 systematically overestimates optimism about science and technology under Latin American country prompting\.” Unlike the categories, the semantic axes are not one\-to\-one with questions: of the 101 total questions used, 74 are mapped to exactly one axis, 14 are mapped to multiple axes, and 13 are not mapped\.

For each mapped questionqqon axisaa, we define an oriented semantic scoresq​\(⋅\)∈\[0,1\]s\_\{q\}\(\\cdot\)\\in\[0,1\]such that larger values always indicate more of the positive pole of axisaa\. Ordered questions are rescaled to\[0,1\]\[0,1\]and reverse\-coded when needed; binary member items are coded as 0/1 and oriented in the same way; and a small number of unordered items with clear practical ordering use an explicit hand coding from response option to semantic value\. Details on these axes, the questions mapped to each of them, and the poles defined as “positive” and “negative” can be found in Appendix[D](https://arxiv.org/html/2607.24782#A4)\.

We then define

baseline\_semantic​\(q,a\)\\displaystyle\\text\{baseline\\\_semantic\}\(q,a\)=sq​\(B\),\\displaystyle=s\_\{q\}\(B\),\(5\)response\_semantic​\(q,a\)\\displaystyle\\text\{response\\\_semantic\}\(q,a\)=sq​\(R\),\\displaystyle=s\_\{q\}\(R\),\(6\)human\_semantic​\(q,a\)\\displaystyle\\text\{human\\\_semantic\}\(q,a\)=𝔼H​\[sq\]\.\\displaystyle=\\mathbb\{E\}\_\{H\}\[s\_\{q\}\]\.\(7\)From these quantities we compute

semantic\_shift​\(q,a\)\\displaystyle\\text\{semantic\\\_shift\}\(q,a\)=\\displaystyle=response\_semantic​\(q,a\)−baseline\_semantic​\(q,a\),\\displaystyle\\text\{response\\\_semantic\}\(q,a\)\-\\text\{baseline\\\_semantic\}\(q,a\),\(8\)semantic\_alignment\_delta​\(q,a\)\\displaystyle\\text\{semantic\\\_alignment\\\_delta\}\(q,a\)=\\displaystyle=\|human\_semantic​\(q,a\)−baseline\_semantic​\(q,a\)\|−\\displaystyle\\left\|\\text\{human\\\_semantic\}\(q,a\)\-\\text\{baseline\\\_semantic\}\(q,a\)\\right\|\-\|human\_semantic​\(q,a\)−response\_semantic​\(q,a\)\|\.\\displaystyle\\left\|\\text\{human\\\_semantic\}\(q,a\)\-\\text\{response\\\_semantic\}\(q,a\)\\right\|\.\(9\)Positive semantic shift means movement toward the positive pole of the axis\. Positive semantic alignment delta means movement toward the matched human target on that axis, analogous to directional alignment in the question\-scoring case\. Axis\-level summaries use the same weighting principle as the main benchmark: bundled members are scored first, averaged back to the parent selection unit, and then parent units are averaged with equal weight within each axis\.

![Refer to caption](https://arxiv.org/html/2607.24782v1/images/country_alignment_heatmap.png)Figure 3:Directional alignment by language\-country slice and prompt condition for the four hosted models\. We observe that the countries for which directional alignment is strongest—including Arabic\-speaking countries, India, and China—are relatively consistent across models\.![Refer to caption](https://arxiv.org/html/2607.24782v1/images/semantic_axis_alignment_heatmap.png)Figure 4:Semantic\-axis alignment by prompt variant and hosted model\. Certain semantic axes, especially religiosity / faith primacy, are consistently strong across all models\. Others vary more substantially by model: GPT\-5\.4 is a high\-end outlier for redistribution / state responsibility, for example, as is Gemini 2\.5 Flash for work\-first / material security\.![Refer to caption](https://arxiv.org/html/2607.24782v1/images/country_axis_deviation_panels.png)Figure 5:Country deviations on representative semantic axes, centered on the world\-average human reference\. All LLM data in this figure is for GPT\-5\.4\. This figure gives a more detailed country\-level view of semantic\-axis alignment, including notable anomalies such as GPT\-5\.4’s overestimation of science / technology optimism for Latin American countries\.

## 4Results

### 4\.1Overall Prompt Comparison

Figure[2](https://arxiv.org/html/2607.24782#S3.F2)reports the main benchmark summary for the four hosted models\. Coverage represents the proportion of questions with recoverable answers, excluding cases in which the model hedged or refused to answer\.The main overall result is that country conditioning usually improves directional alignment relative to the language\-only prompt, and third\-person forecasting is the strongest prompt condition for all hosted models except Claude Sonnet 4\.6\.Qwen’s user\-country variant is the main exception among country\-conditioned prompts, with slightly negative directional alignment\.

The strongest third\-person alignment number is Gemini’s0\.0750\.075, narrowly above GPT\-5\.4’s0\.0730\.073\. However, Gemini reaches this score with much lower coverage:79\.0%79\.0\\%under third\-person prompting versus GPT\-5\.4’s96\.7%96\.7\\%, due to its high refusal rates on certain languages \(see Appendix[G](https://arxiv.org/html/2607.24782#A7), Figure[7](https://arxiv.org/html/2607.24782#A7.F7)\)\. Qwen differs from GPT and Gemini: its vanilla and user\-country prompts yield negative alignment, but third\-person prompting lifts it to a clearly positive0\.0340\.034\. Claude shows the weakest prompt separation, with its country\-conditioned variants clustered tightly between0\.0180\.018and0\.0190\.019\.

### 4\.2Forecasting Versus Personas

The prompt comparison suggests that third\-person prompting changes the task being solved\. User\-country and persona\-country prompts frame the answer as something like “LLM response under a country cue,” whereas the third\-person prompt asks for an explicit forecast about a respondent from the target country\. This distinction appears at the slice level:third\-person directional alignment exceeds persona\-country alignment in all 13 language\-country slices for GPT\-5\.4 and Gemini 2\.5 Flash, in 11 of 13 slices for Qwen, and in 7 of 13 slices for Claude\.

The full slice matrix in Figure[3](https://arxiv.org/html/2607.24782#S3.F3)shows that this advantage varies geographically\. The same countries recur near the top across models: Jordan is the best third\-person slice for GPT\-5\.4, Gemini, and Qwen, and Egypt, India, China, Kenya, and Colombia also rank consistently high\. These cases have country\-conditioned targets that differ visibly from the baseline on high\-salience social values, religiosity, or security\-related tradeoffs\.

By contrast, Great Britain, Canada, and the United States are weak slices for every model, especially Qwen and Claude\. For GPT\-5\.4, third\-person prompting still improves alignment in these English/French North Atlantic slices, but only slightly: the gains are0\.0100\.010for Great Britain,0\.0180\.018for Canada, and0\.0250\.025for the United States\. Qwen is more revealing: its third\-person scores are negative for all three \(−0\.020\-0\.020,−0\.030\-0\.030, and−0\.012\-0\.012, respectively\), despite nontrivial shift magnitudes\. On these country slices, only about a quarter of scorable items improve while about 40% worsen, with repeated misses concentrated in trust, democracy/governance, corruption, and related institutional questions\.

### 4\.3Country\-Specific Effects

The country slices with strongest directional alignment tend to have human WVS profiles that depart from Anglophone defaults along several mutually reinforcing dimensions at once\. In aggregate, Arabic slices combine higher religiosity and more traditional social attitudes; India combines stronger religiosity with more work\-first and authority\-oriented responses; China combines distinctive institutional and social patterns; and Colombia and Kenya show marked differences on several value\-laden items\.In these cases, the models appear able to retrieve a coarse but directionally useful cultural schema\.

Conversely, Great Britain, Canada, and the United States appear to be hard cases precisely because the needed adjustment is smaller and more selective\. Forecasting prompts still induce substantial movement in those slices, but the movement often buys little alignment, suggesting that the models handle large, legible cross\-country contrasts more easily than fine\-grained distinctions among relatively similar countries\.

Figure[3](https://arxiv.org/html/2607.24782#S3.F3)also shows that this pattern varies partly by model\. Gemini retains positive alignment even in its weakest slices, while Qwen’s failures concentrate much more sharply in the Anglophone and Canadian slices\. Still, the overall ordering of strong and weak country slices remains notably consistent across models\.

### 4\.4Where The Effects Concentrate

Prompt effects vary across categories\. Under third\-person prompting, GPT\-5\.4 and Gemini both have positive directional alignment in all seven broad categories\. GPT\-5\.4 is strongest in Religion and Science \(0\.1870\.187\) and Economic Fairness, Work, and Material Conditions \(0\.1110\.111\), and Morality and Worldview \(0\.0760\.076\)\. Gemini shows a similar but sharper concentration in Religion and Science \(0\.1750\.175\), Economic Fairness, Work, and Material Conditions \(0\.1300\.130\), and Public Order, Corruption, Migration, and Security \(0\.1250\.125\)\.

Qwen’s strongest third\-person categories are Religion and Science \(0\.1870\.187\) and Gender, Equality, and Social Inclusion \(0\.0900\.090\), but it is slightly negative on Democracy, Governance, and Public Authority \(−0\.014\-0\.014\) and Trust, Civic Belonging, and Institutions \(−0\.022\-0\.022\)\. Claude is also uneven, but joins the other models in having Religion and Science as its clearest positive category\.

At the question level, the strongest alignment gains concentrate in items such as importance of God, belief in God, freedom versus security, environment versus growth, and worries about war or terrorism\. Weak or negative items cluster more around institutional trust, election fairness, corruption accountability, and some democracy\-essential questions\.The broad pattern is that models track country differences more readily on socially legible value questions than on questions requiring finer\-grained institutional modeling\.

### 4\.5Semantic Direction Is Axis\-Specific

The semantic\-axis results argue against a one\-dimensional account such as “the models have more traditional values under country prompting\.” Some axis\-level changes fit that description, especially on religiosity and some gender\-role questions, but the effect is not uniform across the ten\-axis inventory\.

Across all four models, religiosity / faith primacy is the easiest axis\. GPT\-5\.4 has the largest third\-person delta there \(0\.3840\.384\), while Qwen \(0\.3600\.360\) and Gemini \(0\.2660\.266\) also move strongly in the same direction\. Figure[4](https://arxiv.org/html/2607.24782#S3.F4)shows that the second\-tier strengths differ by model\. GPT\-5\.4 is the clear outlier on economic interventionism \(0\.1650\.165\), far ahead of Gemini \(0\.0670\.067\), Qwen \(0\.0530\.053\), and Claude \(−0\.037\-0\.037\)\. This suggests that GPT is unusually good at reorienting on redistribution and state\-responsibility questions, rather than only on socio\-cultural questions\.

Gemini’s most distinctive strength is productivist materialism / work\-first orientation \(0\.2560\.256\), where it substantially outperforms all other models\. Qwen, meanwhile, improves more than Claude on gender egalitarianism and outgroup inclusion, but remains much weaker on institutional trust and democratic pluralism\.The semantic\-axis layer further supports an axis\-specific interpretation: prompting helps most where cross\-country differences are socially legible and less where they depend on more specific institutional knowledge\.

The country\-by\-axis panels in Figure[5](https://arxiv.org/html/2607.24782#S3.F5)present a case study for GPT\-5\.4, comparing deviations from the world\-average human reference across four axes\. On religiosity / faith primacy, GPT broadly recovers the human ordering of countries: the Arabic slices sit well above the world average, while China, Canada, and Great Britain sit well below it\. On gender egalitarianism, the model is directionally reasonable but not perfectly calibrated: it overstates egalitarian deviations for Argentina and Canada and understates them for Great Britain\.

Institutional trust is the clearest failure mode\. Under third\-person prompting, GPT assigns India much more above\-average trust than the human reference does, misses China’s strongly above\-average trust signal, and softens several low\-trust countries toward the middle\. Science / technology optimism is mixed in a different way: GPT is fairly close for most of the panel, but it systematically overestimates Latin American optimism, predicting Argentina and Colombia as slightly above the world average even though the human reference is below it, while also pushing Morocco below average despite a modestly positive human deviation\.

### 4\.6Localized Models

We also compare the hosted models to three narrower localized models on corresponding language slices: Jais\-2\-8B\-Chat for Arabic, YandexGPT\-5\-Lite\-8B for Russian, and Airavata for Hindi\(Senguptaet al\.,[2023](https://arxiv.org/html/2607.24782#bib.bib26); Galaet al\.,[2024](https://arxiv.org/html/2607.24782#bib.bib27)\)\.None of these localized models exceeds GPT\-5\.4 or Gemini on the overlapping third\-person slice summaries, although Airavata is competitive with Claude and Qwen on Hindi\.

The slice\-matched comparison is nonetheless informative\. Airavata is the strongest localized baseline: on Hindi/India, its third\-person directional alignment is0\.0310\.031, essentially tied with Claude’s0\.0320\.032, though still below Qwen \(0\.0420\.042\), GPT\-5\.4 \(0\.0930\.093\), and Gemini \(0\.1080\.108\)\. YandexGPT\-5\-Lite\-8B is respectable on Russian in persona\-country mode \(0\.0200\.020\), where it slightly exceeds GPT\-5\.4 and Qwen, but its third\-person score falls to0\.0100\.010, leaving it below all four hosted models\. Jais is the weakest case: its Arabic third\-person average alignment is negative \(−0\.022\-0\.022\), even though the hosted models are all positive on the same slices\. Appendix[F](https://arxiv.org/html/2607.24782#A6)gives the slice\-by\-slice comparison in more detail\.

## 5Conclusion

This paper shows that personalization, personas, and forecasting are not interchangeable interfaces for eliciting value judgments from LLMs\. Across WVS questions, country\-conditioned prompts often change model responses substantially, but the direction and usefulness of that change depend on the framing: third\-person forecasting most consistently moves responses toward matched human distributions, while user\-country and persona\-country prompts produce weaker or less predictable alignment\. The strongest successes appear on socially legible axes such as religiosity and gender roles, while institutional trust and democratic values expose persistent gaps\. These findings make prompt framing a core methodological choice for cultural alignment work\. Future evaluations should report and justify the modality they use, rather than treating identity\-conditioned prompts as equivalent\.

## References

- B\. AlKhamissi, M\. ElNokrashy, M\. AlKhamissi, and M\. Diab \(2024\)Investigating cultural alignment of large language models\.External Links:2402\.13231,[Link](https://arxiv.org/abs/2402.13231)Cited by:[§1](https://arxiv.org/html/2607.24782#S1.p4.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1)\.
- Y\. Cao, L\. Zhou, S\. Lee, L\. Cabello, M\. Chen, and D\. Hershcovich \(2023\)Assessing cross\-cultural alignment between chatgpt and human societies: an empirical study\.External Links:2303\.17466,[Link](https://arxiv.org/abs/2303.17466)Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px2.p1.1)\.
- E\. Durmus, K\. Nguyen, T\. I\. Liao, N\. Schiefer, A\. Askell, A\. Bakhtin, C\. Chen, Z\. Hatfield\-Dodds, D\. Hernandez, N\. Joseph, L\. Lovitt, S\. McCandlish, O\. Sikder, A\. Tamkin, J\. Thamkul, J\. Kaplan, J\. Clark, and D\. Ganguli \(2023\)Towards measuring the representation of subjective global opinions in language models\.Note:arXiv preprint arXiv:2306\.16388v2External Links:[Link](https://arxiv.org/abs/2306.16388)Cited by:[§1](https://arxiv.org/html/2607.24782#S1.p4.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px1.p1.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1),[§3\.1](https://arxiv.org/html/2607.24782#S3.SS1.p1.1)\.
- J\. Gala, T\. Jayakumar, J\. A\. Husain, A\. K\. M, M\. S\. U\. R\. Khan, D\. Kanojia, R\. Puduppully, M\. M\. Khapra, R\. Dabre, R\. Murthy, and A\. Kunchukuttan \(2024\)Airavata: introducing hindi instruction\-tuned llm\.External Links:2401\.15006,[Link](https://arxiv.org/abs/2401.15006)Cited by:[§4\.6](https://arxiv.org/html/2607.24782#S4.SS6.p1.1)\.
- C\. Haerpfer, R\. Inglehart, A\. Moreno, C\. Welzel, K\. Kizilova, J\. Diez\-Medrano, M\. Lagos, P\. Norris, E\. Ponarin, B\. Puranen,et al\.\(2020\)World values survey: round seven – country\-pooled datafile\.JD Systems Institute & WVSA Secretariat,Madrid, Spain & Vienna, Austria\.External Links:[Document](https://dx.doi.org/10.14281/18241.1),[Link](https://doi.org/10.14281/18241.1)Cited by:[§1](https://arxiv.org/html/2607.24782#S1.p5.1),[§3\.1](https://arxiv.org/html/2607.24782#S3.SS1.p1.1)\.
- S\. Khanuja, H\. Liu, S\. Zhang, J\. Lambert, M\. Chen, R\. Mathews, and L\. Wang \(2026\)Steering llms for culturally localized generation\.External Links:2603\.23301,[Link](https://arxiv.org/abs/2603.23301)Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1)\.
- Y\. Liu, M\. Kaneko, and C\. Chu \(2025\)On the alignment of large language models with global human opinion\.External Links:2509\.01418,[Link](https://arxiv.org/abs/2509.01418)Cited by:[§3\.1](https://arxiv.org/html/2607.24782#S3.SS1.p1.1)\.
- M\. Lutz, I\. Sen, G\. Ahnert, E\. Rogers, and M\. Strohmaier \(2025\)The prompt makes the person\(a\): a systematic evaluation of sociodemographic persona prompting for large language models\.External Links:2507\.16076,[Link](https://arxiv.org/abs/2507.16076)Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1)\.
- S\. Santurkar, E\. Durmus, F\. Ladhak, C\. Lee, P\. Liang, and T\. Hashimoto \(2023\)Whose opinions do language models reflect?\.InProceedings of the 40th International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.202,pp\. 29971–30004\.External Links:[Link](https://proceedings.mlr.press/v202/santurkar23a.html)Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1)\.
- N\. Sengupta, S\. K\. Sahu, B\. Jia, S\. Katipomu, H\. Li, F\. Koto, W\. Marshall, G\. Gosal, C\. Liu, Z\. Chen, O\. M\. Afzal, S\. Kamboj, O\. Pandit, R\. Pal, L\. Pradhan, Z\. M\. Mujahid, M\. Baali, X\. Han, S\. M\. Bsharat, A\. F\. Aji, Z\. Shen, Z\. Liu, N\. Vassilieva, J\. Hestness, A\. Hock, A\. Feldman, J\. Lee, A\. Jackson, H\. X\. Ren, P\. Nakov, T\. Baldwin, and E\. Xing \(2023\)Jais and jais\-chat: arabic\-centric foundation and instruction\-tuned open generative large language models\.External Links:2308\.16149,[Link](https://arxiv.org/abs/2308.16149)Cited by:[§4\.6](https://arxiv.org/html/2607.24782#S4.SS6.p1.1)\.
- Y\. Tao, O\. Viberg, R\. S\. Baker, and R\. F\. Kizilcec \(2024\)Cultural bias and cultural alignment of large language models\.PNAS Nexus3\(9\)\.External Links:ISSN 2752\-6542,[Link](http://dx.doi.org/10.1093/pnasnexus/pgae346),[Document](https://dx.doi.org/10.1093/pnasnexus/pgae346)Cited by:[§1](https://arxiv.org/html/2607.24782#S1.p4.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1),[§3\.1](https://arxiv.org/html/2607.24782#S3.SS1.p1.1)\.
- P\. J\. Venkata \(2026\)When ai speaks, whose values does it express? a cross\-cultural audit of individualism–collectivism bias in large language models\.External Links:2604\.22153,[Link](https://arxiv.org/abs/2604.22153)Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1)\.
- A\. Wang, J\. Morgenstern, and J\. P\. Dickerson \(2025\)Large language models that replace human participants can harmfully misportray and flatten identity groups\.Nature Machine Intelligence,pp\. 1–12\.Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px1.p1.1)\.
- W\. Zhao, D\. Mondal, N\. Tandon, D\. Dillion, K\. Gray, and Y\. Gu \(2024\)WorldValuesBench: a large\-scale benchmark dataset for multi\-cultural value awareness of language models\.External Links:2404\.16308,[Link](https://arxiv.org/abs/2404.16308)Cited by:[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2607.24782#S2.SS0.SSS0.Px3.p1.1),[§3\.1](https://arxiv.org/html/2607.24782#S3.SS1.p1.1)\.

## Appendix AQuestion Selection Details

The final benchmark subset contains 101 standalone WVS question units\. Selection followed four main rules:

1. 1\.prefer wording that is portable across countries and does not depend on country\-specific party lists, institution rosters, or local annexes;
2. 2\.prefer questions that remain interpretable as standalone prompts;
3. 3\.exclude self\-evaluative or immediate\-local\-context items such as life satisfaction, happiness, self\-rated health, and trust in family;
4. 4\.keep substantively useful controversial items, but remove near\-duplicates\.

The three grouped selection units are:

- •SU\_CHILD\_QUALITIESforQ7\-Q17;
- •SU\_NEIGHBORSforQ18\-Q26;
- •SU\_IMMIGRATION\_EFFECTSforQ122\-Q129\.

These grouped units are rendered with one response line per member item and are averaged back to a single parent score during evaluation\. Selection operated on standalone units rather than raw codebook rows because several WVS batteries are experienced by respondents as one question with multiple recorded members\.

## Appendix BPrompt Templates

Each prompt consists of four pieces: an optional country preamble, the localized question text, the localized response options, and a language\-specific answer suffix\. The vanilla prompt uses no country preamble\.

Table 1:Country\-prompt preambles by language\.\{country\_name\}is replaced with the localized country name for the target slice\.Table 2:Answer suffixes by language\. This suffix follows the localized question text and response options in every prompt condition\.
## Appendix CAdditional Metric and Aggregation Details

Human response distributions are computed from WVS respondent weights over substantive responses only\. For a given language or language\-country group, the distribution mass on each response option is:

P​\(option​k\)=\\displaystyle P\(\\text\{option \}k\)=weighted substantive responses choosing​ktotal substantive response weight for the group\.\\displaystyle\\frac\{\\text\{weighted substantive responses choosing \}k\}\{\\text\{total substantive response weight for the group\}\}\.
These option shares sum to 1 within each question member\. Missing, blank, and other non\-substantive responses are excluded from this distribution and reported through coverage instead\.

Bundled questions are scored in three steps:

1. 1\.compute the metric separately for each member question;
2. 2\.average member scores back to the parent selection unit;
3. 3\.average parent selection units with equal weight in aggregate summaries\.

This prevents larger batteries from dominating the benchmark solely because they contain more recorded members\.

## Appendix DSemantic Axis Inventory

[Table3](https://arxiv.org/html/2607.24782#A4.T3)lists the ten semantic axes used for direction\-of\-shift analysis\. Each mapped question\-member receives a semantic value in\[0,1\]\[0,1\], oriented so that larger values always mean more of the positive pole\. The final column gives the mapped benchmark units for each axis, using WVS question IDs and benchmark selection\-unit IDs for the bundled batteries\.

Table 3:Semantic\-axis inventory\.
## Appendix EParser and Coverage Notes

We use deterministic answer extraction that prioritizes explicit answer\-bearing text, including numbered responses and exact option labels, before applying conservative fallback matching\. Hedge and refusal flags are tracked separately from parsing status\. For bundled rows, the primary benchmark score requires all expected members to be parsed\.

## Appendix FLocalized Models

We compare three slice\-matched localized baselines to the four hosted models on the subsets for which a region\-specific model is available: Jais\-2\-8B\-Chat on the three Arabic slices \(Egypt, Jordan, Morocco\), YandexGPT\-5\-Lite\-8B on Russian/Russia, and Airavata on Hindi/India\. The comparison uses the same prompt conditions and the same directional\-alignment metric as in the main benchmark, but aggregates only over the overlapping slice or slice family\.

The localized models do not dominate the hosted systems on their home slices\. For Arabic, Jais is weaker than all four hosted models under every conditioned prompt\. Its user\-country average over the three Arabic slices is modestly positive \(0\.0110\.011\), its persona\-country average is near zero \(0\.0040\.004\), and its third\-person average is negative \(−0\.022\-0\.022\)\. By contrast, the hosted models are all positive on Arabic third\-person prompting, ranging from0\.0360\.036for Claude to0\.1210\.121for Gemini, with GPT\-5\.4 at0\.1140\.114and Qwen at0\.0880\.088\. Jais also has substantially lower coverage than the strongest hosted systems, with overall conditioned coverage between79\.5%79\.5\\%and84\.5%84\.5\\%\.

Airavata is the most competitive localized baseline\. On Hindi/India it reaches0\.0230\.023for user\-country,0\.0310\.031for persona\-country, and0\.0310\.031for third\-person prompting, with roughly89%89\\%–91%91\\%coverage across prompt conditions\. These numbers place it close to Claude on the same slice and above GPT\-5\.4 in user\-country mode, but still clearly below GPT\-5\.4 and Gemini under third\-person prompting\. Airavata therefore looks like a credible localized baseline rather than a trivial failure case, but it does not overturn the main finding that the strongest hosted models are better respondent forecasters\.

YandexGPT\-5\-Lite\-8B performs respectably on Russian\. Its persona\-country score on Russia is0\.0200\.020, slightly above GPT\-5\.4 \(0\.0120\.012\) and Qwen \(0\.0060\.006\), and close to Claude \(0\.0180\.018\), while maintaining essentially complete coverage\. But its third\-person score is only0\.0100\.010, which leaves it well below GPT\-5\.4 \(0\.0810\.081\) and Gemini \(0\.0640\.064\), and below Claude \(0\.0230\.023\) and Qwen \(0\.0320\.032\) as well\. The localized models are therefore best understood as selective competitors on some prompt styles and slices, not as across\-the\-board replacements for the strongest general\-purpose systems\. Figure[8](https://arxiv.org/html/2607.24782#A7.F8)visualizes these slice\-matched comparisons\.

## Appendix GAdditional Figures and Tables

These figures serve as diagnostics and decompositions for the main benchmark results\. Figure[6](https://arxiv.org/html/2607.24782#A7.F6)shows that aggregate gains are carried disproportionately by a subset of categories, especially Religion and Science and, for GPT\-5\.4 and Gemini, Economic Fairness, Work, and Material Conditions\.

![Refer to caption](https://arxiv.org/html/2607.24782v1/images/category_alignment.png)Figure 6:Category\-level directional alignment for both models and prompt variants\.Figure[7](https://arxiv.org/html/2607.24782#A7.F7)is a coverage diagnostic\. It shows that the models differ not only in alignment but also in whether they will answer the question in the first place\. GPT\-5\.4 and Qwen have near\-zero refusal rates across most settings, Claude has low but nonzero refusal rates concentrated in Arabic, and Gemini’s weaker effective coverage is driven largely by conditioned\-prompt refusals, especially in Arabic and to a lesser extent Russian and Hindi\.

![Refer to caption](https://arxiv.org/html/2607.24782v1/images/refusal_patterns.png)Figure 7:Prompt\-level and language\-level refusal patterns for the four hosted models\.Figure[8](https://arxiv.org/html/2607.24782#A7.F8)gives the localized\-model comparison used in Section[4\.6](https://arxiv.org/html/2607.24782#S4.SS6)\. The important reading is slice\-relative rather than global: each localized model is compared only on the language\-country cells for which it is available\. The figure makes clear that Airavata is the closest localized competitor, Yandex is competitive mainly in persona\-country prompting, and Jais does not recover the Arabic forecasting gains seen in the hosted systems\.

![Refer to caption](https://arxiv.org/html/2607.24782v1/images/sovereign_slice_comparison.png)Figure 8:Hosted versus localized models on the Arabic, Russian, and Hindi slice\-matched comparisons\.
## Appendix HEthics, Broader Impact, and Reproducibility

This benchmark is descriptive rather than normative\. A positive alignment score means that a model moved toward the observed WVS response distribution under our prompting and scoring setup; it does not mean that the model is “correct” in any broader moral or political sense, nor that the matched survey responses should be treated as a social ideal\. The benchmark is also about aggregate distributions, not about any individual’s beliefs\. Even when a country\-level forecast is accurate on average, it should not be used to stereotype or essentialize respondents from that country\.

The work also poses a familiar risk in cultural modeling: prompting a model to answer “as if” it were from a given country can encourage the use of coarse cultural heuristics\. Some of those heuristics may help with forecasting, but they may also encode flattening stereotypes, especially on socially sensitive dimensions such as religion, gender roles, or attitudes toward minorities\. For that reason, we report axis\-specific successes and failures rather than presenting country prompting as a general solution\. In particular, our results show that models can look strong on salient value dimensions while remaining weak on institutional trust, democratic process, and other subtler constructs\.

The underlying human data come from the World Values Survey, and our benchmark uses weighted aggregate response distributions rather than individual\-level prediction targets\. Reproducibility is supported by deterministic scoring rules, explicit prompt templates, fixed question selection, and explicit aggregation procedures, all described in this paper\. The appendix tables and figures are computed from the same benchmark runs discussed in the main text, and the scoring and aggregation rules used to produce them are specified in Section[C](https://arxiv.org/html/2607.24782#A3)\. The main remaining source of irreproducibility is the model side itself: hosted LLM outputs may change over time, so exact benchmark values should be interpreted as tied to the specific model snapshots and runs analyzed here\.

Similar Articles

Re-Centering Humans in LLM Personalization

arXiv cs.CL

This paper studies the gap between synthetic and human data for evaluating LLM personalization across three stages: attribute extraction, relevance matching, and response generation. Results show models perform worse on real human data, and the authors introduce lightweight training interventions to improve alignment.

Evaluation Drift in LLM Personality Induction: Are We Moving the Goalpost?

arXiv cs.CL

This paper investigates whether fine-tuning LLMs on long-form essays with associated Big Five personality profiles stabilizes questionnaire responses and can induce target profiles, finding that while variance reduces, accuracy on the full five-dimensional profile remains near chance.