Convergence in Science, Divergence in Religion: Calibrated Framing Differences Across Wikipedia's Language Editions
Summary
This study uses multilingual encoders to measure framing differences across Wikipedia's language editions, finding that religious and political concepts diverge more than scientific ones.
View Cached Full Text
Cached at: 08/25/26, 04:18 AM
# Convergence in Science, Divergence in Religion:Calibrated Framing Differences Across Wikipedia’s Language Editions
Source: [https://arxiv.org/html/2608.21821](https://arxiv.org/html/2608.21821)
Hung\-Hsuan ChenAffiliation:Computer Science and Information EngineeringAffiliation:National Central UniversityAffiliation:Taoyuan, TaiwanEmail:[hhchen1105@acm\.org](mailto:)
###### Abstract
When Wikipedia’s language editions describe the same concept, how differently do they frame it? Previous work measures coverage gaps between editions; we measure the framing distance for matched concepts\. We analyze 2,799 valid articles from 3,000 possible concept\-language observations, spanning 150 Wikidata\-anchored concepts, 20 language editions, 4 domains, and a calibration set\. Raw embedding distances reflect both content differences and how well the encoder aligns each language pair\. Even among calibration concepts with stable cross\-cultural denotations \(e\.g\., chemical elements, numbers, colors\), the largest language\-pair mean distance is 3\.6 times the smallest, and distances are typically smaller within language families\. We define a baseline\-adjusted distance \(calibrated distance\): the distance between two language versions of a concept minus the mean distance for calibration concepts in the same language pair\. This adjustment substantially reduces pair\-specific alignment differences and the language\-family pattern\. Across three multilingual encoders \(LaBSE, multilingual MPNet, and CMLM\), scientific articles align more closely than calibration articles, and all three rank religion first and science/technology last\. Concept\-level rankings are highly consistent across encoders \(Spearman rho=0\.75\-0\.79 for MPNet and CMLM relative to LaBSE\)\. Religion lies significantly above the calibration baseline under LaBSE\. Within politics, divergence concentrates on concepts such as censorship and refugee, while democracy and human rights are among the most aligned\. Code, data, and per\-language\-pair calibration baselines are released\.111[https://github\.com/hhchen1105/cross\-linqual\-concept](https://github.com/hhchen1105/cross-linqual-concept)
## 1Introduction
Wikipedia exists in more than 300 languages\. Its language editions are largely written independently rather than translated from a common source\. When the Turkish, Korean, and Polish editions describe*pilgrimage*or*censorship*, they draw on different editor communities, sources, and cultural contexts\. Wikipedia therefore offers a rare corpus for asking: when language communities describe*the same*concept, how differently do they frame it? We find the greatest divergence in religious and politically sensitive concepts, not in settled scientific knowledge\.
Previous computational work on cross\-lingual Wikipedia differences has focused mainly on*coverage*: which articles, facts, or table entries appear in one edition but not another\([14](https://arxiv.org/html/2608.21821#bib.bib1);[2](https://arxiv.org/html/2608.21821#bib.bib4)\)\. We instead study*framing*\. For concepts matched across editions, does article content diverge more in culturally loaded domains such as religion and politics than in less culturally loaded domains such as basic science and chemical elements? This distinction separates what editions include from how they describe shared topics\. It also matters beyond Wikipedia because language editions are core pretraining data for multilingual language models\. Such models can change historical narratives with the query language\. For example, the same model credits the radio to Popov in Russian but to Marconi in English and Italian; it credits movable\-type printing to Bi Sheng in Chinese but to Gutenberg in German\([7](https://arxiv.org/html/2608.21821#bib.bib6)\)\. Measuring divergence in the encyclopedic source material is a first step toward identifying the data\-side origins of such language\-conditioned behavior\.
Multilingual sentence encoders create a methodological problem that previous embedding\-based comparisons have not addressed\. Encoders such as LaBSE\([6](https://arxiv.org/html/2608.21821#bib.bib12)\)align some language pairs much better than others\. In our data, the mean distances for the calibration articles range from0\.1070\.107for Persian–Indonesian to0\.3890\.389for Hindi–Chinese\. These articles cover concepts with relatively stable cross\-cultural denotations, including chemical elements, numbers, colors, animals, and natural kinds\. Their3\.6×3\.6\\timesspread therefore reflects encoder alignment and the edition\-level writing differences, not only the content\. Raw distances are also smaller within language families \(e\.g\., French–Spanish\) than across them \(e\.g\., Hindi–Chinese\), with a mean of0\.1770\.177within families versus0\.2170\.217across them\. Without calibration, an analysis could mistake these artifacts for cultural distance\. We subtract the mean calibration distance for the same language pair from each raw distance\. We call this baseline\-adjusted quantity*calibrated distance*\. This correction substantially reduces the aggregate family contrast \(see the Results section\)\.
This paper makes three contributions\. First, it shows why calibration is necessary: neutral\-article baselines vary3\.6×3\.6\\timesacross language pairs and carry a language\-family signal\. Per\-pair calibration substantially weakens both patterns, and parallel text validates the structure of the baselines \(see the Method section and the Calibration\-set composition subsection\)\. Second, it identifies a clear domain ordering across 2,799 articles in 20 languages spanning more than 12 families and nine scripts\. Under LaBSE, religion lies above the calibration baseline \(\+0\.034\+0\.034, Holm\-adjusted two\-sided permutationp=0\.007p=0\.007\), while science lies below it\. Political divergence is concentrated in specific concepts: editions describe “democracy” similarly but “censorship” differently \(see the Results section\)\. Third, it separates robust rankings from encoder\-dependent magnitudes\. Two additional encoders place religion first and science/technology last and reproduce the concept\-level ranking \(Spearmanρ=0\.75\\rho=0\.75–0\.790\.79\), but religion exceeds the baseline significantly only under LaBSE\. Excluding bot\-created and translation\-generated articles changes the religion estimate little \(see the Robustness section\)\.
At the concept level, ritual and institutional religious terms \(sacrifice, clergy, temple, martyr\) and politically sensitive concepts \(censorship, refugee\) diverge most\. Settled knowledge and canonical ideals—evolution, DNA, quantum mechanics, democracy, and human rights—are among the most aligned\. These contrasts support a cultural interpretation, but do not identify its cause\.
## 2Related Work
#### Cross\-lingual differences between Wikipedia editions\.
InfoGap\([14](https://arxiv.org/html/2608.21821#bib.bib1)\)is the closest prior work\. It decomposes articles into facts and aligns them across editions with LaBSE and LLM verification\. Applied to 2\.7K LGBT biographies in English, French, and Russian, it found large coverage gaps and disproportionate inclusion of negative\-connotation facts in the Russian edition\. InfoGap measures*coverage*: which facts an edition includes\. We measure*framing*: how far apart the content of matched articles is after controlling for encoder noise\. An edition can present the same facts with different emphasis, or different facts with similar framing, so the measures are complementary\. The distinction is not only conceptual: InfoGap’s LaBSE\-based candidate retrieval is followed by a discrete LLM verification step, so encoder alignment quality mainly affects which candidates are considered rather than the reported fact\-presence judgment itself; our continuous distance measure has no such downstream correction and inherits that quality directly, which is why it needs calibration\. Extending fact\-level alignment to also measure how differently a shared fact is phrased across editions would reintroduce that artifact, making calibration \(Eq\.[1](https://arxiv.org/html/2608.21821#S4.E1)\) necessary\. InfoGap studies two or three language pairs; our concept\-level metric covers all 190 pairs among 20 languages and compares domains\. Other work uses behavioral signals, including overlap in edit\-war topics\([18](https://arxiv.org/html/2608.21821#bib.bib2)\)and cultural borders inferred from co\-editing\([15](https://arxiv.org/html/2608.21821#bib.bib3)\)\. These signals capture editor behavior and topic selection rather than article content\. Work on multilingual Wikipedia tables\([2](https://arxiv.org/html/2608.21821#bib.bib4)\)aligns table entries across editions using Wikidata identifiers, and proposes cross\-lingual embedding similarity as future work; our calibration would be a necessary addition to that kind of uncalibrated embedding comparison\.
#### Cross\-cultural semantics in embedding space\.
[16](https://arxiv.org/html/2608.21821#bib.bib5)compare supervised affective gradients \(valence, arousal, dominance\) across aligned multilingual embeddings with permutation tests and bootstrap intervals, finding broadly shared valence structure with interpretable residual differences\. Their object of study is the affective lexicon; ours is encyclopedic article content\. We adopt their permutation\-based significance philosophy, adapted to a design where the calibration baseline must be recomputed inside each permutation to avoid construction bias \(see the Method section\)\.
#### Cultural alignment of language models\.
A growing line of work probes the sociocultural tendencies of*LLM outputs*: whether they align with survey\-based cultural values\([1](https://arxiv.org/html/2608.21821#bib.bib8);[10](https://arxiv.org/html/2608.21821#bib.bib9)\), whether occupational gender patterns in open\-ended narratives align more closely with human stereotypes than with labor\-force statistics\([3](https://arxiv.org/html/2608.21821#bib.bib11)\), and—closest to our motivation—whether the same model produces different historical attributions depending on the query language\([7](https://arxiv.org/html/2608.21821#bib.bib6)\)\. We ask a data\-side question instead, measuring divergence in*human\-written Wikipedia content*; the claims therefore do not overlap with the LLM\-alignment literature\.
#### Multilingual sentence encoders\.
LaBSE\([6](https://arxiv.org/html/2608.21821#bib.bib12)\)aligns sentence embeddings across 109 languages through translation\-ranking training\. Alignment quality varies with the availability of training pairs, contributing to the language\-pair variation captured by our baselines\. The method itself is encoder\-agnostic: substituting another multilingual encoder produces baselines for that encoder and the same edition\-level writing differences\. We demonstrate this property with two additional encoders\([13](https://arxiv.org/html/2608.21821#bib.bib16);[17](https://arxiv.org/html/2608.21821#bib.bib17)\)in the Encoder robustness subsection\.
## 3Data
### 3\.1Concepts
We study 150 concepts across four culturally loaded domains—*religion*,*politics*,*science/tech*, and*pop culture*—with 30 concepts each, plus a calibration set of 30 minimally culture\-loaded concepts: chemical elements, small numbers, basic colors, common animals, and universal natural kinds, used only to estimate neutral\-article baselines \(see the Method section\)\. The culturally loaded domains include concepts such as karma, dharma, democracy, liberalism, freedom, human rights, and work\-life balance\.
Wikipedia titles provide a machine\-readable concept vocabulary for language\-technology applications, e\.g\., scientific keyphrase compilation or generation\([5](https://arxiv.org/html/2608.21821#bib.bib10);[4](https://arxiv.org/html/2608.21821#bib.bib18)\)\. We use this vocabulary cross\-lingually\. Each concept is anchored by a Wikidata QID, which maps it to article titles across editions\.
We resolve QIDs from the English article’swikibase\_itempage property\. A first\-hit entity search was unreliable\. For example, it mapped*Sin*to Singapore and*Sun*to Sun Microsystems\. For the five concepts affected by such disambiguation or redirect errors, we manually verified the correct QID\. We recorded it in a documented override file that the resolution pipeline consults instead of the unreliable first\-hit search\. All 150 concepts resolved successfully\. The appendix lists them in full\.
### 3\.2Languages
We use 20 languages from 15 families and nine scripts: Arabic, Chinese, English, Finnish, French, German, Hebrew, Hindi, Indonesian, Japanese, Korean, Persian, Polish, Portuguese, Russian, Spanish, Swahili, Thai, Turkish, and Vietnamese\. Table[1](https://arxiv.org/html/2608.21821#S3.T1)lists their families, scripts, and coverage\. Two constraints bound the selection: every language must be supported by LaBSE, and a 20\-language sample keeps the 3,000\-article fetch\-and\-validation pipeline tractable while providing 190 language pairs\. Within that budget, we maximize diversity across families, scripts, and regions\.
### 3\.3Article text and validation
For each concept–language observation with a Wikidata sitelink, we retrieve the article’s lead section as plain text through the MediaWiki API\. Lead sections are more standardized and comparable in length than full articles, reducing length and structure confounding\. We exclude observations with no sitelink \(i\.e\., no article exists in that edition\), a disambiguation page, or a stub\. Stub detection uses a script\-aware count\. For Chinese, Japanese, and Thai, we count characters rather than whitespace\-delimited tokens because these scripts do not consistently separate words with spaces\. We consider an extract as a stub if this count is below 20\.
Of the150×20=3,000150\\times 20=3\{,\}000concept–language observations, 2,799 \(93\.3%\) are valid: 154 lack sitelinks and 47 are stubs, with zero fetch errors\. Exclusion is unevenly distributed \(Table[1](https://arxiv.org/html/2608.21821#S3.T1)\): Swahili has 71% valid observations while every other edition reaches at least 89%\. We treat per\-language exclusion as a substantive signal of Wikipedia coverage inequality and report it alongside the distance results\.
Table 1:The 20 language editions: family, script, and valid concept–language observations, ascending by coverage\. Swahili’s low coverage is itself a coverage\-inequality finding \(the Robustness section shows it is also the most bot\- and translation\-mediated edition in our sample\)\.CodeLanguageFamilyScriptValidRateswSwahiliBantuLatin106/15071%hiHindiIndo\-AryanDevanagari133/15089%fiFinnishUralicLatin134/15089%koKoreanKoreanicHangul136/15091%plPolishSlavicLatin138/15092%deGermanGermanicLatin139/15093%jaJapaneseJaponicJapanese141/15094%thThaiKra\-DaiThai141/15094%idIndonesianAustronesianLatin141/15094%heHebrewSemiticHebrew142/15095%ruRussianSlavicCyrillic142/15095%arArabicSemiticArabic143/15095%ptPortugueseRomanceLatin143/15095%viVietnameseAustroasiaticLatin143/15095%zhChineseSiniticHan144/15096%frFrenchRomanceLatin146/15097%esSpanishRomanceLatin146/15097%trTurkishTurkicLatin146/15097%faPersianIranianArabic146/15097%enEnglishGermanicLatin149/15099%
## 4Method
### 4\.1Embeddings
We split each valid lead section into sentences and embed each sentence with LaBSE\([6](https://arxiv.org/html/2608.21821#bib.bib12)\)\. We L2\-normalize each sentence vector so that every sentence contributes equally to the pooled vector regardless of its magnitude, mean\-pool the normalized vectors, and L2\-normalize the result\. This produces one 768\-dimensional vectorvc,ℓv\_\{c,\\ell\}for each conceptccand languageℓ\\ell\. Embedding computation ran as single\-GPU jobs on an internal computing cluster rather than a cloud provider; the full three\-encoder pass also completes within a few CPU\-hours on a machine without a GPU\.
### 4\.2Calibrated distance
Letd\(c,i,j\)=1−cos\(vc,i,vc,j\)d\(c,i,j\)=1\-\\cos\(v\_\{c,i\},v\_\{c,j\}\), wherecos\(⋅,⋅\)\\cos\(\\cdot,\\cdot\)denotes cosine similarity, be the raw distance between the versions of conceptccin languagesiiandjj\. We define
e\(c,i,j\)=d\(c,i,j\)⏟raw distance−1\|𝒞ij\|∑c′∈𝒞ijd\(c′,i,j\)⏟calibration floorb\(i,j\)e\(c,i,j\)\\;=\\;\\underbrace\{d\(c,i,j\)\}\_\{\\text\{raw distance\}\}\\;\-\\;\\underbrace\{\\frac\{1\}\{\|\\mathcal\{C\}\_\{ij\}\|\}\\sum\_\{c^\{\\prime\}\\in\\mathcal\{C\}\_\{ij\}\}d\(c^\{\\prime\},i,j\)\}\_\{\\text\{calibration floor \}b\(i,j\)\}\(1\)
Here,b\(i,j\)=1\|𝒞ij\|∑c′∈𝒞ijd\(c′,i,j\)b\(i,j\)=\\frac\{1\}\{\|\\mathcal\{C\}\_\{ij\}\|\}\\sum\_\{c^\{\\prime\}\\in\\mathcal\{C\}\_\{ij\}\}d\(c^\{\\prime\},i,j\)is the calibration floor, where𝒞ij\\mathcal\{C\}\_\{ij\}denotes the pre\-selected, minimally culture\-loaded calibration concepts \(see Data\) available in both languagesiiandjj\(mean\|𝒞ij\|=27\.5\|\\mathcal\{C\}\_\{ij\}\|=27\.5out of 30\)\. We calle\(c,i,j\)e\(c,i,j\)the*baseline\-adjusted distance*, shortened to*calibrated distance*\. The baselineb\(i,j\)b\(i,j\)estimates how far apart languagesiiandjjare on minimally culture\-loaded reference concepts\. It mainly captures encoder alignment and edition\-level writing differences, although some content variation may remain\. Baselines range from0\.1070\.107\(fa–id\) to0\.3890\.389\(hi–zh\); within a language pair, calibration\-concept distances have a mean SD of0\.0700\.070, i\.e\., individual calibration concepts still fluctuate aroundb\(i,j\)b\(i,j\), but this within\-pair spread is small relative to the between\-pair range, so most of the variation in raw distance is explained by the language pair itself rather than by which calibration concept is used, supportingb\(i,j\)b\(i,j\)as a stable per\-pair floor\. Calibrated distance is signed\. A positive value means that two editions describe a concept more differently than they describe the calibration concepts; a negative value means that they describe it more similarly\.
### 4\.3Significance testing – reliability of the domain effects
To establish that a domain’s calibrated distance effect is real rather than an artifact of chance, concept selection, or language sampling, we run five checks: a two\-sided, concept\-level permutation test for whether a domain’s mean calibrated distance across language pairs differs from zero; a concept bootstrap for sensitivity to which concepts were chosen; a language\-node bootstrap for the sensitivity of concept rankings to which languages are sampled; a concept\-node bootstrap for the sensitivity of language rankings to which concepts are sampled; and a Mantel test comparing domain\-level geometries\.
#### Permutation test\.
Two design choices matter for validity\. First, we permute each concept’s domain/calibration label rather than treating the 190 language pairs as independent replicates, because every concept contributes distances to all 190 pairs simultaneously, so pairs sharing a concept are correlated and would inflate significance if treated as independent samples\. Second, we recompute the calibration baselineb\(i,j\)b\(i,j\)inside every permutation rather than holding it fixed, becauseb\(i,j\)b\(i,j\)is itself defined by which concepts are labeled calibration; reusing the original baseline under a shuffled label assignment would bias the null distribution\. Concretely, we combine a domain’s 30 concepts with the 30 calibration concepts, randomly reassign the domain/calibration label 10,000 times, and after each reassignment recompute bothb\(i,j\)b\(i,j\)and the domain’s mean calibrated distance from scratch\. Monte Carlopp\-values use the plus\-one correction\([12](https://arxiv.org/html/2608.21821#bib.bib14)\), which avoids ever reportingp=0p=0under finitely many permutations, followed by Holm adjustment\([8](https://arxiv.org/html/2608.21821#bib.bib15)\)to control the family\-wise error rate across the four domain tests\.
#### Concept bootstrap\.
We compute percentile 95% intervals from 5,000 bootstrap draws \(i\.e\., random sampling with replacement\)\. Each draw resamples the 30 domain concepts and 30 calibration concepts separately, then recomputes the per\-pair baseline and domain contrast, applying the same baseline\-recomputation principle as the permutation test above\. Because the concepts were purposively selected rather than probability\-sampled, these intervals measure sensitivity to concept composition; they are not population\-sampling intervals for all possible domain concepts\.
#### Language\-node bootstrap\.
We assess how sensitive the concept\-level rankings \(the Concept\-level structure subsection\) are to which languages happen to be sampled\. We resample the 20 languages 5,000 times, reconstruct the induced dyads, and report each concept’s median rank, percentile rank interval, and top\- or bottom\-10 inclusion rate\. This design avoids treating the 190 overlapping dyads as independent, since each language appears in 19 of them – a different source of non\-independence from the concept\-sharing addressed above\.
#### Concept\-node bootstrap\.
Symmetrically, we assess how sensitive the language\-level rankings \(the Language structure subsection\) are to which concepts happen to be sampled\. We resample a domain’s 30 concepts 5,000 times and, on each draw, recompute every language’s mean calibrated distance across its 20−1\-1pairings and its rank within the domain\. We report each language’s median rank, percentile rank interval, and top\- or bottom\-4 inclusion rate, matching the four most divergent and four most aligned languages reported in the Language structure subsection\.
#### Mantel test\.
We compare domain\-level language\-distance matrices with Mantel tests\([9](https://arxiv.org/html/2608.21821#bib.bib13)\): Spearman correlations of the upper triangles with 10,000 label permutations\. We apply Holm adjustment\([8](https://arxiv.org/html/2608.21821#bib.bib15)\)to the six domain\-pair comparisons, following[16](https://arxiv.org/html/2608.21821#bib.bib5)\.
### 4\.4Divergence\-profile geometry
Because calibrated distance can be negative, the language\-pair matrix is not a valid multidimensional scaling \(MDS\) dissimilarity matrix\. Instead, for each domain we represent each language by a profile: its mean calibrated distance to every language in that domain, with the self\-distance set to zero\. This makes each profile a 20\-dimensional vector, where each entry corresponds to one of the 20 languages and gives the profile language’s mean calibrated distance to that target language over the domain’s concepts\. We center each profile dimension across languages so that the resulting geometry reflects each language’s relative pattern of divergence rather than an overall offset on any one target\-language dimension\. We then compute Euclidean distances between the centered profiles and apply two\-dimensional classical MDS\. When distances are Euclidean, classical MDS reduces to an eigendecomposition of the double\-centered Gram matrix and is equivalent to truncated SVD/PCA on the profile vectors; we use the distance\-matrix formulation because it also accepts the non\-Euclidean distance definitions used in the sensitivity checks below\.222We use classical MDS rather than nonlinear methods such as t\-SNE or UMAP because those methods preserve local neighbor rankings rather than global pairwise distances, offer no analogous stress or variance\-explained diagnostic, and are stochastic, which would confound the bootstrap stability check below with optimization randomness rather than data variability\.We report normalized stress and the proportion of positive\-eigenvalue variance represented in two dimensions\.
To assess stability, we resample the domain’s 30 concepts 500 times and rebuild the profiles and MDS\. We then correlate pairwise distances in each bootstrap projection with those in the full\-sample projection\. As sensitivity checks, we also compare the geometry with MDS based on a non\-negative constant shift of off\-diagonal calibrated distance values and with MDS based on raw cosine distances\.
## 5Results
### 5\.1Domain\-level divergence
Table[2](https://arxiv.org/html/2608.21821#S5.T2)shows the domain results under LaBSE\. Religion lies significantly above the calibration baseline \(\+0\.034\+0\.034, Holm\-adjustedp=\.0068p=\.0068\); science/tech lies significantly below it \(−0\.024\-0\.024, Holm\-adjustedp=\.030p=\.030\), meaning its articles align more closely across languages than the calibration articles do\. Politics and pop culture do not differ from the baseline\. Under LaBSE, culturally loaded content diverges more for religion but not for politics as a whole\. Political divergence instead concentrates in specific sensitive concepts \(see the Concept\-level structure subsection\)\. The Encoder robustness subsection examines which results transfer to other encoders\.
Table 2:Mean calibrated distance by domain, percentile 95% concept\-bootstrap intervals \(5,000 draws\), and raw and Holm\-adjusted two\-sided permutationpp\-values \(10,000 permutations\)\. Domain and calibration concepts are resampled separately, and the per\-pair baseline is recomputed on every bootstrap or permutation draw\. The 30 concepts per group, not the thousands of overlapping article\-pair observations, are the resampling units; because concepts were purposively selected, intervals measure sensitivity to concept composition rather than population sampling uncertainty\.DomainMean calibrated distanceConcept\-bootstrap 95% intervalTwo\-sidedppHolmppReligion\+0\.0341\+0\.0341\[\+0\.0149,\+0\.0530\]\[\+0\.0149,\\ \+0\.0530\]0\.0020\.0020\.0070\.007Politics\+0\.0045\+0\.0045\[−0\.0151,\+0\.0238\]\[\-0\.0151,\\ \+0\.0238\]0\.6530\.6530\.6830\.683Pop culture−0\.0085\-0\.0085\[−0\.0250,\+0\.0079\]\[\-0\.0250,\\ \+0\.0079\]0\.3420\.3420\.6830\.683Science/tech−0\.0243\-0\.0243\[−0\.0416,−0\.0067\]\[\-0\.0416,\\ \-0\.0067\]0\.0100\.0100\.0300\.030
### 5\.2Calibration is necessary
Two results show why calibration is necessary\. First, neutral\-article baselines range from0\.1070\.107to0\.3890\.389across language pairs\. This3\.6×3\.6\\timesrange is much larger than the domain effects of interest \(all absolute mean calibrated distances are below0\.040\.04\), so raw distances largely reflect pair\-specific encoder alignment and edition\-level writing differences\. Second, raw distances average0\.1770\.177within language families but0\.2170\.217across families\. After calibration, this gap shrinks: mean calibrated distance is\+0\.005\+0\.005within families and\+0\.001\+0\.001across them\. A smaller script effect remains \(\+0\.009\+0\.009within scripts vs\.−0\.002\-0\.002across scripts\), but the domain results also hold within script groups\. The Calibration\-set composition subsection reports an independent check against content\-controlled parallel text, which speaks to whether this shrinkage reflects genuine per\-pair encoder alignment rather than an artifact of the embedding pipeline\.
### 5\.3Language structure
Figure 1:Mean calibrated distance between language editions by domain on a shared scale \(red: above the calibration floor; blue: below; gray: no valid pairs\)\. Every panel uses the same language order, obtained by clustering the mean calibrated distance matrix across all four domains\. The same cell therefore represents the same language pair in every panel\.Figure[1](https://arxiv.org/html/2608.21821#S5.F1)shows the four domain matrices under a shared color scale and a fixed language ordering \(hierarchical clustering of the mean calibrated distance matrix over all four domains’ concepts\)\. The religion panel is systematically warmer than the science panel, visualizing the domain result\. For each language, we average its calibrated distance across all pairings with the other 20−1\-1languages in the domain\. Within religion, the most divergent languages by this measure are Korean \(\+0\.056\+0\.056\), Polish \(\+0\.056\+0\.056\), Persian \(\+0\.055\+0\.055\), and Turkish \(\+0\.051\+0\.051\); the most aligned are Japanese \(−0\.009\-0\.009\), Chinese \(\+0\.001\+0\.001\), Hebrew \(\+0\.018\+0\.018\), and Thai \(\+0\.021\+0\.021\)\. Chinese warrants a caveat here: zh\.wikipedia has been blocked in the PRC since 2015–2019, so its editor community and this alignment mostly reflect Taiwan, Hong Kong, and overseas Chinese contributors rather than a PRC\-based perspective \(see the Discussion and Limitations section\)\. The largest single pairs are Arabic–Korean \(0\.1050\.105\), Persian–Korean \(0\.0870\.087\), and English–Persian \(0\.0870\.087\)\.
Table[3](https://arxiv.org/html/2608.21821#S5.T3)assesses how stable this religion\-domain ranking is under a concept\-node bootstrap \(the Method section\), which resamples the domain’s 30 concepts 5,000 times and recomputes each language’s mean calibrated distance and rank\. The top cluster is more stable in membership than in exact order: Korean, Polish, Persian, and Turkish remain in the top four in 79\.9%, 74\.4%, 81\.5%, and 59\.2% of draws, and Arabic—ranked fifth—is a close contender at 52\.0%\. The aligned end is more stable: Japanese and Chinese remain in the bottom four in 100\.0% and 96\.3% of draws, while Hebrew and Thai are less certain \(64\.8% and 59\.1%\), and Russian—ranked sixteenth—is a comparably close contender at 47\.7%\.
Table 3:Stability of religion\-domain language rankings under 5,000 concept\-node bootstrap draws \(resampling the domain’s concepts; see the Method section\)\. Rank 1 is most divergent, and rank 20 is most aligned\. Tail\-4 rate is the proportion of draws in which a language lands in the top or bottom four, shown for languages observed at rank 5 or better, or within 5 of the bottom, since near\-threshold languages can also land there under resampling; each language’s rate is computed independently, so the shown values do not sum to 100%\.LangMeanMed\. rank95% intervalTail\-4 rateko\+0\.056\+0\.0563\[1,8\]\[1,\\ 8\]79\.9%pl\+0\.056\+0\.0563\[1,10\]\[1,\\ 10\]74\.4%fa\+0\.055\+0\.0553\[1,7\]\[1,\\ 7\]81\.5%tr\+0\.052\+0\.0524\[1,10\]\[1,\\ 10\]59\.2%ar\+0\.051\+0\.0514\[1,16\]\[1,\\ 16\]52\.0%en\+0\.044\+0\.0447\[3,11\]\[3,\\ 11\]–hi\+0\.041\+0\.0418\[3,15\]\[3,\\ 15\]–es\+0\.040\+0\.0408\[3,15\]\[3,\\ 15\]–pt\+0\.036\+0\.03610\[5,15\]\[5,\\ 15\]–sw\+0\.036\+0\.03610\[2,17\]\[2,\\ 17\]–fi\+0\.035\+0\.03511\[4,17\]\[4,\\ 17\]–fr\+0\.035\+0\.03511\[5,16\]\[5,\\ 16\]–id\+0\.034\+0\.03411\[6,16\]\[6,\\ 16\]–vi\+0\.033\+0\.03312\[5,17\]\[5,\\ 17\]–de\+0\.027\+0\.02715\[10,17\]\[10,\\ 17\]–ru\+0\.022\+0\.02216\[11,19\]\[11,\\ 19\]47\.7%th\+0\.020\+0\.02017\[11,19\]\[11,\\ 19\]59\.1%he\+0\.019\+0\.01917\[11,18\]\[11,\\ 18\]64\.8%zh\+0\.001\+0\.00119\[16,20\]\[16,\\ 20\]96\.3%ja−0\.010\-0\.01020\[19,20\]\[19,\\ 20\]100\.0%To check whether religion’s language structure reduces to a simple, low\-dimensional picture, we project each language’s centered divergence profile \(the Method section\) into two dimensions via classical MDS\. We do not visualize the result: the two\-dimensional solution captures only 68\.6% of the positive\-eigenvalue variance and has normalized stress0\.2690\.269, a moderate\-to\-poor fit, and individual language positions are unstable under resampling\. Across 500 profile\-resampling draws, pairwise distances in the bootstrap and full\-sample projections have a median Spearman correlation of0\.7740\.774but a 2\.5th percentile of only0\.5760\.576, and specific nearest\-neighbor pairings are markedly less stable than the overall geometry \(e\.g\., in an earlier check, one pair of near\-neighbor languages selected each other as nearest neighbor in only 33\.8%–51\.0% of bootstrap draws\)\. The overall geometry also correlates only moderately with raw\-distance MDS \(ρ=0\.47\\rho=0\.47\) and weakly with MDS of constant\-shifted calibrated distances \(ρ=0\.29\\rho=0\.29\), so even the coarse structure depends on which distance definition is used\. Given this fit and sensitivity, we treat the two\-dimensional profile geometry as a diagnostic that religion’s language structure is not fully summarized by two dimensions, not as a reliable map of which languages pattern together\.
### 5\.4Concept\-level structure
Mean calibrated distance produces a clear concept\-level pattern\. Ritual and institutional religious terms dominate the most divergent concepts: sacrifice \(\+0\.115\+0\.115\), clergy \(\+0\.093\+0\.093\), martyr \(\+0\.085\+0\.085\), temple \(\+0\.076\+0\.076\), blasphemy \(\+0\.074\+0\.074\), salvation \(\+0\.071\+0\.071\), pilgrimage \(\+0\.066\+0\.066\), and scripture \(\+0\.064\+0\.064\)\. The list also includes politically sensitive concepts \(censorship\+0\.108\+0\.108, refugee\+0\.057\+0\.057\) and locally specific pop\-culture terms \(streetwear\+0\.080\+0\.080, television drama\+0\.063\+0\.063\)\. By contrast, the most aligned concepts describe standardized bodies of knowledge or canonical ideals: evolution \(−0\.072\-0\.072\), democracy \(−0\.068\-0\.068\), bacteria \(−0\.068\-0\.068\), DNA \(−0\.067\-0\.067\), electricity \(−0\.066\-0\.066\), civil rights \(−0\.064\-0\.064\), and quantum mechanics \(−0\.063\-0\.063\)\.
The extremes are stable under 5,000 language\-node bootstrap draws: sacrifice and censorship remain in the top ten in 99\.0% and 99\.3% of draws, while concepts near the cutoff are far less stable, e\.g\., pilgrimage and scripture enter the top ten in only 45\.5% and 37\.7% \(Appendix Table[6](https://arxiv.org/html/2608.21821#A1.T6)\)\. We therefore interpret broad tiers rather than an exact ordering\. Canonical political concepts also vary: democracy and human rights \(−0\.007\-0\.007\) are highly standardized, liberalism is below the floor \(−0\.038\-0\.038\), and freedom is near it \(\+0\.010\+0\.010\)\. This variation explains why politics averages to the floor even though censorship diverges sharply\.
### 5\.5Domains share geometry
All six Mantel correlations between the four domain matrices are positive \(Spearmanρ=0\.36\\rho=0\.36–0\.740\.74\)\. Four remain significant after Holm correction \(pHolm≤\.020p\_\{\\mathrm\{Holm\}\}\\leq\.020\)\. The politics–pop culture and religion–pop culture comparisons are borderline \(bothpHolm=\.0502p\_\{\\mathrm\{Holm\}\}=\.0502\)\. Thus, domains share much of their language\-pair structure: because Mantel correlations compare each matrix’s internal rank order rather than its absolute values, a sharedρ\\rhodoes not require similar raw distances, only a similar relative pattern of which language pairs are more or less divergent than others\. Religion’s distinctiveness is therefore a shift in overall*level*—its whole matrix runs higher—rather than a wholly different arrangement of which languages pattern together\.
## 6Robustness
### 6\.1Encoder robustness
The headline results use LaBSE\. To separate data properties from encoder properties, we repeat the entire pipeline with two alternatives\. Paraphrase\-multilingual\-mpnet\-base\-v2 \(MPNet\) is a paraphrase\-distilled encoder with a 128\-token window\([13](https://arxiv.org/html/2608.21821#bib.bib16)\)\. Universal\-sentence\-encoder\-CMLM \(CMLM\) shares LaBSE’s architecture and 256\-token window, but its primary training objective is conditional masked language modeling on monolingual sentence context; its multilingual variant adds bitext retrieval and NLI only as auxiliary co\-training tasks, not as the dominant objective the way translation\-ranking is for LaBSE\([17](https://arxiv.org/html/2608.21821#bib.bib17)\)\. For both models, we keep sentence splitting, token windowing, mean pooling, per\-pair calibration, and permutation tests unchanged\.
Table[4](https://arxiv.org/html/2608.21821#S6.T4)shows that the ranking replicates\. All three encoders place religion first and science/technology last\. The concept rankings correlate with LaBSE at Spearmanρ=0\.75\\rho=0\.75for MPNet and0\.790\.79for CMLM \(bothp<10−22p<10^\{\-22\},n=120n=120concepts\)\. The magnitude of the religion effect does not replicate: mean calibrated distance falls from\+0\.034\+0\.034with LaBSE to\+0\.010\+0\.010with MPNet and\+0\.004\+0\.004with CMLM\. Neither replication encoder yields a significant domain\-level test \(Holm\-adjustedp=\.37p=\.37and\.76\.76\)\. Science/technology, by contrast, remains below the baseline under all three encoders \(adjustedp=\.030p=\.030,\.006\.006, and<\.001<\.001\)\. LaBSE and CMLM differ in how central cross\-lingual alignment is to training: LaBSE optimizes translation\-ranking as its sole objective on 6 billion bilingual pairs, while CMLM treats bitext retrieval as an auxiliary task alongside a primarily monolingual objective\. This difference in training emphasis and bilingual data scale plausibly contributes to LaBSE’s stronger religion effect\. We treat the domain and concept ordering as encoder\-robust, but the positive religion effect as LaBSE\-specific\.
Table 4:Mean calibrated distance by domain under LaBSE and two replication encoders \(MPNet: paraphrase\-multilingual\-mpnet\-base\-v2; CMLM: universal\-sentence\-encoder\-CMLM\), using the same language\-pair\-weighted estimand throughout\. Eachppcell reports the raw two\-sided permutation value followed by its Holm\-adjusted value in parentheses \(10,000 permutations; four domains per encoder\)\. The final row gives Spearman correlations of per\-concept divergence rankings against LaBSE \(n=120n=120concepts\)\. Relative ordering replicates; magnitudes and religion’s significance are encoder\-dependent\.LaBSEMPNetCMLMDomainCalibratedpp\(Holm\)Calibratedpp\(Holm\)Calibratedpp\(Holm\)Religion\+0\.0341\+0\.03410\.0020\.002\(0\.0070\.007\)\+0\.0098\+0\.00980\.3690\.369\(0\.3690\.369\)\+0\.0043\+0\.00430\.7640\.764\(0\.7640\.764\)Politics\+0\.0045\+0\.00450\.6530\.653\(0\.6830\.683\)−0\.0255\-0\.02550\.0120\.012\(0\.0350\.035\)−0\.0423\-0\.04230\.0040\.004\(0\.0080\.008\)Pop culture−0\.0085\-0\.00850\.3420\.342\(0\.6830\.683\)−0\.0191\-0\.01910\.0760\.076\(0\.1520\.152\)−0\.0411\-0\.04110\.0030\.003\(0\.0070\.007\)Science/tech−0\.0243\-0\.02430\.0100\.010\(0\.0300\.030\)−0\.0319\-0\.03190\.0010\.001\(0\.0060\.006\)−0\.0633\-0\.0633<0\.001<0\.001\(<0\.001<0\.001\)Concept\-rankρ\\rhovs\. LaBSE—0\.7540\.7540\.7890\.789
### 6\.2Bot\-created and translation\-generated articles
Low\-resource editions contain many articles created by bots or with the ContentTranslation tool\. These processes may homogenize content and reduce calibrated distance\. We audit 889 articles: every valid article in Swahili, Hindi, Thai, Vietnamese, and Indonesian, plus 15 sampled concepts in every other language\. We flag an article if it was created through ContentTranslation \(identified by thecontenttranslationrevision tag\), created by an account whose username indicates a bot \(ends in “bot”\), or has such accounts among more than 50% of the editors in its last 30 revisions; the MediaWiki revision API we query exposes ContentTranslation tags directly but not an authoritative bot flag, so bot status is a username heuristic rather than a verified account attribute\.
Overall, 13\.3% of audited articles are flagged\. Swahili has the highest rate at 41\.5% \(44/106\), followed by Hindi \(15%\) and Vietnamese \(13%\); most European editions are at or below 7%\. Swahili thus has both the lowest concept coverage and the most bot\- and translation\-mediated content\. Excluding flagged articles changes mean religion calibrated distance only from\+0\.034\+0\.034to\+0\.032\+0\.032, and no domain changes sign\. Because the audit is exhaustive for only five editions and samples 15 concepts elsewhere, it is a subset robustness check rather than a corpus\-wide exclusion analysis\.
### 6\.3Calibration\-set composition
The calibration set contains five subdomains: chemical elements \(8 concepts\), small numbers \(4\), basic colors \(5\), common animals \(8\), and universal natural kinds such as water and mountain \(5\)\. We repeat the analysis five times, omitting one subdomain each time\. Mean baselines change by at most0\.0110\.011: from0\.2150\.215with the full set to0\.2050\.205–0\.2230\.223\. Every omission preserves the domain ordering\. Religion remains above the baseline, with mean calibrated distance from\+0\.026\+0\.026\(without natural kinds\) to\+0\.044\+0\.044\(without colors\), and one\-sided permutationp≤\.008p\\leq\.008in every case \(full set:\+0\.034\+0\.034,p<\.001p<\.001\)\. Politics remains at the baseline and science/technology below it; no single calibration subdomain drives the result\.
The leave\-one\-out test cannot detect bias shared by all five subdomains\. If every neutral article contains some cultural variation, all Wikipedia\-based floors will be inflated\. We therefore compare them with floors from FLORES\-200 devtest\([11](https://arxiv.org/html/2608.21821#bib.bib7)\), where the same 1,012 sentences are professionally translated into all 20 languages\. We use the same embedding pipeline and pool ten consecutive sentences into pseudo\-documents that approximate the mean calibration\-article length\. Because the content is parallel, this floor mainly isolates encoder noise; translation from a common English source makes it a lower bound\.
Per\-pair calibration depends on the*structure*of the floors across language pairs\. The Wikipedia and parallel\-text floors have similar structure: Spearmanρ=0\.79\\rho=0\.79–0\.820\.82across pooling levels and Chinese script variants \(n=190n=190,p<10−41p<10^\{\-41\}\)\. Thus, most pair\-to\-pair variation removed by our floors reflects encoder alignment\. Their average*levels*, however, differ:0\.2150\.215for Wikipedia articles versus0\.0620\.062for pooled parallel text\. This gap reflects independent authorship—different sentences, emphasis, and style—plus any remaining cultural content in the calibration articles\. Both components raise the Wikipedia floor and push calibrated distance downward\. Positive values are therefore conservative\. Negative science/technology values mean greater alignment than independently written neutral articles, not greater alignment than translation\-equivalent text\.
## 7Discussion and Limitations
#### What calibrated distance does and does not measure\.
Calibrated distance is relative\. It measures how much more differently two editions describe a concept than they describe calibration concepts with stable denotations, under the same encoder\. Calibration reduces pair\-specific encoder effects and the aggregate language\-family contrast, although a small same\-script effect remains\. Calibrated distance is therefore useful for comparisons across domains, concepts, and language pairs measured in the same way\. It is not an absolute or ground\-truth measure of cultural difference\. It also cannot distinguish two editions that genuinely disagree about a concept’s meaning from two editions that emphasize different facets of a concept they would otherwise describe the same way; a high calibrated distance value is consistent with either\.
#### Implications for multilingual language models\.
Wikipedia is a major source of pretraining data for multilingual language models\. These models can answer the same factual question differently across query languages, such as crediting the radio to Popov or Marconi\([7](https://arxiv.org/html/2608.21821#bib.bib6)\)\. Our results show where such divergence already appears in Wikipedia: in ritual and institutional religious concepts and in specific politically sensitive concepts, not in politics or science as whole domains\. Language family alone does not explain the remaining pairwise patterns\. Calibrated distance does not directly predict model behavior because pretraining mixtures and post\-training also shape outputs\. Still, when a model’s answers differ by language, our matrices help distinguish disagreement already present in encyclopedic data from disagreement introduced by the model\.
#### Scope and validity limitations\.
First, we do not validate the metric against human ratings of semantic difference\. Second, language editions are neither nations nor cultures\. Chinese illustrates the problem: zh\.wikipedia\.org is one edition, and its Traditional and Simplified variants display the same underlying content\. Because Wikipedia is blocked in the PRC, its editor community is weighted toward Taiwan, Hong Kong, and overseas Chinese communities\. Our “zh” result therefore reflects a transnational Chinese\-language edition, not a PRC\-based perspective\. Third, we analyze only lead sections; full articles may differ\. Fourth, our flags miss manual translations and translations that predate ContentTranslation, so undetected translation may reduce some estimates\. Fifth, Swahili has only 71% concept coverage and a heavily bot\-mediated corpus\. Sixth, our concept anchoring assumes that a shared Wikidata QID denotes the same conceptual scope across editions; our validation pipeline checks for missing sitelinks, disambiguation pages, and stubs, but does not independently verify scope equivalence, so some divergence for interpretively contested concepts could reflect a scope mismatch rather than differing description of the same referent\.
#### Measurement reliability limitations\.
First, rankings replicate across encoders, but the significant positive religion effect appears only under LaBSE \(see the Encoder robustness subsection\)\. Absolute magnitudes should not be transferred across encoders\. Second, the calibration floor comes from independently written articles, not parallel translations\. It therefore absorbs edition style and any remaining cultural content in the neutral concepts, as well as encoder noise\. The parallel\-text analysis shows that pair\-to\-pair structure is mainly encoder\-driven\. Any remaining inflation makes positive calibrated distance conservative, but negative values should be interpreted relative to independently written neutral articles rather than pure encoder noise\.
#### Future work\.
Future studies could validate calibrated distance against human ratings, compare independent editions that share a script \(e\.g\., Cantonese Wikipedia\), and compare platforms with different editorial governance \(e\.g\., Baidu Baike\)\. Tracking calibrated distance over revision histories could also reveal how framing changes over time\.
## 8Conclusion
We introduced calibrated distance, a cross\-lingual metric that subtracts a calibration baseline for each language pair\. Across 150 concepts, 20 languages, and four domains plus a calibration set, these baselines vary3\.6×3\.6\\timesand calibration greatly reduces the language\-family contrast\. Under LaBSE, religion lies above the baseline, science below it, and political divergence concentrates in specific sensitive concepts rather than the domain as a whole\. Two additional encoders preserve the ordering—religion highest and science/technology lowest—but not the significant positive religion effect\. Coverage and framing provide complementary views of cross\-lingual knowledge inequality\. We release code, data, and calibration baselines so future studies can measure framing without mistaking encoder artifacts for culture\.
## Acknowledgments and GenAI Usage Disclosure
We acknowledge support from the National Science and Technology Council of Taiwan under grant number 113\-2221\-E\-008\-100\-MY3\. We thank the National Center for High\-performance Computing \(NCHC\) of National Applied Research Laboratories \(NARLabs\) in Taiwan for providing computational and storage resources\.
This paper was prepared with substantial assistance from an LLM\-based coding agent \(Claude Code\), used under the author’s direction throughout the project: implementing the data and analysis pipeline; proposing and, upon the author’s approval, running analyses \(e\.g\., the encoder replications and the parallel\-text calibration check\); drafting and revising paper text, edited, and in several cases rejected or removed by the author; and locating references, which were verified against their sources before inclusion\. Other LLMs \(e\.g\., ChatGPT, Gemini\) assisted with language refinement\. The author made all research questions, inclusion and exclusion decisions, and final claims, reviewed all content, and takes full responsibility for it\.
## References
- A\. Arora, L\. Kaffee, and I\. AugensteinProbing pre\-trained language models for cross\-cultural differences in values\.InProceedings of the First Workshop on Cross\-Cultural Considerations in NLP \(C3NLP\),Dubrovnik, Croatia,pp\. 114–130\.External Links:[Document](https://dx.doi.org/10.18653/v1/2023.c3nlp-1.12)Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px3.p1.1)\.
- Cappaet al\.\(2025\)S\. Cappa, L\. Kong, P\. Peet, F\. Wei, Y\. Zhou, and J\. KaloFactual inconsistencies in multilingual Wikipedia tables\.arXiv preprint arXiv:2507\.18406\.Cited by:[§1](https://arxiv.org/html/2608.21821#S1.p2.1),[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px1.p1.1)\.
- Chenet al\.\(2025\)E\. Chen, R\. Zhan, Y\. Lin, and H\. ChenMore women, same stereotypes: unpacking the gender bias paradox in large language models\.InProceedings of the 34th ACM International Conference on Information and Knowledge Management \(CIKM\),External Links:[Document](https://dx.doi.org/10.1145/3746252.3760969)Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px3.p1.1)\.
- Chenet al\.\(2011\)H\. Chen, L\. Gou, X\. Zhang, and C\. L\. GilesCollabSeer: a search engine for collaboration discovery\.InProceedings of the 11th Annual International ACM/IEEE Joint Conference on Digital Libraries,New York, NY, USA,pp\. 231–240\.Cited by:[§3\.1](https://arxiv.org/html/2608.21821#S3.SS1.p2.1)\.
- Chenet al\.\(2017\)H\. Chen, J\. Wu, and C\. L\. GilesCompiling keyphrase candidates for scientific literature based on Wikipedia\.InProceedings of the Workshop on \(Meta\)\-Data Quality \(MDQual\) at the 21st International Conference on Theory and Practice of Digital Libraries \(TPDL\),Cited by:[§3\.1](https://arxiv.org/html/2608.21821#S3.SS1.p2.1)\.
- Fenget al\.\(2022\)F\. Feng, Y\. Yang, D\. Cer, N\. Arivazhagan, and W\. WangLanguage\-agnostic BERT sentence embedding\.InProceedings of the 60th Annual Meeting of the Association for Computational Linguistics \(ACL\),Cited by:[§1](https://arxiv.org/html/2608.21821#S1.p3.1),[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px4.p1.1),[§4\.1](https://arxiv.org/html/2608.21821#S4.SS1.p1.1)\.
- Gueyet al\.\(2026\)W\. Guey, P\. Bougault, W\. Zhang, V\. D\. de Moura, and J\. O\. GomesSame question, different history: language, national identity, and credit in large language models\.arXiv preprint arXiv:2606\.23164\.Cited by:[§1](https://arxiv.org/html/2608.21821#S1.p2.1),[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px3.p1.1),[§7](https://arxiv.org/html/2608.21821#S7.SS0.SSS0.Px2.p1.1)\.
- Holm \(1979\)S\. HolmA simple sequentially rejective multiple test procedure\.Scandinavian Journal of Statistics6\(2\),pp\. 65–70\.Cited by:[§4\.3](https://arxiv.org/html/2608.21821#S4.SS3.SSS0.Px1.p1.1),[§4\.3](https://arxiv.org/html/2608.21821#S4.SS3.SSS0.Px5.p1.1)\.
- Mantel \(1967\)N\. MantelThe detection of disease clustering and a generalized regression approach\.Cancer Research27\(2\),pp\. 209–220\.Cited by:[§4\.3](https://arxiv.org/html/2608.21821#S4.SS3.SSS0.Px5.p1.1)\.
- Masoudet al\.\(2025\)R\. I\. Masoud, Z\. Liu, M\. Ferianc, P\. Treleaven, and M\. RodriguesCultural alignment in large language models: an explanatory analysis based on Hofstede’s cultural dimensions\.InProceedings of the 31st International Conference on Computational Linguistics \(COLING\),Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px3.p1.1)\.
- NLLB Teamet al\.\(2022\)NLLB Team, M\. R\. Costa\-jussà, J\. Cross, O\. Çelebi, M\. Elbayad, K\. Heafield, K\. Heffernan, E\. Kalbassi, J\. Lam, D\. Licht, J\. Maillard,et al\.No language left behind: scaling human\-centered machine translation\.arXiv preprint arXiv:2207\.04672\.Cited by:[§6\.3](https://arxiv.org/html/2608.21821#S6.SS3.p2.1)\.
- Northet al\.\(2002\)B\. V\. North, D\. Curtis, and P\. C\. ShamA note on the calculation of empirical P values from Monte Carlo procedures\.American Journal of Human Genetics71\(2\),pp\. 439–441\.Cited by:[§4\.3](https://arxiv.org/html/2608.21821#S4.SS3.SSS0.Px1.p1.1)\.
- Reimers and Gurevych \(2020\)N\. Reimers and I\. GurevychMaking monolingual sentence embeddings multilingual using knowledge distillation\.InProceedings of the 2020 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),pp\. 4512–4525\.External Links:[Document](https://dx.doi.org/10.18653/v1/2020.emnlp-main.365)Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px4.p1.1),[§6\.1](https://arxiv.org/html/2608.21821#S6.SS1.p1.1)\.
- Samiret al\.\(2024\)F\. Samir, C\. Y\. Park, A\. Field, V\. Shwartz, and Y\. TsvetkovLocating information gaps and narrative inconsistencies across languages: a case study of LGBT people portrayals on Wikipedia\.InProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),Note:arXiv:2410\.04282Cited by:[§1](https://arxiv.org/html/2608.21821#S1.p2.1),[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px1.p1.1)\.
- Samoilenkoet al\.\(2016\)A\. Samoilenko, F\. Karimi, D\. Edler, J\. Kunegis, and M\. StrohmaierLinguistic neighbourhoods: explaining cultural borders on Wikipedia through multilingual co\-editing activity\.EPJ Data Science5\(9\)\.Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px1.p1.1)\.
- Sikoraet al\.\(2026\)J\. Sikora, P\. Lenartowicz, and H\. PlisieckiSupervised semantic differential for cross\-cultural concept analysis: a case study of human affect\.arXiv preprint arXiv:2605\.28225\.Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px2.p1.1),[§4\.3](https://arxiv.org/html/2608.21821#S4.SS3.SSS0.Px5.p1.1)\.
- Yanget al\.\(2021\)Z\. Yang, Y\. Yang, D\. Cer, J\. Law, and E\. DarveUniversal sentence representation learning with conditional masked language model\.InProceedings of the 2021 Conference on Empirical Methods in Natural Language Processing \(EMNLP\),pp\. 6216–6228\.External Links:[Document](https://dx.doi.org/10.18653/v1/2021.emnlp-main.502)Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px4.p1.1),[§6\.1](https://arxiv.org/html/2608.21821#S6.SS1.p1.1)\.
- Yasseriet al\.\(2014\)T\. Yasseri, A\. Spoerri, M\. Graham, and J\. KertészThe most controversial topics in Wikipedia: a multilingual and geographical analysis\.InGlobal Wikipedia: International and Cross\-Cultural Issues in Online Collaboration,P\. Fichman and N\. Hara \(Eds\.\),Note:arXiv:1305\.5566Cited by:[§2](https://arxiv.org/html/2608.21821#S2.SS0.SSS0.Px1.p1.1)\.
## Appendix AAppendix: Concept Inventory
Table[5](https://arxiv.org/html/2608.21821#A1.T5)lists all 150 concepts by domain, identified by their English Wikipedia titles; each is anchored by a Wikidata QID in the released data \(see the Data section\)\. The calibration set is broken out into its five subdomains, which the leave\-one\-out analysis of the Calibration\-set composition subsection exercises\.
Table 5:The 150 concepts, by domain \(English Wikipedia titles\)\.DomainConcepts \(English Wikipedia titles\)ReligionKarma, Dharma, Sin, Salvation, Heaven, Hell, Reincarnation, Nirvana, Prayer, Meditation, Fasting, Pilgrimage, Sacrifice, Prophet, Messiah, Monotheism, Polytheism, Atheism, Agnosticism, Secularism, Religious conversion, Religious tolerance, Blasphemy, Martyr, Afterlife, Ritual, Clergy, Temple, Scripture, Creation mythPoliticsDemocracy, Liberalism, Freedom, Human rights, Socialism, Communism, Conservatism, Nationalism, Populism, Authoritarianism, Revolution, Civil rights, Rule of law, Separation of powers, Political corruption, Propaganda, Censorship, Capitalism, Welfare state, Immigration, Refugee, Colonialism, Imperialism, Self\-determination, Patriotism, National security, Freedom of speech, Equality before the law, Political polarization, Work\-life balanceScience/techArtificial intelligence, Machine learning, Internet, World Wide Web, Computer, Algorithm, Database, Cryptography, Quantum mechanics, Relativity, Evolution, Genetics, DNA, Vaccine, Climate change, Nuclear power, Renewable energy, Space exploration, Telescope, Microscope, Electricity, Gravity, Bacteria, Virus, Photosynthesis, Plate tectonics, Periodic table, Semiconductor, Robotics, BiotechnologyPop cultureAnime, Manga, Hip hop music, Rock music, Pop music, Cinema, Hollywood, Bollywood, K\-pop, Video game, Esports, Social media, Internet meme, Fandom, Cosplay, Television drama, Reality television, Celebrity, Influencer marketing, Streaming media, Comic book, Superhero, Science fiction, Fantasy, Fashion, Streetwear, Fast food, Coffeehouse, Beauty pageant, Sports fandomCalibration: chemical elementsHydrogen, Helium, Carbon, Oxygen, Gold, Silver, Iron, CopperCalibration: small numbersOne, Two, Three, TenCalibration: basic colorsRed, Blue, Green, Black, WhiteCalibration: common animalsDog, Cat, Horse, Cattle, Chicken, Elephant, Lion, TigerCalibration: natural kindsWater, Mountain, River, Sun, MoonTable 6:Stability of the ten highest\- and ten lowest\-ranked concepts under 5,000 language\-node bootstrap draws\. Rank 1 is most divergent and rank 120 most aligned\. Tail identifies the high\- or low\-divergence block; Tail\-10 inclusion is the proportion of draws in which a concept remains in the corresponding top or bottom ten\. Wide intervals caution against interpreting adjacent point\-estimate ranks as fixed\.ConceptDomainTailMeanMedian rankRank 95% intervalTail\-10 inclusionSacrificeReligionHigh\+0\.115\+0\.1152\[1,8\]\[1,\\ 8\]99\.0%CensorshipPoliticsHigh\+0\.108\+0\.1082\[1,8\]\[1,\\ 8\]99\.3%ClergyReligionHigh\+0\.093\+0\.0934\[1,21\]\[1,\\ 21\]84\.1%MartyrReligionHigh\+0\.085\+0\.0856\[1,19\]\[1,\\ 19\]81\.9%StreetwearPop cultureHigh\+0\.080\+0\.0807\[2,50\]\[2,\\ 50\]69\.8%TempleReligionHigh\+0\.076\+0\.0769\[2,29\]\[2,\\ 29\]60\.4%BlasphemyReligionHigh\+0\.074\+0\.0749\[2,27\]\[2,\\ 27\]58\.6%SalvationReligionHigh\+0\.071\+0\.07110\[2,33\]\[2,\\ 33\]53\.8%PilgrimageReligionHigh\+0\.066\+0\.06612\[2,43\]\[2,\\ 43\]45\.5%ScriptureReligionHigh\+0\.064\+0\.06413\[3,35\]\[3,\\ 35\]37\.7%K\-popPop cultureLow−0\.049\-0\.049107\[84,117\]\[84,\\ 117\]31\.4%AnimePop cultureLow−0\.060\-0\.060113\[101,118\]\[101,\\ 118\]67\.8%Quantum mechanicsScience/techLow−0\.063\-0\.063114\[100,120\]\[100,\\ 120\]70\.5%Civil rightsPoliticsLow−0\.064\-0\.064114\[89,120\]\[89,\\ 120\]65\.2%ElectricityScience/techLow−0\.066\-0\.066115\[105,120\]\[105,\\ 120\]81\.7%DNAScience/techLow−0\.067\-0\.067115\[98,120\]\[98,\\ 120\]75\.6%BacteriaScience/techLow−0\.068\-0\.068116\[104,120\]\[104,\\ 120\]84\.9%DemocracyPoliticsLow−0\.068\-0\.068116\[108,120\]\[108,\\ 120\]93\.5%EvolutionScience/techLow−0\.072\-0\.072117\[104,120\]\[104,\\ 120\]89\.9%VirusScience/techLow−0\.074\-0\.074118\[110,120\]\[110,\\ 120\]96\.8%Similar Articles
Small edits, large models: How Wikipedia advocacy shapes LLM values
This paper demonstrates that a small coordinated Wikipedia editing campaign can measurably shape how language models handle topics, using animal welfare as a case study.
BioDivergence: A Benchmark and Evaluation Framework for Hidden Contextual Contradictions in Biomedical Abstracts
Introduces BioDivergence, a benchmark and evaluation framework for detecting context-conditioned contradictions in biomedical abstracts, featuring a six-class conflict taxonomy and a silver dataset of 11,865 claim pairs.
When AI Takes Sides on Questions of Faith: Persistent Asymmetries in AI-Mediated Faith Guidance
This paper investigates whether large language models treat questions about religious conversions symmetrically, finding persistent asymmetries with certain faiths favored over others. The study tests 20 models across 182 religious pairings, revealing reproducible patterns that could have real-world implications.
Discovering Conceptual Metaphors Across Topics and Media Types
The paper presents an unsupervised method to extract linguistic metaphors and group them into conceptual metaphors, applying the approach to analyze framing differences in left- vs. right-leaning podcasts.
Domain Adaptation and Reasoning Frameworks in Language Models: A Controlled Experiment with Historical Cosmology
This paper investigates how domain adaptation reshapes explanatory behavior in language models by training on a pre-Copernican corpus, finding that fine-tuning shifts explanatory framing more than cosmological stance.