Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets
Summary
This paper introduces a method that uses LLMs combined with prediction markets to measure how information ecosystems bias strategic beliefs, applying it to Ukraine-related markets and finding that English news sources systematically distort territorial predictions.
View Cached Full Text
Cached at: 07/24/26, 05:16 AM
# Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets
Source: [https://arxiv.org/html/2607.20441](https://arxiv.org/html/2607.20441)
Mykola Khandoga1,Yevhen Kostiuk1,2,Anton Polishko1,Yurii Filipchuk1, Kostiantyn Kozlov1,Dmytro Zamriy1,Artur Kiulian1 1Future Principle2Aarhus University
###### Abstract
Every information ecosystem produces beliefs that shape strategic decisions\. Both human analysts and AI systems inherit the blind spots of their information sources\. We show that LLMs, combined with prediction markets, function as a calibrated instrument for measuring how far ecosystem\-induced beliefs deviate from an external reference: LLMs extract the beliefs a text corpus implies, and prediction market price trajectories – anchored at resolution by realised outcomes – provide the calibration reference against which to quantify the deviation\.
We isolate the bias contribution of specific text through ablation: varying information context while holding the model fixed, with a contaminated model that knows actual outcomes as control\. Applied to 111 Ukraine\-related prediction markets \(∼\\scriptstyle\\sim93,000 predictions, four models\), we find that English news context systematically biases territorial predictions, wrong 64–72% of the time \(p<10−6p<10^\{\-6\}\)\. A contaminated model that knows actual outcomes shows the same error rate, indicating the bias originates primarily in the text\. Supplementing with Ukrainian military\-analytical sources reduces the bias for all clean models; absolute\-error gains are partial and model\-dependent\.
We show that the distortion originates primarily in the sources, not the models\. Consistent across four architectures, it will persist in any system that processes them and propagate into downstream decisions\.
Belief Propagation in LLM World Models: Measuring Strategic Information Bias with Prediction Markets
Mykola Khandoga1, Yevhen Kostiuk1,2, Anton Polishko1, Yurii Filipchuk1,Kostiantyn Kozlov1,Dmytro Zamriy1,Artur Kiulian11Future Principle2Aarhus University
## 1Introduction
The beliefs propagated by news coverage about ongoing events have major consequences for policy, public opinion, and resource allocation\. Yet there exists no method to quantify how close they are to the public consensus\. Existing approaches either detect framing properties of text without measuring their downstream cost\(Ali and Hassan,[2022](https://arxiv.org/html/2607.20441#bib.bib2); Otmakhova et al\.,[2024](https://arxiv.org/html/2607.20441#bib.bib14)\), or evaluate LLM forecasting accuracy without analyzing the information diet that drives it\(Karger et al\.,[2025](https://arxiv.org/html/2607.20441#bib.bib10); Halawi et al\.,[2024](https://arxiv.org/html/2607.20441#bib.bib9)\)\.
Closing this gap requires solving two problems\. First, we need a model that internalizes discourse framing – not classifying frames from the outside, but absorbing them so its output reflects the belief the text induces\. Second, we need a grounded scale against which to measure that belief – an external reference anchored by realised outcomes, not another model’s opinion\.
LLMs solve the first problem\. In\-context learning operates as implicit Bayesian inference over latent concepts in the input\(Xie et al\.,[2022](https://arxiv.org/html/2607.20441#bib.bib19)\), mechanistically equivalent to gradient descent on internal representations\(von Oswald et al\.,[2023](https://arxiv.org/html/2607.20441#bib.bib16)\)\. The model doesn’t just read the text – it updates its beliefs toward what the text implies\. The output probability is the induced belief\.
Prediction markets solve the second\. A belief without an external reference is just an opinion\. Prediction markets\(Wolfers and Zitzewitz,[2004](https://arxiv.org/html/2607.20441#bib.bib17),[2006](https://arxiv.org/html/2607.20441#bib.bib18)\)provide continuous, financially incentivized probability estimates that are eventually anchored by realised outcomes\. We use them in two distinct roles: the binary resolution gives us a low\-power but genuine ground truth \(§4\.1\), while the continuous price trajectory serves as the calibration reference for all model comparisons\. The delta between the LLM\-induced belief and market price, measured in percentage points \(pp\), is our calibrated measure of framing cost\.
Our goal is to measure the bias that a specific text corpus induces – how many pp closer to or further from the market estimate does this text push the model’s prediction? An LLM prediction reflects both parametric knowledge from pretraining and in\-context beliefs induced by the prompt\. To isolate each source’s contribution, we construct an ablation ladder:
- •Aprovides market overview and current price data – the minimal context from which the model reasons using only parametric knowledge\.
- •Badds a price chart: structured numerical signal without narrative framing\.
- •Cadds English news articles: narrative without the rest of the context\.
- •Dcombines all English\-language sources – chart, news, war map, trader comments – representing the full English information ecosystem\.
- •DUAsupplements D with Ukrainian military sources: General Staff reports, frontline bloggers, defense media\.
Each transition is a measurement in pp: A→\\toB measures the value of enriched price history signal, A→\\toC the cost of English news narrative alone, A→\\toD the cost of the full English ecosystem, D→\\toDUAthe value of Ukrainian source diversification\. A formal framework is given in Appendix[A](https://arxiv.org/html/2607.20441#A1); Appendix[H](https://arxiv.org/html/2607.20441#A8)reports an exploratory decomposition of parametric and context\-induced bias components\.
Our contributions are:
1. 1\.A method for measuring the bias a text corpus induces via belief propagation in LLMs, in calibrated probability units, validated against prediction markets;
2. 2\.An ablation structure that isolates parametric from context\-induced bias, revealing that the English information ecosystem systematically distorts LLM predictions on territorial questions – a finding confirmed by a contaminated model control and by linguistic analysis of reasoning traces \(offense\-dominant verb framing, asymmetric counterfactual reasoning\) – and that supplementing with Ukrainian military\-analytical sources partially counterbalances the bias;
3. 3\.
## 2Related Work
LLMs as forecasters\.ForecastBench\(Karger et al\.,[2025](https://arxiv.org/html/2607.20441#bib.bib10)\)shows LLMs now outperform non\-expert crowds; agentic systems have reached superforecaster\-level performance\(Alur et al\.,[2025](https://arxiv.org/html/2607.20441#bib.bib3)\)\. We depart from this line entirely: rather than benchmarking accuracy, we exploit LLMs’ sensitivity to linguistic framing as a measurement instrument\. Our models need not be good forecasters – they need to faithfully reflect what the text implies\.
Computational framing analysis\.Media framing shapes public understanding of conflict\(Entman,[2004](https://arxiv.org/html/2607.20441#bib.bib6)\), and NLP work on factuality and bias of news media is surveyed inNakov et al\. \([2024](https://arxiv.org/html/2607.20441#bib.bib12)\)\. Methods range from codebook annotation\(Card et al\.,[2015](https://arxiv.org/html/2607.20441#bib.bib5)\)to LLM\-based classification of political bias in conflict coverage\(Baly et al\.,[2020](https://arxiv.org/html/2607.20441#bib.bib4); Al\-Harbi et al\.,[2026](https://arxiv.org/html/2607.20441#bib.bib1)\)\. Offense\-dominant framing in Western coverage of Ukraine has been documented qualitatively\(Ojala et al\.,[2024](https://arxiv.org/html/2607.20441#bib.bib13)\)and through topic modeling\(Ptaszek et al\.,[2024](https://arxiv.org/html/2607.20441#bib.bib15)\)\. These approaches classify frames – detecting what framing exists\. Our method measures what that framing costs, in calibrated probability units\.
LLM bias\.Biases in LLMs are documented across demographic dimensions\(Gallegos et al\.,[2024](https://arxiv.org/html/2607.20441#bib.bib8); Feng et al\.,[2023](https://arxiv.org/html/2607.20441#bib.bib7)\)\. These treat the model as the object of study\. Our method measures how biased text propagates*through*models into calibrated beliefs – the model is the instrument, not the subject\.
## 3Data and Methods
### 3\.1Dataset
We collected 111 Ukraine\-related prediction markets from Polymarket222[https://polymarket\.com](https://polymarket.com/)\(January 2025 – January 2026\): 65 territorial \(“Will side X control \[city\] by \[date\]?”\) and 46 diplomatic \(negotiations, sanctions, Zelenskyy suit\)\. For each market, we constructed rolling prediction points at∼\\scriptstyle\\sim8 cutoff dates with a median gap of∼\\scriptstyle\\sim16 days, creating instances where we know the current price, the actual price at each horizon \(6h, 12h, 1d, 2d, 3d, 5d and 7d\), and all information available up to the cutoff\.
Figure 1:One evaluation instance\. The model receives context up toTcutoffT\_\{\\mathrm\{cutoff\}\}under varying information conditions \(A–DUA\); we compare its prediction atTpredictionT\_\{\\mathrm\{prediction\}\}against the actual market price\.Each prediction is made under five information conditions:A\(market overview \+ current price data only\),B\(A \+ price chart image\),C\(A \+ English news blocks\),D\(A \+ chart \+ English news \+ war map \+ Polymarket trader comments\), andDUA\(D supplemented with Ukrainian\-language military sources: General Staff casualty reports, Telegram military bloggers, Militarnyi\)\. Conditions are identical across models; the contaminated model \(Gemini 3\.1 Pro Preview\) runs all conditions except DUA\.
The English news corpus linked to our 111 benchmark markets comprises 16,457 articles from 2,217 domains \(subset of a 122,290\-article GDELT collection; Appendix[F](https://arxiv.org/html/2607.20441#A6)\): 89% Western media, 3\.4% think tanks \(ISW\), 2\.1% Ukrainian English\-language outlets, 2\.8% Russian sources, and zero Ukrainian\-language analytical sources\. The DUAcorpus draws from DeepState frontline maps, General Staff daily loss reports, Ukrainian military bloggers, Militarnyi, Defense Express, and Ukrainian OSINT channels \(Table[4](https://arxiv.org/html/2607.20441#A6.T4)\)\.
### 3\.2Models
We evaluate three clean models – Gemini 2\.5 Flash, Gemini 2\.5 Pro, and GPT\-5\-mini – plus one contaminated control: Gemini 3\.1 Pro Preview, whose training data extends past market resolution dates\. The contaminated model’s blind predictions show near\-zero bias \(\+0\.35 pp vs \+2\.0 pp clean average\) and beat the no\-change baseline by 10\.4%, confirming knowledge of actual outcomes\.
Flash and Pro share training data \(Gemini 2\.5 family\) but differ in reasoning depth, enabling controlled comparison of processing effects\. All models output structured predictions with full reasoning traces\.
### 3\.3Statistical Framework
The market is the unit of independence throughout \(N=65N\{=\}65territorial,N=46N\{=\}46diplomatic\)\. Adjacent cutoffs have overlapping prediction windows \(∼\\scriptstyle\\sim44% overlap\), so all tests use market\-level aggregates with cluster\-robust inference\. We apply Bonferroni correction across 8 primary tests\. With 65 clusters, we detect Cohen’sd≥0\.35d\\geq 0\.35at 80% power\. Our accuracy baseline is*no\-change*: predict that the price at the horizon equals the current price\. We use two distinct references: realised binary outcomes as the ground truth anchor in §4\.1 \(low\-power but genuine\), and the continuous market price trajectory as the calibration reference for all model comparisons in §4\.2–4\.4\. Bias and MAE are therefore deviations from the market reference, not claims about reality\. Full statistical details in Appendix[B](https://arxiv.org/html/2607.20441#A2)\.
## 4Results
### 4\.1The Benchmark Is Biased – But Useful
Polymarket overestimates Russian territorial capture by \+3\.5 pp relative to actual outcomes \(t\(381\)=5\.58t\(381\)=5\.58,p<10−7p<10^\{\-7\},d=0\.29d=0\.29; this test is point\-level since it characterises a property of the benchmark itself, distinct from the market\-clustered tests used for model comparisons in §4\.2–4\.4\)\. Despite this bias, the market correlates strongly with outcomes \(r=0\.83r=0\.83,R2=0\.69R^\{2\}=0\.69\), and binary resolution provides insufficient power \(3/65 territorial markets resolved YES\)\. Note that Polymarket resolution for territorial markets relies on ISW and DeepState frontline updates, themselves expert assessments rather than direct observation; residual disagreements between these sources and on\-the\-ground reality are absorbed into the \+3\.5 pp figure\. We use the continuous price trajectory as the calibration reference for all downstream comparisons\.
### 4\.2English Context Destroys Signal
Blind models \(condition A\) show \+2\.0 pp average pro\-capture bias – already present in training data, but*less*than Polymarket’s \+3\.5 pp\. Adding English news \(condition D\) pushes models to \+3\.4 pp, nearly matching the market’s overestimation\. English news does not add information – it replaces the model’s more accurate prior with the discourse’s less accurate framing\. The shift is significant for Pro 2\.5 \(\+2\.4 pp,p=0\.0001p=0\.0001\) and GPT\-5\-mini \(\+1\.4 pp,p=0\.002p=0\.002\), both surviving Bonferroni correction\. Flash shows a consistent but smaller effect \(\+0\.5 pp,p=0\.066p=0\.066\)\. All bias measurements below are relative to the market price trajectory; §4\.1 establishes that this proxy is biased \(\+3\.5 pp\) but strongly correlated with outcomes \(r=0\.83r=0\.83\), meaning our estimates are conservative – the true distortion relative to reality is likely larger\.
When context pushes predictions toward capture, those pushes are wrong 64–72% of the time across all clean models \(binomial test vs 50%,p<10−6p<10^\{\-6\}; Table[1](https://arxiv.org/html/2607.20441#S4.T1)\)\. The bias is systematic and traceable: linguistic analysis of reasoning traces \(Appendix[L](https://arxiv.org/html/2607.20441#A12)\) shows Russia receives 2\.3–3\.7×\\timesmore offensive verbs, “advances into” territory 77 times while Ukraine never does, and models reason about “if Russia succeeds” 60 times but “if Ukraine succeeds” zero times\. Bias2accounts for only 2–9% of total error \(Appendix[G](https://arxiv.org/html/2607.20441#A7)\); we study it because it is directional, not because it dominates accuracy\.
Figure 2:MAE vs no\-change baseline across all information conditions\. Adding English context \(A→\\toD\) degrades predictions for all clean models; chart\-only \(B\) outperforms full context \(D\)\. DUApartially recovers accuracy\. The contaminated model \(Pro 3\.1\*\) beats baseline under all conditions; DUAwas not run on it\. Territorial markets, 7\-day horizon\.The full condition ladder \(Figure[2](https://arxiv.org/html/2607.20441#S4.F2); Appendix[I](https://arxiv.org/html/2607.20441#A9)\) reveals that chart\-only predictions \(B\) outperform full English context \(D\) for all clean models\. Diplomatic markets serve as placebo: context does not damage predictions \(p=0\.03p=0\.03improvement for Flash\), confirming a domain\-specific mechanism \(Appendix[K](https://arxiv.org/html/2607.20441#A11)\)\. The bias is directionally asymmetric: downward predictions carry genuine signal, while upward predictions carry the discourse’s offense\-dominant distortion\. Filtering out upward predictions converts all three models from losing to beating the no\-change baseline \(Appendix[D](https://arxiv.org/html/2607.20441#A4)\)\.
### 4\.3Contaminated Model Ablation
The contaminated model \(Pro 3\.1\*\) knows actual outcomes – it beats no\-change by 10\.4%\. Yet when English context pushes it toward capture, it is wrong at the same rate as clean models \(Table[1](https://arxiv.org/html/2607.20441#S4.T1)\)\.
Table 1:When English context pushes predictions toward capture, accuracy is 28–36% across four models with different knowledge levels \(p<10−6p<10^\{\-6\}for all, binomial test vs 50%\)\. The error rate is a property of the corpus, not model ignorance\.The pro\-capture push error rate is a property of the English news corpus, not of model ignorance \(Appendix[J](https://arxiv.org/html/2607.20441#A10)\)\. An inverted\-question robustness check confirms this is not an artifact of question framing \(Appendix[C](https://arxiv.org/html/2607.20441#A3)\)\.
### 4\.4Ukrainian Sources Reduce Bias; Accuracy Effects Are Model\-Dependent
Supplementing English news with Ukrainian military sources \(D→\\toDUA\) reduces pro\-capture bias across all three clean models \(Figure[3](https://arxiv.org/html/2607.20441#S4.F3)\)\. We use “correction” here in the sense of reducing deviation from the market reference; DUAis source diversification, not fact\-checking against a ground truth\.
For Flash, DUAeliminates the context\-induced directional shift: bias drops from \+0\.4 pp \(p=0\.066p=0\.066\) to \+0\.1 pp \(p=0\.378p=0\.378\), indistinguishable from blind prediction\. For Pro and GPT, significant pro\-capture bias persists \(p<0\.01p<0\.01\)\. Ukrainian sources provide a comparable absolute correction across models, but the outcome differs because models accumulate different amounts of context damage: Flash takes little damage from English text, so the correction is sufficient; Pro amplifies the offense\-dominant signal far beyond what source supplementation can repair \(Appendices[K](https://arxiv.org/html/2607.20441#A11),[E](https://arxiv.org/html/2607.20441#A5),[M](https://arxiv.org/html/2607.20441#A13)\)\.
Accuracy effects are more mixed\. DUAimproves MAE on average across clean models, but not uniformly: the blind condition A remains competitive for some configurations, and DUAhurts diplomatic predictions \(Appendix[K](https://arxiv.org/html/2607.20441#A11)\)\. The robust finding is bias reduction; absolute error improvements are partial and model\-dependent\.
Figure 3:Bias vs accuracy for each model under conditions A \(blind\), D \(English context\), and DUA\(D supplemented with Ukrainian sources\)\. Dashed arrows: A→\\toD \(English context damages\)\. Solid arrows: D→\\toDUA\(Ukrainian sources correct\)\. All solid arrows point left and down\. Territorial markets, 7\-day horizon\.
## 5Discussion and Conclusion
Our results indicate a measurable cost of information ecosystem misalignment with the market reference: English\-language context induces a systematic pro\-capture bias through both biased framing and source exclusion, and Ukrainian military sources partially counterbalance it\. The bias is robust \(p<10−6p<10^\{\-6\}for push accuracy\), domain\-specific \(territorial but not diplomatic\), and invariant to model knowledge \(contaminated model shows same push error rate\)\.
The practical implications are immediate\. Supplementing English retrieval with Ukrainian sources through multilingual RAG reduces directional bias across all clean models; absolute\-error improvements follow on average but are partial and model\-dependent\. Conservative reasoning \(Flash\) benefits most, while deeper reasoning \(Pro\) amplifies the offense\-dominant signal beyond what source supplementation can repair\. This makes model selection a critical lever: choosing conservative over deep reasoning can matter more than improving the information itself\. The parametric bias already present in condition A reflects an English\-centric information ecosystem and requires broadening source inclusion\.
A case study illustrates the thesis in miniature: all clean models confidently predicted Zelenskyy would wear a suit to a papal funeral – logically sound but culturally blind \(Appendix[N](https://arxiv.org/html/2607.20441#A14)\)\. The method we introduce turns ecosystem misalignment from a qualitative concern into a grounded quantity\.
## Limitations
With 65 territorial market clusters, we achieve 80% power to detect Cohen’sd≥0\.35d\\geq 0\.35\. Our MAE effects \(d=0\.25d=0\.25–0\.310\.31\) fall below this threshold, explaining non\-significance after Bonferroni correction\. The DUAvs D improvement does not reach significance at the market\-cluster level \(p=0\.10p=0\.10–0\.370\.37\)\. The Flash/Pro processing divergence, while controlled \(same training data\), is a single comparison\. Polymarket’s Ukraine markets may not generalize to other conflicts\. While the case study uses Ukrainian sources, the methodology generalises to any conflict where one information ecosystem is suspected of systematic framing distortion relative to another\.
## Ethical Considerations
Our dataset spans 111 prediction markets about Ukraine – from whether specific cities will be captured and communities displaced, to diplomatic negotiations, international sanctions, and aid decisions\. The territorial markets reduce the fate of real communities to price movements on a trading platform\. We find this commodification of human catastrophe deeply troubling\.
We use this data not to legitimize prediction markets, but because their structure inadvertently exposes something important: a measurable gap between what the English\-language information ecosystem implies about events in Ukraine and what is actually happening\. This gap – driven by both offense\-dominant framing within included sources and exclusion of Ukrainian analytical ones – has consequences beyond prediction accuracy\. Distorted understanding shapes international policy, humanitarian response, and the political will to support Ukraine\.
The induced bias is not merely dovish or negotiation\-oriented\. It systematically pushes toward a low\-agency, offense\-dominant view of Ukraine in which Ukrainian leverage is discounted and territorial loss is treated as more inevitable than reality later shows\. The worldview induced by the Anglo\-American source ecosystem qualitatively resembles later concessionist policy rhetoric that downplays Ukrainian leverage\. We leave this striking alignment for future study\.
The bias we document is not abstract\. When English\-language AI systems systematically overestimate Russian territorial success, they reinforce a narrative of inevitable Ukrainian loss that Ukrainian soldiers, analysts, and journalists work daily to counter – through sources that English\-language pipelines do not include\.
This work used AI\-based writing assistance tools for editing and formatting\.
## Acknowledgments
We gratefully acknowledge Amazon Web Services and DigitalOcean for the cloud compute credits and infrastructure that supported this work\. Model inference, training, and evaluation pipelines were run on AWS \(EC2 GPU instances, SageMaker, S3\); data collection and experiment tracking were hosted on DigitalOcean managed database and compute instances\.
## References
- Al\-Harbi et al\. \(2026\)Mohammed Al\-Harbi and 1 others\. 2026\.An evaluation of LLMs for political bias in Western media: Israel\-Hamas and Ukraine\-Russia wars\.*arXiv preprint arXiv:2601\.06132*\.
- Ali and Hassan \(2022\)Mohammad Ali and Naeemul Hassan\. 2022\.A survey of computational framing analysis approaches\.In*Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing*, pages 9335–9348\.
- Alur et al\. \(2025\)Rohan Alur, Bradly C Stadie, Daniel Kang, Ryan Chen, Matt McManus, Michael Rickert, Tyler Lee, Michael Federici, and 1 others\. 2025\.AIA forecaster: Technical report\.*arXiv preprint arXiv:2511\.07678*\.
- Baly et al\. \(2020\)Ramy Baly, Giovanni Da San Martino, James Glass, and Preslav Nakov\. 2020\.We can detect your bias: Predicting the political ideology of news articles\.In*Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing*, pages 4982–4991\.
- Card et al\. \(2015\)Dallas Card, Amber E Boydstun, Justin H Gross, Philip Resnik, and Noah A Smith\. 2015\.The media frames corpus: Annotations of frames across issues\.In*Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics*, pages 438–444\.
- Entman \(2004\)Robert M Entman\. 2004\.*Projections of Power: Framing News, Public Opinion, and U\.S\. Foreign Policy*\.University of Chicago Press\.
- Feng et al\. \(2023\)Shangbin Feng, Chan Young Park, Yohan Liu, and Yulia Tsvetkov\. 2023\.From pretraining data to language models to downstream tasks: Tracking the trails of political biases leading to unfair NLP models\.In*Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics*\.
- Gallegos et al\. \(2024\)Isabel O Gallegos, Ryan A Rossi, Joe Barber, Md Mehrab Tanjim, Sungchul Kim, Franck Dernoncourt, Tong Bui, Cheonbok Kim, Besmira Nushi, Duen Horng Yu, and 1 others\. 2024\.Bias and fairness in large language models: A survey\.*Computational Linguistics*, 50\(3\)\.
- Halawi et al\. \(2024\)Danny Halawi, Fred Shi, Sebastian Borgeaud, Adam Lerer, Pieter Abbeel, and Jacob Steinhardt\. 2024\.Approaching human\-level forecasting with language models\.*arXiv preprint arXiv:2402\.18563*\.
- Karger et al\. \(2025\)Ezra Karger, Houtan Bastani, Chen Yueh\-Han, Zachary Jacobs, Danny Halawi, Fred Zhang, and Philip E Tetlock\. 2025\.ForecastBench: A dynamic benchmark of AI forecasting capabilities\.In*International Conference on Learning Representations*\.
- Kuhn et al\. \(2023\)Lorenz Kuhn, Yarin Gal, and Sebastian Farquhar\. 2023\.Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation\.In*International Conference on Learning Representations*\.
- Nakov et al\. \(2024\)Preslav Nakov, Jisun An, Haewoon Kwak, Muhammad Arslan Mansurov, and Momin Mansurov\. 2024\.A survey on predicting the factuality and the bias of news media\.In*Findings of the Association for Computational Linguistics: ACL 2024*\. Association for Computational Linguistics\.
- Ojala et al\. \(2024\)Markus Ojala, Mervi Pantti, and Jenni Kangas\. 2024\.Framing the war in Ukraine: A comparative study of news coverage\.*Journalism Studies*\.
- Otmakhova et al\. \(2024\)Yulia Otmakhova, Shima Khanehzar, and Lea Frermann\. 2024\.Media framing: A typology and survey of computational approaches across disciplines\.In*Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\)*\.
- Ptaszek et al\. \(2024\)Grzegorz Ptaszek, Bogdan Yuskiv, and Serhii Khomych\. 2024\.War on frames: Text mining of conflict in Russian and Ukrainian news agency coverage on Telegram\.*Media, War & Conflict*, 17\(1\):41–61\.
- von Oswald et al\. \(2023\)Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, João Sacramento, Alexander Mordvintsev, Andrey Zhmoginov, and Max Vladymyrov\. 2023\.Transformers learn in\-context by gradient descent\.In*International Conference on Machine Learning*, pages 35151–35174\.
- Wolfers and Zitzewitz \(2004\)Justin Wolfers and Eric Zitzewitz\. 2004\.Prediction markets\.*Journal of Economic Perspectives*, 18\(2\):107–126\.
- Wolfers and Zitzewitz \(2006\)Justin Wolfers and Eric Zitzewitz\. 2006\.Interpreting prediction market prices as probabilities\.NBER Working Paper 12200, National Bureau of Economic Research\.
- Xie et al\. \(2022\)Sang Michael Xie, Aditi Raghunathan, Percy Liang, and Tengyu Ma\. 2022\.An explanation of in\-context learning as implicit Bayesian inference\.In*International Conference on Learning Representations*\.
## Appendix ATheoretical Framework
We formalize the mechanism studied in this paper\. The goal is not a general theory of conflict forecasting, but to make precise what we mean by*offense\-dominant*beliefs under source exclusion\.
#### Latent battlefield state\.
Letiiindex a market\-event pair\. Letyi∈\{0,1\}y\_\{i\}\\in\\\{0,1\\\}denote the realized outcome, whereyi=1y\_\{i\}=1corresponds to offensive success on the target event\. Each event has an unobserved latent statezi∈ℝz\_\{i\}\\in\\mathbb\{R\}capturing the true degree of offensive feasibility\.
#### Information ecosystems as biased signals\.
We consider two information ecosystems:EE\(English\-language\) andUU\(Ukrainian military\-analytical\)\. Each provides a noisy signal about the same latent state:
xiE=zi\+βE\+εiE,xiU=zi\+βU\+εiU,x\_\{i\}^\{E\}=z\_\{i\}\+\\beta\_\{E\}\+\\varepsilon\_\{i\}^\{E\},\\qquad x\_\{i\}^\{U\}=z\_\{i\}\+\\beta\_\{U\}\+\\varepsilon\_\{i\}^\{U\},whereεiE,εiU\\varepsilon\_\{i\}^\{E\},\\varepsilon\_\{i\}^\{U\}are zero\-mean noise andβE,βU∈ℝ\\beta\_\{E\},\\beta\_\{U\}\\in\\mathbb\{R\}are systematic shifts\. An ecosystem is*more offense\-dominant*when it shifts beliefs further toward offensive success\. The English ecosystem is more offense\-dominant than the Ukrainian one wheneverβE\>βU\\beta\_\{E\}\>\\beta\_\{U\}\.
#### LLMs as belief elicitation instruments\.
For modelmm, letμm\\mu\_\{m\}denote the model’s effective baseline belief under condition A \(minimal context: market overview and current price data\), absorbing both pretraining priors and the model’s processing of the price signal\. Given a source setSS, the model produces
p^i\(m\)\(S\)=σ\(gi\(m\)\(S\)\),\\hat\{p\}\_\{i\}^\{\(m\)\}\(S\)=\\sigma\\\!\\bigl\(g\_\{i\}^\{\(m\)\}\(S\)\\bigr\),whereσ\(⋅\)\\sigma\(\\cdot\)is the logistic sigmoid andgi\(m\)\(S\)g\_\{i\}^\{\(m\)\}\(S\)is a latent score formed by combining the model prior with available signals:
gi\(m\)\(S\)=λm,0μm\+∑e∈Sλm,exieλm,0\+∑e∈Sλm,e\.g\_\{i\}^\{\(m\)\}\(S\)=\\frac\{\\lambda\_\{m,0\}\\mu\_\{m\}\+\\sum\_\{e\\in S\}\\lambda\_\{m,e\}\\,x\_\{i\}^\{e\}\}\{\\lambda\_\{m,0\}\+\\sum\_\{e\\in S\}\\lambda\_\{m,e\}\}\.Hereλm,0≥0\\lambda\_\{m,0\}\\geq 0weights the prior andλm,e≥0\\lambda\_\{m,e\}\\geq 0weights ecosystemee\. We treat these as effective parameters that absorb presentation\-order effects and model\-specific context processing\. This maps onto our three experimental conditions:
p^i\(m\)\(A\)\\displaystyle\\hat\{p\}\_\{i\}^\{\(m\)\}\(A\)=σ\(μm\),\\displaystyle=\\sigma\(\\mu\_\{m\}\),p^i\(m\)\(D\)\\displaystyle\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\)=p^i\(m\)\(\{E\}\),\\displaystyle=\\hat\{p\}\_\{i\}^\{\(m\)\}\(\\\{E\\\}\),p^i\(m\)\(DUA\)\\displaystyle\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\_\{UA\}\)=p^i\(m\)\(\{E,U\}\)\.\\displaystyle=\\hat\{p\}\_\{i\}^\{\(m\)\}\(\\\{E,U\\\}\)\.
###### Proposition 1\(Source exclusion shifts latent scores toward offense\)\.
Assume ecosystem signals satisfyxie=zi\+βe\+εiex\_\{i\}^\{e\}=z\_\{i\}\+\\beta\_\{e\}\+\\varepsilon\_\{i\}^\{e\}with𝔼\[εie\]=0\\mathbb\{E\}\[\\varepsilon\_\{i\}^\{e\}\]=0, and that the latent scoregi\(m\)\(S\)g\_\{i\}^\{\(m\)\}\(S\)is a positively weighted average of the model prior and available signals\. IfβE\>βU\\beta\_\{E\}\>\\beta\_\{U\}andλm,U\>0\\lambda\_\{m,U\}\>0, then for every eventii:
𝔼\[gi\(m\)\(D\)\]\>𝔼\[gi\(m\)\(DUA\)\]\.\\mathbb\{E\}\\\!\\left\[g\_\{i\}^\{\(m\)\}\(D\)\\right\]\>\\mathbb\{E\}\\\!\\left\[g\_\{i\}^\{\(m\)\}\(D\_\{UA\}\)\\right\]\.Excluding Ukrainian sources systematically increases the expected latent score toward offensive success\.
#### Proof\.
Substituting𝔼\[xiE\]=zi\+βE\\mathbb\{E\}\[x\_\{i\}^\{E\}\]=z\_\{i\}\+\\beta\_\{E\}and𝔼\[xiU\]=zi\+βU\\mathbb\{E\}\[x\_\{i\}^\{U\}\]=z\_\{i\}\+\\beta\_\{U\}:
𝔼\[gi\(m\)\(D\)\]=λm,0μm\+λm,E\(zi\+βE\)λm,0\+λm,E,\\mathbb\{E\}\\\!\\left\[g\_\{i\}^\{\(m\)\}\(D\)\\right\]=\\frac\{\\lambda\_\{m,0\}\\mu\_\{m\}\+\\lambda\_\{m,E\}\(z\_\{i\}\+\\beta\_\{E\}\)\}\{\\lambda\_\{m,0\}\+\\lambda\_\{m,E\}\},𝔼\[gi\(m\)\(DUA\)\]\\displaystyle\\mathbb\{E\}\\\!\\left\[g\_\{i\}^\{\(m\)\}\(D\_\{UA\}\)\\right\]=λm,0μm\+λm,E\(zi\+βE\)\+λm,U\(zi\+βU\)λm,0\+λm,E\+λm,U\.\\displaystyle=\\frac\{\\lambda\_\{m,0\}\\mu\_\{m\}\+\\lambda\_\{m,E\}\(z\_\{i\}\+\\beta\_\{E\}\)\+\\lambda\_\{m,U\}\(z\_\{i\}\+\\beta\_\{U\}\)\}\{\\lambda\_\{m,0\}\+\\lambda\_\{m,E\}\+\\lambda\_\{m,U\}\}\.Sinceλm,U\>0\\lambda\_\{m,U\}\>0andβU<βE\\beta\_\{U\}<\\beta\_\{E\}, the additional term pulls the weighted average below the English\-only value\.□\\square
#### From scores to probabilities\.
Sinceσ\(⋅\)\\sigma\(\\cdot\)is monotone increasing, the score ordering impliesp^i\(m\)\(D\)\>p^i\(m\)\(DUA\)\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\)\>\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\_\{UA\}\)pointwise for each realization of the noise\. The ordering𝔼\[p^i\(m\)\(D\)\]\>𝔼\[p^i\(m\)\(DUA\)\]\\mathbb\{E\}\[\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\)\]\>\\mathbb\{E\}\[\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\_\{UA\}\)\]then follows by taking expectations\. However, the*magnitude*of the probability gap depends on the curvature ofσ\\sigmaand the noise distribution, so the proposition is stated at the level of latent scores where the result is exact\.
#### Operational quantities\.
The framework yields three empirically measurable quantities\. The*harm of English context*:Hm=𝔼i\[p^i\(m\)\(D\)−p^i\(m\)\(A\)\]H\_\{m\}=\\mathbb\{E\}\_\{i\}\[\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\)\-\\hat\{p\}\_\{i\}^\{\(m\)\}\(A\)\]\. The*source exclusion cost*:Xm=𝔼i\[p^i\(m\)\(D\)−p^i\(m\)\(DUA\)\]X\_\{m\}=\\mathbb\{E\}\_\{i\}\[\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\)\-\\hat\{p\}\_\{i\}^\{\(m\)\}\(D\_\{UA\}\)\]\. The*directional bias*:Bm\(S\)=𝔼i\[p^i\(m\)\(S\)−yi\]B\_\{m\}\(S\)=\\mathbb\{E\}\_\{i\}\[\\hat\{p\}\_\{i\}^\{\(m\)\}\(S\)\-y\_\{i\}\]\. On territorial markets, positiveBm\(S\)B\_\{m\}\(S\)indicates systematic overprediction of offensive success\. Our main empirical finding isBm\(D\)\>Bm\(DUA\)B\_\{m\}\(D\)\>B\_\{m\}\(D\_\{UA\}\), withHm\>0H\_\{m\}\>0andXm\>0X\_\{m\}\>0\.
#### Limitations of the formalization\.
This framework is deliberately modest\. It does not claim that LLM outputs recover latent beliefs perfectly, nor that ecosystems differ only along a single dimension\. The weighted\-average assumption is an idealization: actual LLMs process context sequentially, and effective weights may depend on presentation order, prompt structure, and reasoning depth\. The formalization makes explicit the mechanism tested – if one ecosystem is more offense\-dominant, excluding the other should produce more offense\-dominant predictions – without claiming more than the experimental design supports\.
## Appendix BStatistical Methodology
#### Clustering\.
Adjacent cutoffs within a market have overlapping 7\-day prediction windows \(∼\\scriptstyle\\sim44% overlap at the median 16\-day gap\)\. Intra\-cluster correlation ranges from 0\.008 \(Flash\) to 0\.141 \(GPT\-5\-mini\)\. All tests use market\-level aggregates\.
#### Multiple testing\.
We apply Bonferroni correction across 8 primary tests\. Market bias \(territorial and diplomatic\), directional bias shift \(3 models\), and MAE damage \(3 models\)\. After correction: market bias \(p<10−4p<10^\{\-4\}\), Pro 2\.5 bias shift \(p=6\.8×10−4p=6\.8\\times 10^\{\-4\}\), and GPT bias shift \(p=0\.018p=0\.018\) survive\. MAE tests and Flash bias shift do not survive\. Push accuracy tests \(p<10−6p<10^\{\-6\}\) are excluded from this family\.
#### Power\.
WithN=65N\{=\}65clusters, 80% power atα=0\.05\\alpha=0\.05requiresd≥0\.35d\\geq 0\.35\. Observed: Pro 2\.5d=0\.50d=0\.50\(powered\), GPTd=0\.36d=0\.36\(marginal\), Flashd=0\.19d=0\.19\(underpowered\)\. MAE effectsd=0\.25d=0\.25–0\.310\.31\(underpowered\)\. Flash\-scale detection requires∼\\scriptstyle\\sim215 clusters\.
#### Permutation tests\.
Sign\-randomization tests \(10,000 iterations\) confirm all parametric results with concordantpp\-values\.
## Appendix CQuestion Inversion \(Anti\-X\)
We re\-run territorial predictions with inverted questions: “Will Russia*fail to capture*X?” with inverted prices \(1−p1\{\-\}p\)\. This is analogous to semantic entropy\(Kuhn et al\.,[2023](https://arxiv.org/html/2607.20441#bib.bib11)\)but diagnoses*context quality*rather than model confidence\.
When contradictions occur under condition D, they are directionally asymmetric\. For Pro 3\.1\* \(contaminated\), the asymmetry is 47:1 – original\-down/anti\-up vastly dominates\. English military reporting is stronger evidence*against failure*than*for capture*\.
## Appendix DSelective Trust
A zero\-parameter rule – trust the model only when it predicts downward movement – converts losing strategies to winning ones\. Flash selective:−\-3\.4% vs no\-change \(p<10−21p<10^\{\-21\}\)\. Pro 2\.5 selective:−\-3\.3%\. This reveals that downward predictions carry genuine signal while upward \(pro\-capture\) predictions carry systematic noise\. DUA\+ selective is the best combination for GPT\-5\-mini \(−\-0\.8%\), finally converting it to a winning strategy\.
## Appendix EPer\-Horizon Analysis
Pro\-capture bias grows with prediction horizon \(Table[2](https://arxiv.org/html/2607.20441#A5.T2), Figure[4](https://arxiv.org/html/2607.20441#A5.F4)\)\. DUAconsistently produces less push than D at every horizon\.
Figure 4:Left: pro\-capture bias grows with prediction horizon for all conditions\. Right: context\-induced push \(D−\-A\) and Ukrainian\-corrected push \(DUA−\-A\) across horizons\. DUAreduces push at every horizon\. Territorial markets, clean model average\.Table 2:Bias by horizon \(pp, clean model average, territorial\)\. Bias grows with horizon; DUAreduces push at all horizons\.
## Appendix FSource Ecosystem and Utility
### F\.1English Information Diet
The full GDELT collection spans all topics and comprises 122,290 articles from 6,232 domains\. Of these, 16,457 articles from 2,217 domains are linked to our 111 Ukraine benchmark markets \(§3\)\. The composition statistics below describe the benchmark subset\. The corpus is US\-centric \(63% of articles\) and Western\-oriented \(Table[3](https://arxiv.org/html/2607.20441#A6.T3)\)\.
Table 3:English source composition by category\. US sources account for 63% of articles\. Ukrainian\-language analytical sources: zero\.The top domains by volume are Yahoo \(5,864\), marketscreener \(1,142\), freerepublic \(781\), Daily Mail \(736\), globalsecurity\.org \(659\), ZeroHedge \(595\), ABC News \(560\), ISW \(534\), Independent \(464\), and Newsweek \(462\)\. The corpus reflects what GDELT surfaces as the English\-language information diet about Ukraine – mainstream wire content, finance aggregators, and partisan outlets\.Zero Ukrainian\-language analytical sources appear\.
### F\.2Ukrainian Information Diet
The DUAcondition supplements condition D with three source types \(Table[4](https://arxiv.org/html/2607.20441#A6.T4)\)\.
Table 4:Ukrainian sources added in DUA\.The 16 Telegram channels represent the core of the Ukrainian military information ecosystem: 5 active/reserve military \(including brigade commanders Magyar, Zhorin, Shtefan, Fedorenko, Krotevych\), 4 journalists \(Tsaplienko, Butusov, Kazanskyi\), 4 analysts \(Berezovets, Kovalenko, Mashovets, Zhdanov\), 1 official channel \(General Staff ZSU\), 1 tech specialist \(Beskrestnov\), and 1 commentator\. All channels represent Ukrainian perspectives – no Russian, neutral, or Western\-OSINT channels are included\. This is by design: DUAtests whether adding the Ukrainian military\-analytical ecosystem improves prediction accuracy, not whether balanced sourcing does\.
### F\.3Source Utility Analysis
We analyze which sources models actually cite in their reasoning traces \(condition D, 7d horizon, clean models,N=2,130N=2\{,\}130predictions\) and whether citing a source correlates with better or worse predictions\. The patterns below are correlational: ISW\-cited predictions performing worse does not establish that citing ISW*causes*worse predictions; both may reflect harder markets or more contested events\. Relative performance compares the model’s error when citing a source against the no\-change baseline for those same markets\.
Table 5:Source utility: frequency of citation in reasoning traces and correlation with prediction quality\. Relative performance = \(NC\_error−\-model\_error\) / NC\_error; negative = worse than no\-change\. ISW – the most\-cited analytical source \(51\.5%\) – correlates with*worse*directional accuracy \(50\.9%\) than predictions not citing it \(61\.8%\)\.#### The ISW paradox\.
ISW is the dominant analytical source \(51\.5% citation rate\)\. Yet predictions citing ISW show 50\.9% directional accuracy – a coin flip – compared to 61\.8% when ISW is not cited\. This is consistent with ISW’s offense\-dominant analytical framing: detailed, authoritative coverage of offensive operations that models internalize as evidence for territorial change\. The authority of the source amplifies the framing effect\.
#### Russian officials as accidental signal\.
Russian officials are cited at 43\.0% with the best directional accuracy \(61\.9%\) among high\-frequency sources\. This is counterintuitive until one considers the epistemic framing from Appendix[L](https://arxiv.org/html/2607.20441#A12): models treat Russian claims with skepticism \(“Russia*claims*…”\), and this discounting accidentally produces better\-calibrated predictions than absorbing ISW’s authoritative framing uncritically\.
#### Contaminated model source shift\.
The contaminated model \(Pro 3\.1\*\), which knows outcomes, shifts its citation patterns: ISW drops from 51\.5% to 35\.4%, Ukrainian officials from 36\.9% to 23\.1%, while price action rises from 76\.9% to 81\.0%\. A model with outcome knowledge relies less on narrative sources and more on the price signal – further evidence that narrative sources add framing, not information\.
## Appendix GBias\-Variance Decomposition
Bias2accounts for 2–9% of model MSE; variance dominates at 91–98%\. Polymarket: 8% bias2\. English context increases both components; Ukrainian sources reduce both\. Variance reduction is the larger contributor to MAE improvement for bold models\.
## Appendix HThree\-Layer Bias Decomposition
We present this decomposition as exploratory and correlational\. With 65 territorial markets, per\-model component estimates are noisy and we do not draw causal source\-level conclusions from them\. Our experimental conditions separate three components of pro\-capture bias \(Figure[5](https://arxiv.org/html/2607.20441#A8.F5)\), measured on territorial markets at 7\-day horizon\.
#### Parametric bias \(training data\)\.
Measured by condition A – no context, just the model’s priors\. Flash: \+1\.8 pp\. Pro: \+1\.0 pp\. GPT: \+3\.2 pp\.
#### Context\-induced bias \(English news\)\.
Measured by D−\-A: the additional pro\-capture shift from English context\. This is where models diverge dramatically\. Flash: \+0\.5 pp\. Pro: \+2\.4 pp\. GPT: \+1\.4 pp\. Pro accumulates 5×\\timesmore context damage than Flash despite sharing training data – deeper reasoning amplifies the offense\-dominant signal in English text\.
#### Ukrainian source correction\.
Supplementing with Ukrainian sources provides a roughly constant absolute correction across models: Flash−\-0\.3 pp, Pro−\-0\.1 pp, GPT−\-0\.3 pp \(Table[6](https://arxiv.org/html/2607.20441#A8.T6)\)\. What differs is not the correction but the denominator – how much context damage each model accumulates\. For Flash, 0\.3 pp corrects most of the 0\.5 pp context damage \(57%\)\. For Pro, a similar correction is negligible against 2\.4 pp of damage \(4%\)\.
Table 6:Three\-layer bias decomposition\. Parametric bias \(A\) is in the weights\. Context\-induced bias \(D−\-A\) comes from English news\. Ukrainian correction \(D−\-DUA\) is the bias reduction from supplementing with Ukrainian sources – roughly constant across models, but against vastly different context damage\.Table 7:DUArecovery of context\-induced damage\. All models improve on both dimensions\.This is a model selection result: Ukrainian sources help all models roughly equally in absolute terms, but their impact depends on how aggressively the model amplifies English context\. Conservative reasoning \(Flash\) keeps context damage small, making the correction sufficient\. Deep reasoning \(Pro\) amplifies English bias beyond what source supplementation can repair\.
Figure 5:Bias decomposition\. Flash and Pro share training data but differ 5×\\timesin context\-induced bias\. Ukrainian sources provide a similar absolute correction for all models, but it is swamped by Pro’s context damage\.
## Appendix IFull Condition Comparison
Table 8:MAE vs no\-change \(%\), territorial 7d\. Chart\-only \(B\) outperforms full context \(D\) for all clean models\.Figure 6:Per\-market MAE under D \(English\) vs DUA\(supplemented with Ukrainian sources\)\. Each dot is one territorial market\. Points below the diagonal indicate DUAoutperforms D\. DUAwins the majority of markets for Flash \(37/65\) and Pro \(32/65\)\. Territorial markets, 7\-day horizon\.
## Appendix JContaminated Model Details
Pro 3\.1\* shows near\-zero blind bias \(\+0\.35 pp vs \+2\.0 pp clean average\) and beats no\-change by 10\.4% blind, 9\.4% with context – the only model to beat baseline under any condition\. Despite this knowledge, its pro\-capture push accuracy \(27\.9%\) matches clean models, demonstrating that the directional signal in English military reporting overrides even direct outcome knowledge\.
## Appendix KDiplomatic Markets \(Placebo\)
DUAhurts diplomatic predictions for Flash \(\+5\.9% vs D\) and Pro \(\+5\.8%\), while GPT is unchanged \(−\-0\.1%\)\. Ukrainian military sources contain no diplomatic signal; English coverage of negotiations and sanctions is more informative\. This confirms domain specificity \(Figure[7](https://arxiv.org/html/2607.20441#A11.F7)\)\.
Figure 7:Domain specificity: English context damages territorial predictions \(left\) but not diplomatic ones \(right\)\. DUAcorrects territorial bias but hurts diplomatic predictions, confirming the intervention is domain\-specific\. 7\-day horizon\.
## Appendix LLinguistic Analysis of Offense\-Dominant Framing
The quantitative results in §4 stand independently of the analysis below\. We provide linguistic analysis of reasoning traces as qualitative illustration of the mechanism behind the statistical findings\.
We analyze 444 reasoning traces \(111 markets×\\times4 models, condition D, 7d horizon, first cutoff per market;∼\\scriptstyle\\sim159,000 words\) using regex\-based proximity matching with manual validation\. The analysis reveals eight dimensions of offense\-dominant framing, all pointing in the same direction across all models\.
### L\.1Agency: Who Acts
Russia is systematically framed as the agent\. Across all models, Russia appears as grammatical subject 60–66% of the time \(ratio 1\.4–2\.0×\\timesover Ukraine\), is the first actor mentioned in 76–86% of texts, and receives 1\.56–1\.76×\\timesmore total mentions\. Ukraine’s primary role is reactive\.
### L\.2Verb Semantics: What Each Side Does
Within 80 characters of each actor mention, 59–64% of verbs near Russia are offensive \(advance, capture, assault, deploy\) while Ukraine’s verbs split between defensive \(hold, resist, repel\) and diplomatic\. Russia receives 2\.3–3\.7×\\timesmore offensive verbs than Ukraine across all four models\.
### L\.3Success/Failure Framing
The most extreme asymmetry\. Russia’s success\-to\-failure language ratio ranges from 6\.7:1 to 14\.1:1\. Ukraine’s ratio is 1\.4–2\.5:1\. Russia is described in almost exclusively positive\-outcome terms \(advance, progress, gains, momentum\) even when the model predicts those outcomes will not materialize\. The contaminated model \(Pro 3\.1\*\) shows the highest ratio \(14\.1:1\) despite knowing most territorial outcomes resolve against capture – framing and prediction are decoupled\.
### L\.4Territorial Lexicon
Table 9:Territorial verbs attributed to each actor \(sum across 4 models, 444 traces\)\. “Advance into” appears 77 times near Russia andzerotimes near Ukraine\.
### L\.5Conditional Erasure
Models reason about hypothetical Russian success but never about Ukrainian success:
Table 10:Conditional framing in reasoning traces\. Ukrainian success is never considered as a scenario\.Pro 3\.1\* produces 37 “if Russia succeeds” constructions – the most of any model – despite knowing most such outcomes do not occur\.
### L\.6Epistemic Framing
Russia “claims” \(224 instances\) while Ukraine “denies” \(20 instances; Russia: 1\)\. Ukraine’s primary epistemic role is refuting Russian assertions rather than making its own\. Russia is also “confirmed” 2×\\timesmore than Ukraine, creating a paradox where Russian assertions are simultaneously more doubted and more validated\.
### L\.7Syntactic Subordination
“Despite Ukrainian resistance, Russia continues to advance” appears 30 times\. The inverse –“Despite Russian challenges, Ukraine holds” – appears 6 times\. Ukrainian action is systematically placed in concessive clauses; Russian action occupies the main clause\. Ukrainian defense is framed as*overcome*; Russian offense as*persisting*\.
### L\.8Composite Scorecard
MetricGPTFlashPro3\.1\*Mention ratio \(R/U\)1\.561\.671\.761\.68Offensive verb ratio2\.283\.203\.703\.34Russia S/F ratio8\.19\.06\.814\.1Ukraine S/F ratio1\.42\.22\.51\.6Subject ratio \(R/U\)1\.391\.961\.871\.47Russia first \(%\)78\.679\.684\.085\.9“If R succeeds”613437“If U succeeds”0000Table 11:Composite framing scorecard across all four models\. Every metric shows the same direction\. The contaminated model \(3\.1\*\) amplifies framing despite knowing outcomes\.Every dimension – agency, verb semantics, success framing, conditional reasoning, epistemic credibility, syntactic structure – points in the same direction across all four models\. The contaminated model, which*knows*most territorial outcomes resolve against offense, produces the most extreme framing on several dimensions\. This decoupling of framing from knowledge confirms that the offense\-dominant pattern is structural – embedded in how English\-trained LLMs construct conflict narratives – rather than a reflection of model beliefs about outcomes\.
## Appendix MPrediction Error by Time to Resolution
Figure[8](https://arxiv.org/html/2607.20441#A13.F8)shows prediction error stratified by time remaining until market resolution\. Context damage \(D exceeding no\-change\) is concentrated in the 1\-week\-to\-1\-month window, where markets are most active and English news coverage is densest\. At longer horizons \(6\+ months\), all conditions converge as markets are less liquid and predictions are dominated by the prior\.
Figure 8:MAE by time remaining to market resolution\. Context damage is strongest in the 1wk–1mo window where news flow is densest\. Territorial markets, 7\-day horizon, clean model average\.
## Appendix NCase Study: The Zelenskyy Suit
Consider the Polymarket question “Will Zelenskyy wear a suit before June?” All three clean models predicted YES with high confidence \(0\.91–0\.95\), reasoning that a papal funeral demands formal attire – a logically sound inference from generic diplomatic norms\. Any Ukrainian would have predicted differently\. Zelenskyy has not worn a suit since February 24, 2022; the wartime military clothing is a deliberate political statement, not a wardrobe constraint\. Returning to a suit would signal a fundamental shift in how Ukraine frames its wartime posture\. The contaminated model, which knows the outcome, predicted 0\.33\. The gap between 0\.93 and 0\.33 is not a reasoning failure – the logic is valid\. It is an information ecosystem failure: the English\-language corpus encodes “heads of state wear suits to funerals” but not “this particular head of state has made not wearing a suit a defining act of wartime leadership\.” The models reason fluently from the wrong world model\.Similar Articles
What LLM Forecasters Know but Don't Say: Probing Internal Representations for Calibration and Faithfulness
This paper probes internal representations of LLM forecasters to improve calibration and assess faithfulness of chain-of-thought reasoning, finding that probes achieve better calibration and act as lie detectors.
LLMs know when they are wrong. I made a fix relating to Anthropic's new "global workspace" paper [R]
The author presents a method to make LLMs verbalize calibrated confidence by using a linear probe on mid-layer states and a small trained bridge to confidence logits, requiring only 200 labeled examples and no weight modification. This is linked to Anthropic's global workspace paper explaining the know-say gap.
When LLMs Learn to Be Consistently Wrong: A Multi-Model Study of Linear Representations of Synthetic Deception
This paper studies synthetic dishonesty in LLMs by fine-tuning honest and deceptive variants of five transformer models and finding that robust, domain-invariant dishonesty representations can be rapidly entrenched via modest supervised fine-tuning, with implications for activation-based monitoring.
Nous: An Attempt to Extract and Inject the Cognition Behind Prediction-Market Behavior
This paper investigates whether human cognitive diversity in prediction markets can be extracted as behavioral profiles and injected into LLM agents. Extraction partially works with stable profiles, but prompt-level injection fails to meaningfully transfer diversity, suggesting the need for deeper model interventions.
Consistent but Miscalibrated: Evaluating LLM Limitations for Risk Communication in Natural Language
This paper evaluates nine LLMs on their ability to accurately communicate probabilistic predictions in natural language, finding that models are consistent but miscalibrated, particularly for uncertainty tasks.