Tag
This paper shows that Large Language Bayes (LLB), which averages posteriors from language-model-generated probabilistic programs using weights from an exponentiated evidence bound, is not reparameterisation-invariant. Equivalent program writings can receive substantially different weights (up to 31.9× discrepancy that can even reverse sign), inverting Bayes factors and inducing error in model posteriors controlled by the spread of bound shortfalls via a sharp Hilbert-distance bound.