parameterisation-invariance

Tag

Cards List
#parameterisation-invariance

Large Language Bayes Is Not Reparameterisation-Invariant

arXiv cs.LG ↗ · 2026-10-03 Cached

This paper shows that Large Language Bayes (LLB), which averages posteriors from language-model-generated probabilistic programs using weights from an exponentiated evidence bound, is not reparameterisation-invariant. Equivalent program writings can receive substantially different weights (up to 31.9× discrepancy that can even reverse sign), inverting Bayes factors and inducing error in model posteriors controlled by the spread of bound shortfalls via a sharp Hilbert-distance bound.

0 favorites 0 likes
← Back to home

Submit Feedback