Tag
This paper demonstrates that the regret of Bayesian and multiplicative-weights updates satisfies an exact information-accounting identity, decomposing the learner's excess loss into an uncertainty payment and a reduction in information distance to any comparator. The cumulative payment defines intrinsic time, leading to exact adaptive regret decompositions that unify Hedge, Bayesian model averaging, online convex optimization, and other algorithms.