Tag
The paper introduces Bayesian κ-Explorer, which places Dirichlet priors on MDP transition distributions to simplify minimax transition estimation by replacing confidence-set optimization with a closed-form posterior variance exploration signal, while retaining the Õ(T^-1/3) convergence rate of the frequentist κ-Explorer and showing lower worst-case estimation errors on Pendulum, Mountain Car, and Taxi.
This paper identifies the geometric mechanism behind boundary-induced acquisition bias in Gaussian processes on bounded domains, showing how kernel truncation inflates posterior variance and distorts acquisition functions independently of the objective function. The authors introduce a function-free diagnostic to quantify this bias across different acquisition classes.