Tag
The paper introduces Bayesian κ-Explorer, which places Dirichlet priors on MDP transition distributions to simplify minimax transition estimation by replacing confidence-set optimization with a closed-form posterior variance exploration signal, while retaining the Õ(T^-1/3) convergence rate of the frequentist κ-Explorer and showing lower worst-case estimation errors on Pendulum, Mountain Car, and Taxi.