bayesian-exploration

Tag

Cards List
#bayesian-exploration

Bayesian $\kappa$-Explorer for Minimax Model Estimation in MDPs

arXiv cs.LG ↗ · yesterday Cached

The paper introduces Bayesian κ-Explorer, which places Dirichlet priors on MDP transition distributions to simplify minimax transition estimation by replacing confidence-set optimization with a closed-form posterior variance exploration signal, while retaining the Õ(T^-1/3) convergence rate of the frequentist κ-Explorer and showing lower worst-case estimation errors on Pendulum, Mountain Car, and Taxi.

0 favorites 0 likes
← Back to home

Submit Feedback