noisy-expert

This paper proposes a noisy expert model to explain the gap between offline and online imitation learning, showing that offline learning from noisy trajectories requires exponential sample complexity while online on-policy distillation achieves polynomial dependence. The analysis leads to an alternative loss function and experiments confirm the theoretical findings.