gradient-boosting

A blog post from Flyback demonstrates how a LightGBM feature that ranked #1 in importance actually worsened predictions due to target encoding leakage, highlighting the danger of relying solely on feature importance metrics.

This paper introduces PathBoost, a gradient tree boosting method for graph-level prediction that uses path-based features to compete with graph neural networks while offering better interpretability.