machine-learning-theory

Tag

Cards List
#machine-learning-theory

Bernstein-Schur Kernels: Random Features by Sketched Modulation and Radial Randomization

arXiv cs.LG · 2026-06-11 Cached

This paper introduces Bernstein–Schur kernels, a class of nonstationary kernels between shift-invariant and dot-product templates, and provides a random feature construction by sketching the finite modulation and randomizing the completely monotone radial factor. The method yields unbiased estimators with operator-norm bounds controlled by intrinsic dimensions, and experiments validate the approach on a biased kernel example.

0 favorites 0 likes
#machine-learning-theory

Beyond Bounded Variance: Variance-Reduced Normalized Methods for Nonconvex Optimization under Blum-Gladyshev Noise

arXiv cs.LG · 2026-05-18 Cached

This paper studies nonconvex stochastic optimization under Blum-Gladyshev noise, where gradient variance grows with distance from initialization. It proves convergence guarantees for normalized SGD with momentum and a variance-reduced STORM method, achieving minimax optimal rates under certain conditions.

0 favorites 0 likes
#machine-learning-theory

When Can Human-AI Teams Outperform Individuals? Tight Bounds with Impossibility Guarantees

arXiv cs.AI · 2026-05-12 Cached

This paper derives tight theoretical bounds for human-AI teams, proving when confidence-based aggregation leads to complementarity and establishing impossibility results under specific error correlations.

0 favorites 0 likes
#machine-learning-theory

A Unified Measure-Theoretic View of Diffusion, Score-Based, and Flow Matching Generative Models

arXiv cs.LG · 2026-05-11 Cached

This arXiv preprint proposes a unified measure-theoretic framework for understanding diffusion, score-based, and flow matching generative models. It establishes connections between these methods via continuity/Fokker-Planck equations and analyzes their sampling schemes and theoretical guarantees.

0 favorites 0 likes
#machine-learning-theory

Energy Generative Modeling: A Lyapunov-based Energy Matching Perspective

arXiv cs.LG · 2026-05-08 Cached

This paper proposes a unified framework for energy-based generative models by casting density transport as a nonlinear control problem with KL divergence as a Lyapunov function. It derives finite-step stopping criteria and demonstrates how nonlinear control theory tools can be applied to static scalar energy models.

0 favorites 0 likes
#machine-learning-theory

How Maximum Entropy makes Reinforcement Learning Robust

ML at Berkeley · 2021-07-26 Cached

This article explains how incorporating Shannon entropy into reinforcement learning objectives creates more robust agents capable of handling unexpected or adversarial changes in rewards and dynamics.

0 favorites 0 likes
#machine-learning-theory

Computational limitations in robust classification and win-win results

OpenAI Blog · 2019-02-04 Cached

This paper extends the study of computational hardness in learning robust classifiers, showing that efficient robust classification can be impossible even when unbounded robust classifiers exist, and establishing a win-win result: either an efficient robust classifier can be learned, or new cryptographic primitives can be constructed.

0 favorites 0 likes
← Back to home

Submit Feedback