convex-optimization

This paper extends CONES to time-varying loss functions, showing bounds for regret and movement cost using projected proximal algorithms in convex optimization.

This paper proves that Thompson sampling achieves polynomial regret for non-monotone convex ridge bandits, showing that monotonicity is not necessary, with a new regret bound of Õ(d^{9/2} √n).

This paper revisits median-of-means estimation from a deterministic optimization perspective and develops a family of block-Lp estimators for robust learning under heavy-tailed and adversarial corruption, showing that nonconvex methods can approach the trimmed oracle performance while remaining computationally tractable.

This paper introduces a post-generation guardrail pipeline for LLMs in financial portfolio advice, using convex projection to enforce KYC constraints and reduce feasibility violations to 0% with minimal correction.

The article discusses the impact of Stephen Boyd's 2006 mathematics textbook on convex optimization, used by Google, Renaissance Technologies, and others, and promotes his free Stanford course EE364A available on YouTube.

This paper proposes a provable two-stage pipeline that distills nonlinear dynamical systems into compact linear state-space models using convex optimization, with theoretical guarantees and experiments on LDS benchmarks and MuJoCo.

This theoretical paper studies the non-asymptotic implicit bias of logistic regression under gradient descent, proving that the parameter vector weakly aligns with the max-margin direction quickly, within a doubly exponential number of iterations in the alignment error.

DecoupleMix introduces a systematic framework for optimizing pretraining data mixtures for Vision-Language Models by decoupling inter-class and intra-class ratio search, using convex optimization to improve scalability and performance over heuristic baselines.

This paper analyzes the scaling limits of constant-stepsize SGD near flat minima, showing that the invariant law concentrates at scale α^(1/m) for objectives with flatness exponent m ≥ 2, and converges to non-Gaussian stationary distributions for m > 2.

Following OpenAI's CDC proof announcement, GPT-5.6 reportedly solved a 30-year open problem in convex optimization using a similar prompt, with the solution verified in the Lean proof assistant.

GPT-5.6 significantly outperforms published state-of-the-art on a fundamental mathematical problem about gradient flow length, achieving exponential improvements. This marks a major advance in AI's ability to reason about complex mathematical questions.

A tweet highlights Stanford professor Stephen Boyd's free convex optimization course and textbook, noting that Citadel pays $400K for this skill. The course teaches optimal portfolio allocation, but emphasizes that the optimizer only works with a genuine edge in signals.

Introduces Simplex-Constrained Sparse Bagging (SCSB), a post-training framework that optimizes estimator weights over the probability simplex using out-of-bag samples, achieving up to 96% ensemble compression and improved calibration.

This paper reveals that Mirror Descent with non-quadratic regularizers can be exponentially more sensitive to initialization than Gradient Descent, even under well-conditioned settings, which has implications for reproducibility in RL and LLM post-training.

This paper introduces a curvature-adaptive Follow-the-Perturbed-Leader (FTPL) algorithm for online optimization that achieves optimal regret bounds for both non-convex Lipschitz losses and strongly convex losses, using a time-varying perturbation scale.

Introduces BoxLitE, a knowledge base embedding model for DL-LiteH that leverages convex optimization to achieve weakly faithful embeddings. The paper shows that for any satisfiable DL-LiteH KB, a BoxLitE embedding exists with desirable faithfulness properties.

This paper introduces CLD, a lightweight convex optimization-based language detection head for ASR that achieves 97-98% accuracy with under 100 training samples while reducing compute costs by 13x, addressing accent and dialect robustness across 5 languages and 24 sub-dialects.