learning-rate-optimization

Tag

Cards List
#learning-rate-optimization

Hybrid Quantum Selection of Learning Rates in Language-Model Training: Termination Criteria and an Interaction-Guided Schedule Oracle

arXiv cs.LG ↗ · 3d ago Cached

This paper proposes using quantum minimum finding (Dürr–Høyer with BBHT search) combined with an Interaction-Guided Schedule Oracle to jointly select layer-group learning-rate schedules for language-model fine-tuning, demonstrating closed-loop training of a 1.5B-parameter model whose benchmark results match uniform-rate baselines.

0 favorites 0 likes
← Back to home

Submit Feedback