bf16-precision

Tag

Cards List
#bf16-precision

bf16 Rounding Silently Discards Most RL Policy Updates: A Hidden Training-Inference Mismatch and an Unbiased One-Line Fix

arXiv cs.LG ↗ · 2026-11-02 Cached

该论文发现RL后训练中fp32主权重经bf16四舍五入导出时,大多数小于半个bf16间隔的策略更新被静默丢弃,使采样器落后优化器50-150步;作者提出仅需一行代码的Fair Cast(随机舍入/误差反馈),在Qwen3-0.6B到4B的25组配对实验中平均提升6.1分。

0 favorites 0 likes
← Back to home

Submit Feedback