numerical-stability

Tag

Cards List
#numerical-stability

GradRepair-ODE: Certified Gradient Repair for Neural ODE Training

arXiv cs.LG ↗ · 2026-09-15 Cached

GradRepair-ODE introduces a reliability framework for certifying and repairing gradients in Neural ODE training to address numerical stability issues in scientific machine learning and generative models.

0 favorites 0 likes
#numerical-stability

When Shared Rollouts Fail in Defensive Driving Evaluation: A NAVSIM Score Basis Audit

arXiv cs.AI ↗ · 2026-08-06 Cached

This paper audits NAVSIM v2.2's defensive driving scoring, showing that a shared reference-conditioned forgiveness rule combined with numerical instability can cause actor-blind probes to outrank human replay, undermining the benchmark's validity.

0 favorites 0 likes
#numerical-stability

Bias Compounds, Variance Washes Out

Hacker News Top ↗ · 2026-05-29 Cached

This article demonstrates that using stochastic rounding for BF16 optimizer state can match FP32 performance because unbiased errors cancel over time, whereas round-to-nearest stalls due to compounding bias. An experiment with an MLP shows BF16+SR achieves similar loss to FP32 while using less memory.

0 favorites 0 likes
← Back to home

Submit Feedback