Tag
This paper studies catastrophic forgetting in the scientific foundation model Walrus-1.3B during two-stage sim-to-real adaptation, finding that finetuning on simulated flow data can increase one-step errors up to 35x, and shows that replaying just 1% of simulated data recovers most lost performance while retaining adaptation to experimental dynamics.