Real-time neural weather restyling for Minecraft on a GTX 1650 (1.4M-param U-Net, distilled from FLUX.2 klein, 30-40 FPS realtime on budget GPU) [P]

Reddit r/MachineLearning Papers

Summary

A 1.4M-parameter U-Net student model, distilled from FLUX.2 klein, achieves real-time 30-40 FPS neural weather restyling (snow, wet, night) inside a Minecraft Fabric mod on a budget GTX 1650, using a PatchGAN fine-tune to fix washed-out outputs from pure pixel losses.

Teacher: FLUX.2 klein 4B paints ~3k frames (snow / wet / night at 3 strengths). Student: 1.4M-param U-Net with FiLM sliders, 512×288, ~26 ms/frame via ONNX Runtime inside a Fabric mod; the HUD stays untouched. Pixel loss (L1+MSE) gave a washed-out “average” because the teacher places snow/puddles differently per frame. A PatchGAN fine-tune on the same pairs fixed it: fat snow, real-looking reflections. Failure cases: night (teacher painted sunsets), already-snowy biomes (never in the training data). Happy to share details.
Original Article

Similar Articles