Tag
This study systematically evaluates physics-informed neural network techniques for fluid dynamics, showing that combining periodic activations with causal weighting improves performance on the Navier-Stokes vortex shedding benchmark, while further additions cause degradation due to nonlinear interactions.
Explores whether very small language models can handle casual conversations adequately, and what training factors differentiate the better ones.
OpenAI presents improved techniques for training consistency models that enable high-quality single-step image generation without distillation, achieving significant FID improvements on CIFAR-10 and ImageNet 64×64 through novel loss functions and training strategies.
OpenAI presents comprehensive techniques for training large neural networks across distributed GPU clusters, covering data parallelism, pipeline parallelism, tensor parallelism, and mixture-of-experts approaches to overcome engineering and scalability challenges.