@simplifyinAI: BREAKING: NVIDIA proved back-propagation isn't the only way to build an AI. Billion-parameter models were trained witho…
Summary
NVIDIA and Oxford University introduced EGGROLL, a scalable evolution strategies algorithm that trains billion-parameter models without backpropagation, using only integers and parallel mutations.
Similar Articles
@HowToAI_: NVIDIA has done the impossible and nobody's talking about it. They trained a 12 BILLION parameter LLM in 4-bit precisio…
NVIDIA trained a 12-billion parameter LLM in 4-bit precision using the new NVFP4 format with micro-scaling, achieving near-zero intelligence loss while halving memory usage and tripling arithmetic speed, marking a major breakthrough in efficient AI training.
@alex_verem: a team of researchers just proved you don't need a bigger model, you need a smarter plan researchers from Tsinghua and …
Researchers from Tsinghua and South China University of Technology introduced Atomic Task Graph (ATG), a framework that enables 7B-8B open-source models to surpass GPT-4 on complex agent benchmarks without fine-tuning, by using directed graph-based planning and internal simulation to drastically reduce hallucination rates.
@heyrobinai: THE ENTIRE AI INDUSTRY JUST GOT HUMILIATED a tiny model trained in just a few hours on a single graphics card is planni…
Yann LeCun's team releases LeWorldModel, a tiny 15M-parameter physics model trained on a single GPU in hours that outperforms billion-dollar foundation models in planning speed and physical plausibility, challenging the dominant scaling paradigm.
Gradient-Free Training of Spiking Neural Networks via Low-Rank Evolution Strategies
Introduces Eggroll, a low-rank evolution strategy for gradient-free training of spiking neural networks, reducing memory and time overhead while achieving competitive accuracy on N-MNIST.
Evolution strategies as a scalable alternative to reinforcement learning
OpenAI presents evolution strategies (ES) as a scalable black-box optimization alternative to reinforcement learning for training neural network policies. ES simplifies the optimization problem by treating policy training as a stochastic parameter search that repeatedly samples and selects better parameter configurations based on reward feedback.