Tag
A debate on whether AGI is inevitable or facing a wall, weighing AI self-improvement and reasoning against issues like lack of understanding, power constraints, and shifting goalposts.
This paper shows that layer-local training methods like Forward-Forward (FF) do not scale to realistic image sizes and datasets, and that synthetic benchmarks overstate their performance. The authors introduce a strong FF variant (DTG-FF) and demonstrate that on real data (e.g., ImageNet-100 at 224x224) FF achieves only 49.4% versus typical BP above 75%, while on synthetic tasks the gap narrows or reverses.
A deep-dive analysis exploring why AI companies continue to scale systems despite prominent researchers declaring the end of the scaling era and widespread acknowledgment of diminishing returns, examining the structural and financial incentives driving the industry.
AI models are deteriorating due to training on recursively generated synthetic data, leading to model collapse; multiple studies highlight the risks of scaling with synthetic data.