Where are the recent improvements in AI coming from mostly?

Reddit r/ArtificialInteligence News
ai-improvements scaling fine-tuning reinforcement-learning research-directions

Summary

A discussion on the sources of recent AI advancements, noting that post-training, fine-tuning, and reinforcement learning have become key, and asking about future directions beyond scaling.

I understand that on the onset of 2023 it was scaling up mostly. Based on training data, parameters and compute. Then MOE. Recent updates are because of post training and fine tuning as well as reward model policy and reinforcement learning for frontier AI systems. But even they would hit a limit after some time and that would be that. Are there any future directions where AI can keep improving and how to know of the recent research in frontier systems and methods used. Especially for closed AI systems.
Original Article

Similar Articles

What does the next generation of models need?

Reddit r/AI_Agents

A discussion about the next evolution of frontier AI usage, questioning whether cloud-based agent workflows and massive distributed compute will replace local setups, referencing Tibo's tweet and OpenAI's recent math results.