Where are the recent improvements in AI coming from mostly?

Reddit r/ArtificialInteligence 07/02/26, 07:15 AM News

Summary

A discussion on the sources of recent AI advancements, noting that post-training, fine-tuning, and reinforcement learning have become key, and asking about future directions beyond scaling.

I understand that on the onset of 2023 it was scaling up mostly. Based on training data, parameters and compute. Then MOE. Recent updates are because of post training and fine tuning as well as reward model policy and reinforcement learning for frontier AI systems. But even they would hit a limit after some time and that would be that. Are there any future directions where AI can keep improving and how to know of the recent research in frontier systems and methods used. Especially for closed AI systems.

Original Article

Similar Articles

AI seems to improve weekly now, what's actually changed in the last month that's worth knowing about?

Reddit r/singularity

A user asks what significant AI changes have occurred in the last month that are worth knowing, seeking insights beyond hype.

@bayeslord: https://x.com/bayeslord/status/2072056960430789032

X AI KOLs Following

A detailed speculative thread on the near future of AI, arguing that algorithmic progress will surprise many, with 4-10 orders of magnitude improvement in intelligence possible, and that we are in an early takeoff where AI accelerating AI research will lead to rapid advances.

@dwarkesh_sp: What does the next training paradigm look like? 0:00:00 – The big research bet the labs are making 0:02:12 – Grindabili…

X AI KOLs Following

A discussion on the next training paradigm for AI, covering research bets, grindability, RLVR, and a vision for 2027.

AI research is splitting into groups that can train and groups that can only fine tune

Reddit r/artificial

Discussion on how compute access is becoming the primary driver of AI progress, creating a divide between organizations that can train large models and those limited to fine-tuning existing foundation models.

@qinzytech: https://x.com/qinzytech/status/2066585405479371092

X AI KOLs Timeline

A technical analysis of two approaches to building self-evolving AI agents: model-based (via architecture like SSMs or transformer with fast-weight updates, and training methods) and harness-based (via memory or meta harness that can rewrite itself). The author provides practical recommendations for different audiences.