Are AGI timelines extrapolating the wrong axis?

Reddit r/singularity News

Summary

The article argues that AGI timelines based on scaling current architectures may be misguided, as true general intelligence requires rationality—dealing with open-ended real-world contexts—which current systems lack due to the frame problem and a low correlation between intelligence and rationality.

Most AGI timelines extrapolate capability curves, which is reasonable if you believe the current architecture can in principle reach general intelligence by scaling. There is a different reading in which the architecture is good at one thing and bad at another, and what AGI actually requires lives on the bad side. The good side is computation inside a delineated frame. The bad side is moving across frames, recognizing when the world has shifted, and reorienting. Calling both intelligence runs them together. Separating them changes the timeline question entirely, including which kind of evidence should update the forecast. I recently gave a talk at the 6th International Conference on Philosophy of Mind in Porto arguing that AGI requires rationality on top of intelligence. You can watch it [here](https://youtu.be/D6hjtY0cm3s?si=5oI1HHg2iB7CKner). Three pieces carry the load. First, Savage's distinction between small worlds (delineated problem spaces) and large worlds (reality itself, with endless context, unknowable even in principle). Current AI systems are extraordinary inside small worlds and structurally limited in large worlds. Second, the frame problem from Dennett, which scaled models have not addressed: any system trying to reason in the world has to filter infinite irrelevant features, and pure algorithmic relevance-classification just inherits the same problem one level up. Living agents cut this with what Vervaeke calls relevance realization, a self-organizing process tied to having stakes in a world. Third, the empirical separation: Stanovich and colleagues show intelligence and rationality share only around thirty percent variance, with attention control shrinking the overlap further. If AGI requires the rationality side, scaling LLMs is climbing the wrong axis. If the axis claim is right, the singularity question shifts from when to whether and how. Artificial autopoiesis, embodied robotic agents with vital stakes, hybrid systems with grounded sensorimotor loops are the most-named alternatives, though none of them are close to current capability. Which of those bets do you think has the best decade-scale chance, and what observable result would change your view that the axis matters more than the scale?
Original Article

Similar Articles

Why scaling alone will not give us rational AI

Reddit r/ArtificialInteligence

This article argues that fundamental architectural limitations, not scaling deficits, prevent current LLMs from achieving true rationality—the ability to recognize and switch frames—citing empirical failures like the reversal curse and frame-transfer issues, and suggests that scaling alone may not bridge this gap.

Position: Agentic AI System Is a Foreseeable Pathway to AGI

arXiv cs.AI

This paper argues that monolithic scaling of a single model is insufficient for achieving AGI and proposes Agentic AI with multi-agent collaboration as a necessary paradigm, demonstrating theoretically that agentic systems achieve exponentially superior generalization and sample efficiency.

Planning for AGI and beyond

OpenAI Blog

OpenAI outlines its strategy for preparing for AGI, emphasizing gradual deployment with real-world feedback loops, increasing caution as systems approach AGI capabilities, and development of better alignment techniques to ensure AI systems remain steerable and safe.

I think most companies are building AI backwards

Reddit r/artificial

The article argues that companies are overinvested in AI intelligence (model capability) while neglecting crucial runtime layers for authority, accountability, and reality representation, leading to potential failures when AI acts within institutions.