@snowboat84: To add a supplementary note, regarding the phenomena emerging from AI—scaling laws, emergence, double descent, representation geometry—the papers discussing them are already numerous. But there is a big problem: they are all thinking in the way of computer scientists, not physicists. What is a computer sci…

X AI KOLs Timeline News

Summary

The author comments that current AI research overuses the thinking style of computer science and lacks a physics-based approach, proposing the need to establish an ideal system like 'Cyber Space' to lay a theoretical foundation.

To add a supplementary note, regarding the phenomena emerging from AI—scaling laws, emergence, double descent, representation geometry—the papers discussing them are already numerous. But there is a big problem: they are all thinking in the way of computer scientists, not physicists. What is the thinking style of computer scientists? Seeing a phenomenon, picking a set of mathematical tools, doing a small experiment, and trying to piece together an explanation—maybe grasping a bit, maybe not. Then switching tools, switching data, and trying again. If you ask them what constitutes a necessary and sufficient condition, they don't care. This is not science; it's modeling. The physics method is completely different. From a jumble of chaotic phenomena, extract what you consider the most fundamental set, idealize it, and establish an isolated, almost non-existent but conceptually clear 'ideal system.' Then thoroughly understand the laws within this ideal system, and only then expand step by step to the real world. Newton's first law was established this way: 'An object not subject to any net force will maintain a constant velocity.' But this law does not hold just anywhere. It doesn't hold on Earth because Earth rotates; it doesn't hold in the solar system because the solar system orbits the center of the Milky Way. Running, spinning on a stool, or in an accelerating car are not good reference frames because they are accelerating. Newton's approach was: only relative to the infinitely distant fixed stars does there exist an 'absolute reference frame,' where the law strictly holds. This is a suspended ideal state, unattainable in reality, but conceptually necessary. All real mechanical problems are 'deviations from this ideal state': gravity, centrifugal force, Coriolis force, friction—all arise because our reference frame is not inertial. Without this suspended ideal state, the entire classical mechanics cannot be established. This is why I need to introduce the concept of Cyber Space. By placing AI phenomena within the independent world of Cyber Space, we can ask questions in the physicist's way: What is the 'inertial reference frame' of Cyber Space? What is its 'ideal gas'? What is its ideal state, the starting point that almost doesn't exist in that Space but must be conceptually established first? No one is seriously asking this question right now. But only by asking this question can new mathematics and new theory have a starting point. Otherwise, we can only continue to watch AI papers pile up like a mountain, each 'explaining a bit,' but never building a new foundational theory.
Original Article
View Cached Full Text

Cached at: 05/24/26, 08:37 PM

To add a further explanation: the phenomena that have emerged in AI—scaling laws, emergence, double descent, representational geometry—have already generated a mountain of papers. But there is a big problem: they are all thinking in the way of computer scientists, not in the way of physicists.

What is the computer scientist’s way of thinking? See a phenomenon, pick a set of mathematical tools, run a small experiment, try to piece together an explanation—maybe you catch something, maybe you don’t. Then switch tools, switch data, and try again. Ask them what a necessary and sufficient condition is, and they don’t care. This is not science; this is modeling.

The physicist’s approach is completely different. From a mess of phenomena, you distill what you believe to be the most fundamental set, idealize it, and construct an isolated, almost nonexistent but conceptually clear “ideal system.” Then you thoroughly understand the laws within this ideal system, and only step by step do you expand to the real world.

Newton’s first law was built this way: “An object not subject to any external force remains in uniform rectilinear motion.” But this law does not hold just anywhere. It does not hold on Earth because Earth rotates; it does not hold in the solar system because the entire solar system orbits the center of the Milky Way; if you are running, sitting on a swivel chair, or riding in an accelerating car, none of those are good reference frames because they are all accelerating. Newton’s approach was: only relative to the infinite distant stars does an “absolute reference frame” exist, and the law holds strictly there. This is an ideal state suspended in midair—unattainable in reality, but conceptually necessary. All real mechanical problems are “deviations from this ideal state.” Gravity, centrifugal force, Coriolis force, friction—all arise because the reference frame we are in is not an inertial frame.

Without this ideal state suspended in midair, classical mechanics could never be built.

That is why I introduced the concept of Cyber Space. Only by placing AI phenomena in the independent world of Cyber Space can we ask questions in the physicist’s way: What is the “inertial reference frame” of Cyber Space? What is its “ideal gas”? What is its ideal state—the starting point that almost does not exist in that Space, but must first be established conceptually?

No one is seriously asking this question right now. But only by asking it can new mathematics and new theories find a point of departure. Otherwise, we will just keep watching AI papers pile up like a mountain, each one “kind of explains something,” yet we can never build a new foundational theory.

Exactly right.

Haha, a bit dry, isn’t it?

Thank you for your summary.

Similar Articles

@snowboat84: https://x.com/snowboat84/status/2062686432335184321

X AI KOLs Timeline

This article explores the deep connections between physics and deep learning, analyzes the isomorphism of phenomena such as Scaling Law and emergence with concepts like critical scaling laws and phase transitions in physics, and reviews the current status and prospects of applying physical methodologies in AI.

@snowboat84: Today, let's discuss something hardcore. One question: what level of mathematics does AI use? From the perspective of tools and models themselves, the mathematics used by AI has an average age of 150 years, with most being from before the mid-19th century: matrix multiplication, gradient descent, chain rule, Fourier transform, inner product, probability — mostly content from the first two years of undergraduate studies. But some phenomena emerging from AI...

X AI KOLs Timeline

Discusses that the mathematics used by AI is mainly linear algebra, calculus, etc., from before the 19th century, but emerging phenomena such as Scaling Law, emergent abilities, double descent, in-context learning, and representation geometry lack mathematical explanation. Analogizes to the clouds in physics in 1900, suggesting it may drive the development of 21st-century mathematics.

@snowboat84: This is the second part of the "When Physics Meets AI" series. The role of physics in AI can be divided into four layers: (1) The first layer is the bottommost, providing the computational skeleton—energy, entropy, and free energy are embedded into AI's training objectives. (2) The second layer is the middle layer, where physics shapes the network architecture—Hopfield's Ising energy function, CNN's translational symmetry, and renormalization group correspond to the hierarchical structure of deep networks.

X AI KOLs Timeline

This article explores the four layers of physics' role in AI, from the bottom computational skeleton to the methodological layer, arguing that physics' methodology is migrating from the natural world to the AI domain.

@paperpaper886: Last week, I discussed the current state and future of AI4Math with a friend from the math department. He said that current AI is already powerful enough as an auxiliary tool, but there is still a long way to go for AI to achieve independent discovery.

X AI KOLs Timeline

Discussed the current state and future of AI in mathematics. Citing an example, ChatGPT 5.5 Pro autonomously solved the farthest pair problem in high-dimensional computational geometry, which had been stuck for years, demonstrating AI's potential in mathematical discovery.

@Xudong07452910: After AI starts doing math, a more dangerous thought may emerge: if machines can prove theorems, are human mathematicians less important? This essay "Automation Without Understanding" discusses this issue. The author's core point is straightforward: Mathematics...

X AI KOLs Timeline

AI systems have made breakthroughs in mathematics, helping to overturn Erdős's long-standing conjecture about unit distances in the plane. But an essay warns: the stronger the automation, the more important human ability to understand and audit machine reasoning becomes, while the U.S. mathematics talent pipeline is degrading due to budget cuts.