Maybe Transformer is the singularity?

The Transformer is starting to feel less like an another AI architecture and more like some fundamental object/entity we accidentally discovered. Almost anything we throw at it seems to get absorbed into the same structure: language, vision, audio, video, code, mathematics, reasoning, tools, agents, entire environments. And there doesn't seem to be an obvious conceptual ceiling yet. We just keep finding new ways to make the same underlying object represent more knowledge and perform more kinds of computation. It almost feels like an information black hole, except instead of destroying information, it absorbs it and turns it into intelligence. Maybe the Transformer isn't just one step on the road to AGI, maybe it's the substrate the whole thing happens inside. Maybe we passed the event horizon in 2017 when we created the first one.