@Raytar: he tested 5760 architectures at Google for a full year. the winner was the original Transformer from 2017. Hyung Won Ch…

X AI KOLs Timeline News

Summary

Hyung Won Chung shares at MIT that after testing 5760 architectures at Google, the original 2017 Transformer was the best, then he moved to OpenAI to train o1. He claims 99% of AI research is theater.

he tested 5760 architectures at Google for a full year. the winner was the original Transformer from 2017. Hyung Won Chung told that story at MIT with a small smile. then went to OpenAI and trained o1. 1 hour. free. by one of the few people on earth who actually moves the frontier. meanwhile your feed is full of guys writing architecture threads who have never trained a model anyone uses. he just told MIT that 99% of AI research is theater. your AI worldview was built by men who read his papers. badly. now you can read him directly. you will rewatch this. save it now.
Original Article
View Cached Full Text

Cached at: 05/25/26, 02:57 PM

he tested 5760 architectures at Google for a full year. the winner was the original Transformer from 2017.

Hyung Won Chung told that story at MIT with a small smile. then went to OpenAI and trained o1.

1 hour. free. by one of the few people on earth who actually moves the frontier.

meanwhile your feed is full of guys writing architecture threads who have never trained a model anyone uses. he just told MIT that 99% of AI research is theater.

your AI worldview was built by men who read his papers. badly. now you can read him directly.

you will rewatch this. save it now.

Raytar (@Raytar): “I was definitely the first prompt engineer at Anthropic. Might have been the first in the world.”

Alex Albert just spent 35 minutes explaining how they train Claude’s personality from the inside.

35 minutes. free. by the person who invented the role.

most people think

Similar Articles

@_avichawla: The No. 1 deep researcher beats Claude and ChatGPT with a trick neither uses. I studied the open-source architecture be…

X AI KOLs Timeline

The Onyx open-source deep research system achieves top ranking by stripping search access from its orchestrator agent, forcing it to decompose queries into focused research threads. Its three-phase pipeline and two-level architecture prevent information distortion and premature answering, outperforming proprietary solutions from OpenAI, Anthropic, and Google.

Three frontier LLMs asked to design a neural net from scratch all rejected the transformer - and converged on sparse lookup tables 1,800x smaller

Reddit r/artificial

POSTECH researchers had Claude Opus 5.5, GPT-6.1 Sol, and GPT-6 Astra freely design neural architectures for labeled questions, and all three independently rejected transformers in favor of sparse lookup tables that reach 54.4% on ARC with 3.35M parameters — 1,800x smaller and 17x faster than comparable transformer designs, though still far below pretrained baselines.

@NFTCPS: You keep talking about AI, but can't even explain what a Transformer is? There's a repo that goes all out — builds a GPT from scratch without using any high-level libraries. It lays out exactly how Attention, Multi-Head, Feed-Forward, Embedding, Residual connections, and Layer Norm are pieced together. And it's not just the model; the entire pipeline is covered…

X AI KOLs Timeline

A GitHub open-source project that implements the complete GPT training pipeline from scratch, including data preprocessing, pretraining, SFT, and RLHF post-training, all based on native PyTorch. Ideal for developers who want to deeply understand the Transformer architecture.

@berryxia: Moonshot AI founder Yang Zhilin recently released a 40-minute video. Born in 1992, valedictorian of Tsinghua CS undergrad, PhD from CMU, co-author of Transformer-XL and XLNet, former researcher at Google Brain and Meta, he calmly deconstructs Kimi K2 in front of the camera...

X AI KOLs Timeline

Moonshot AI founder Yang Zhilin released a 40-minute video detailing the training process of the Kimi K2 model, which cost only $4.6 million. In an 8-model real-time programming competition, Kimi K2 took first place, defeating GPT-5.5 and others, demonstrating how a small team can overturn the traditional compute-stacking paradigm through architecture optimization.