xlnet

#xlnet

@TimDaugs: kimi's ceo has a standing rule against clever architectures. yang zhilin has said the actual move is almost never a new…

X AI KOLs Timeline ↗ · 2026-07-25 Cached

Kimi's CEO Yang Zhilin advocates avoiding clever architectures and prioritizing scaling, exemplified by Moonshot's MuonClip fix that enabled stable training on 15.5 trillion tokens.

0 favorites 0 likes

#xlnet

@FinanceYF5: One of the key technologies for Kimi to beat US models may trace back to founder Yang Zhilin’s doctoral thesis written ten years ago. He is 34, with a bachelor's from Tsinghua and a PhD from CMU, and during his PhD, he worked at Meta AI and Google Brain. That XLNet paper, cited over 10,000 times, later evolved into Kimi K2's trillion-parameter Mo…

X AI KOLs Following ↗ · 2026-07-21 Cached

The article points out that one key technology for Kimi defeating US models may originate from founder Yang Zhilin’s doctoral thesis ten years ago, mentioning the connection between XLNet and Kimi K2's trillion-parameter MoE architecture.

0 favorites 0 likes

xlnet

@TimDaugs: kimi's ceo has a standing rule against clever architectures. yang zhilin has said the actual move is almost never a new…

Submit Feedback