Tag
A person who participated in building ChatGPT from zero to one shares his decade-long journey in AI, including being expelled from high school, dropping out multiple times, working over 30 jobs, and witnessing the explosive growth of ChatGPT users. Now he's considering his direction for the next decade.
This article recounts in detail the story of Jia Yangqing developing the deep learning framework Caffe (originally named Decaf) from scratch during his time at Berkeley and choosing to open-source it, as well as his personal growth from a student to a technical leader.
David Ha and Jürgen Schmidhuber recount how foundational deep learning techniques like transformers, unsupervised pretraining, knowledge distillation, and residual networks were pioneered in Munich in 1991, laying the groundwork for the current AI boom.
A deep retrospective on the four-year evolution of reasoning models from CoT in 2022 to o1/R1 in 2024, pointing out that the true watershed is not the emergence of reasoning ability, but the conversion of reasoning into a billable, schedulable resource.
This article delves into the concept of embodied intelligence, its intellectual origins (philosophy, cognitive science, AI robotics), and historical development (the failure of symbolism and Brooks' subsumption architecture). It analyzes its differences from pure software AI and the challenges it faces.
This article systematically reviews the evolution of the world model concept from Craik's psychological metaphor in 1943 to the industry explosion in 2024-2026. It details the core ideas and representative works of symbolic AI and deep learning schools (Schmidhuber-Ha, Dreamer series, JEPA, video generation direction), and points out the current state of definition confusion and competition among various schools.
This article recounts how Geoffrey Hinton persisted in his research for three decades during the AI winter, when neural networks were abandoned by academia. He eventually gained fame with AlexNet in the 2012 ImageNet competition and won the Nobel Prize in Physics in 2024.
In an interview, Sam Altman recalls his time at Stanford, his startup Loopt, how Y Combinator transformed the startup landscape, and how OpenAI evolved from an unpopular idea into an AGI lab.
A profile of Ilya Sutskever, the Russian-born AI researcher who co-founded OpenAI and played a key role in developing ChatGPT.
Sabrina Halper recommends Dwarkesh Patel's podcast with Eric Jang, who discusses how deep learning progress has been driven more by compute than by biological inspiration.
Yann LeCun disputes claims about Silicon Valley's dominance in AI innovation by listing key breakthroughs like Attention, PyTorch, and AlphaFold that originated in other locations such as Montreal, London, and Paris.
DeepMind reflects on the 10th anniversary of AlphaGo, highlighting its role in kickstarting the modern AI era and its subsequent impact on scientific research and the pursuit of AGI.
OpenAI reflects on its ten-year journey from a small group of researchers to a leading AI company, highlighting key milestones including Dota 1v1, sentiment neurons, RLHF work, ChatGPT, and GPT-4, while emphasizing the importance of their iterative deployment strategy in advancing AI responsibly.
This article discusses Google DeepMind's MuZero algorithm as an example of 'Software 2.0,' arguing that while deep learning surpasses traditional software, it still relies on classical computational techniques like game tree search.