Tag
David Ha and Jürgen Schmidhuber recount how foundational deep learning techniques like transformers, unsupervised pretraining, knowledge distillation, and residual networks were pioneered in Munich in 1991, laying the groundwork for the current AI boom.