Attention is All You Need was published 9 years ago...

Reddit r/singularity News
transformer generative-ai navier-stokes ai-progress mathematics research anniversary

Summary

This article commemorates the 9th anniversary of the 'Attention is All You Need' paper and highlights how transformer-based generative AI systems have solved the Navier-Stokes existence and smoothness problem, demonstrating rapid progress in AI within a decade.

And, today, a transformer-based genAI system found a solution for the Navier-stokes existence and smoothness problem. In less than a decade, transformer-based systems have gone from producing barely sensible text to solving problems that have defied some of humanity's brightest minds. In less than a decade. Where will we be 9 years from now?
Original Article

Similar Articles

Attention Is All You Need

Reddit r/ArtificialInteligence

A reflection on the landmark 'Attention Is All You Need' paper, highlighting how removing recurrence and relying solely on attention mechanisms revolutionized AI and led to modern LLMs like GPT and Claude.

Is 'Attention' the Essence of Intelligence?

Hacker News Top

Quanta Magazine 探索「注意力」机制如何成为现代 AI 的核心：从 Dzmitry Bahdanau 2014 年的机器翻译研究，到 Google 2017 年的 Transformer 论文，再到 ChatGPT 等大语言模型的崛起。

After Math

Hacker News Top

OpenAI announced an AI-generated solution to the Navier-Stokes existence and smoothness problem, sparking debate on the role of AI in mathematics and whether mathematics is merely about problem-solving.