Attention is All You Need was published 9 years ago...

Reddit r/singularity 09/08/26, 11:09 PM News

transformer generative-ai navier-stokes ai-progress mathematics research anniversary

Summary

This article commemorates the 9th anniversary of the 'Attention is All You Need' paper and highlights how transformer-based generative AI systems have solved the Navier-Stokes existence and smoothness problem, demonstrating rapid progress in AI within a decade.

And, today, a transformer-based genAI system found a solution for the Navier-stokes existence and smoothness problem. In less than a decade, transformer-based systems have gone from producing barely sensible text to solving problems that have defied some of humanity's brightest minds. In less than a decade. Where will we be 9 years from now?

Original Article

Similar Articles

Attention Is All You Need

Reddit r/ArtificialInteligence

A reflection on the landmark 'Attention Is All You Need' paper, highlighting how removing recurrence and relying solely on attention mechanisms revolutionized AI and led to modern LLMs like GPT and Claude.

@reach_vb: Attention truly is all you need

X AI KOLs Following

A playful tweet referencing the famous "Attention Is All You Need" transformer paper.

After Math

Hacker News Top

OpenAI announced an AI-generated solution to the Navier-Stokes existence and smoothness problem, sparking debate on the role of AI in mathematics and whether mathematics is merely about problem-solving.

@antoniolupetti: "Understanding Transformers and Attention Mechanisms" is a very interesting paper that presents the Transformer archite…

X AI KOLs Timeline

A tweet highlights an arxiv paper by Michel Fabrice Serret that introduces Transformers and attention mechanisms from an applied mathematics perspective, covering vectorization, multi-head attention, and methods to reduce attention costs like KV caching and latent attention.

Certainty Is All You Need

Reddit r/artificial

This paper introduces a new approach leveraging certainty in transformer models, building on the 'Attention Is All You Need' paradigm.