post-transformer

Tag

Cards List
#post-transformer

Mapping the Post-Transformer Architecture Landscape in 2026 [D]

Reddit r/MachineLearning ↗ · 2026-10-14

A detailed landscape mapping of Post-Transformer architectures for 2026 — including Mamba-2/3, RWKV-7, BDH (Dragon Hatchling), xLSTM, Titans, and various hybrid models — comparing core mechanisms, attention variants, and test-time memory under practical compute and energy budgets.

0 favorites 0 likes
#post-transformer

Transformer co-author validates post-transformer cost efficiency breakthrough

Reddit r/artificial ↗ · 2026-08-14

A 150M-parameter non-transformer architecture achieves state-of-the-art cost-efficiency on ARC-AGI-1, validated by Transformer co-author Łukasz Kaiser, suggesting that recurrent latent reasoning can replace brute-force scaling.

0 favorites 0 likes
#post-transformer

Did Pathway just reveal the architecture breakthrough Andrew Curran predicted? Its 150M model sets a new ARC-AGI-1 cost-efficiency frontier

Reddit r/singularity ↗ · 2026-08-11

Pathway's 150M-parameter BDH-CQ model achieves 29.5% on ARC-AGI-1 at a record-low cost of $0.0007 per task, using recurrent memory and latent reasoning instead of long token chains. The architecture may be the breakthrough Andrew Curran teased, with OpenAI researcher Lukasz Kaiser as an investor and adviser.

0 favorites 0 likes
#post-transformer

Pathway's BDH(post-transformer arch) matches GPT2 scaling from 10M to 1B params trained from scratch. runs on Normal GPUs

Reddit r/LocalLLaMA ↗ · 2026-08-09

Pathway's BDH, a post-transformer architecture, reportedly matches GPT-2 scaling from 10M to 1B parameters while training from scratch on standard GPUs.

0 favorites 0 likes
#post-transformer

Continual learning in mid-2026. A map of everyone trying to crack it: memory layers, "dreaming" agents, and the Post-Transformer models that learn inside the network

Reddit r/artificial ↗ · 2026-06-12

An overview of the current state and future outlook of continual learning in mid-2026, covering memory approaches including external memory, in-state memory, and weight updates, with analysis of various models like TTT, Titans, and Dragon Hatchling.

0 favorites 0 likes
#post-transformer

One of the authors of "Attention is All You Need" just argued we should move past it. Pathway’s Post-Transformer debate is worth watching

Reddit r/singularity ↗ · 2026-05-25

A co-author of the seminal 'Attention is All You Need' paper has argued that the field should move beyond transformers, and a debate hosted by Pathway explores this topic.

0 favorites 0 likes
← Back to home

Submit Feedback