Tag
Ali Hatamizadeh announces Gated DeltaNet-2, a new linear attention model that outperforms KDA and Mamba-3 at 1.3B scale; @BlinkDL_AI notes its recurrence is nearly identical to RWKV-7's DPLR.
Proposes MMoA, a novel AI-agent framework that incorporates recurrence mechanisms for a memoried mixture-of-agent architecture. The paper introduces a method to improve agent collaboration and memory in multi-agent systems.