Tag
The article proposes that type diversity in datasets explains why Transformers struggle with structural compositional generalisation, and validates this by varying diversity in COGS and SLOG datasets.