Tag
Fractale-350M-base is a 386M-parameter base model pretrained from scratch with a novel trained fast-weight memory bank of 8 vectors replacing long context, fully open-sourced including weights, code, and research log.