Tag
Thinky is a ~1T parameter mixture-of-experts model with 41B active parameters, released under Apache-2 license. It achieves new best results among American models, benchmark improvements over Nemotron Ultra, with omni-modal input.
Raphael released two open-source retrieval models, LateOn (ColBERT multi-vector) and DenseOn (single-vector), each 149M parameters and outperforming 4× larger models on BEIR.