icelandic

Researchers train ModernBERT-based Icelandic encoders from 12M to 1B parameters on 9B tokens of open data, showing that a 1B model trained from scratch beats IceBERT on all eleven tasks, and that warm-starting from an English Ettin encoder yields the best scores across every benchmark while highlighting the importance of vocabulary transplantation.