Beyond IceBERT: Open-Data ModernBERT encoders for Icelandic from 12M to 1B parameters
Read the original at arxiv.org→arXiv:2610.36230v1 Announce Type: new Abstract: IceBERT, the reference encoder for Icelandic, found that a cleaned web crawl is enough to train a strong model and that starting from a multilingual model can help on...
Original headline: "Beyond IceBERT: Open-Data ModernBERT Encoders for Icelandic from 12M to 1B Parameters"
Coverage timeline
- Oct 28, 04:00 UTC arXiv cs.CL lead source Beyond IceBERT: Open-Data ModernBERT Encoders for Icelandic from 12M to 1B Parameters