Loopie: a pair of Mixture-of-Experts looped transformers claim “most powerful looped Transformer to date” with 20B and 6B parameter variants
Read the original at arxiv.org→arXiv:2607.16051v1 Announce Type: new Abstract: We present Loopie, the most powerful looped Transformer to date. The Loopie series consists of two Mixture-of-Experts (MoE) models: a 20B-parameter model with 2B...
Original headline: "Loop the Loopies!"