Dory1.0-4B: a 4-billion-parameter looped language model with elastic depth and a normalized Transformer backbone for variable inference compute budgets
Read the original at arxiv.org→arXiv:2611.03998v1 Announce Type: new Abstract: We introduce Dory1.0-4B, a 4-billion-parameter looped (latent-recurrent) language model with elastic depth: a single checkpoint serves different inference compute...
Original headline: "Dory1.0-4B: A Looped Normalized-GPT"
Coverage timeline
- Nov 4, 05:00 UTC arXiv cs.CL lead source Dory1.0-4B: A Looped Normalized-GPT