Wiola 13M, a gated spiral attention architecture for parameter efficient small language models
Read the original at arxiv.org→arXiv:2608.14604v1 Announce Type: new Abstract: Small language models in the ten to one hundred million parameter range are attractive for on device inference, rapid experimentation, and controlled scientific study,...
Original headline: "Wiola 13M, a Gated Spiral Attention Architecture for Parameter Efficient Small Language Models"
Coverage timeline
- Aug 18, 04:00 UTC arXiv cs.CL lead source Wiola 13M, a Gated Spiral Attention Architecture for Parameter Efficient Small Language Models