Why do models under 15b have limited use in labs, with 24-27b as minimum size for state-of-the-art models?
Read the original at www.reddit.com→Basically title. All labs seem to have agreed 24-27b is the minimum size they will go, nothing below that. I wonder when will we get the next sub 14b model from a SOTA lab submitted by /u/Hot_Example_4456 ...
Original headline: "Why do we have models under 15b so rarely anymore?"
Coverage timeline
- Oct 16, 13:28 UTC r/LocalLLaMA lead source Why do we have models under 15b so rarely anymore?