LFM 2.6B is described as lightweight and fast for on-device use, with speeds up to 260T/s and 20k pp on consumer GPUs like the 3090s.
Read the original at old.reddit.com→I’m reaching speeds of 260T/s tg and 20k pp on my 3090s lol, because this model is small and meant to run on phones. From what I‘ve been trying it’s surprisingly great for incredibly quick things like “read this...
Original headline: "LFM 2.6B is a lot of fun."
Coverage timeline
- Aug 9, 04:53 UTC r/LocalLLaMA lead source LFM 2.6B is a lot of fun.