LFM3 1.7b performs well; 2b VL also good but with half the context, and is fast on CUDA with RTX 3090 Ti
Read the original at www.reddit.com→I finally got around to trying it. This tiny model is surprisingly capable it seems. Also tried the 2b VL - also very good but it has half the context of 1.7b. It's also quite fast: $ llama-bench -m...
Original headline: "LFM3 1.7b - Rather good"
Coverage timeline
- Nov 4, 13:30 UTC r/LocalLLaMA lead source LFM3 1.7b - Rather good