LFM3-1.7b shows strong performance for compression and summarization; 4.1k t/s prefill and ~78 t/s decode on Strix Halo iGPU, with higher coherence when tensor-split across 7900 XTX + XT
Read the original at www.reddit.com→Been testing Liquid's LFM3-1.7B (Q8_0 GGUF, llama.cpp, ROCm) as a candidate for compression and summarization work 4.1k t/s prefill and ~78 t/s decode on a Strix Halo iGPU ~7.1k / ~151 if you tensor-split it across a...
Original headline: "LFM3-1.7b seems impressive"
Coverage timeline
- Nov 1, 15:38 UTC r/LocalLLaMA lead source LFM3-1.7b seems impressive