LFM3-1.7B quantization report: 3.6 GB VRAM lossless; 2.2 GB with modest degradation
Read the original at www.reddit.com→This model looks quite spectacular. According to LiquidAI's own benchmarks, it scores higher than MiniCPM5-2B across the board, while offering 2x the context and taking up half the space in VRAM (3.6 GiB vs. 7.1 GiB...
Coverage timeline
- Nov 3, 00:15 UTC r/LocalLLaMA lead source LFM3-1.7B quantization report: 3.6 GB VRAM lossless; 2.2 GB with modest degradation