DeepSeek v4.1 Flash 1017 for Dwarfstar (ds4) integrates 2-bit routed experts with 8-bit or higher for everything else and the original FP8 engram table, using imatrix built from 1017
Read the original at www.reddit.com→Hey y'all, just following up on my PR to get the new vision tower for 1017 working in ds4 with the quant I promised (the language model loads already, but vision needed my PR). I built to the exact same recipe...
Original headline: "DeepSeek v4.1 Flash 1017 for Dwarfstar (ds4)"
Coverage timeline
- Oct 18, 04:12 UTC r/LocalLLaMA lead source DeepSeek v4.1 Flash 1017 for Dwarfstar (ds4)