Running DeepSeek V4.1 Flash 1017 on a single RTX 5090 with 5060 Ti as secondary GPU
Read the original at www.reddit.com→Been working over the last few days getting DeepSeek V4.1 Flash 1017 (Unsloth UD-IQ1_S) running in Basalt (inference engine I'm developing). Specs: RTX 5090 (400W) + RTX 5060 Ti 16 GB (180W), 128 GB DDR5....
Original headline: "Ran DeepSeek V4.1 Flash 1017 on a single RTX 5090"
Coverage timeline
- Oct 21, 15:38 UTC r/LocalLLaMA lead source Ran DeepSeek V4.1 Flash 1017 on a single RTX 5090