RustingStrata runs DeepSeek-V4.1-Flash (249 GB) on a single RTX 3060 with 30 GB RAM using CUDA and Vulkan backends
Read the original at www.reddit.com→RustingStrata now runs DeepSeek-V4.1-Flash (249 GB) on a single RTX 3060 12 GB with 30 GB RAM RustingStrata is a pure-Rust GGUF inference engine with CUDA and Vulkan backends. It now loads DeepSeek-V4.1-Flash at...
Original headline: "RustingStrata vs llama.cpp, DeepSeek-V4.1-Flash Q2 (249 GB) on a single RTX 3060 12 GB with 30 GB RAM"
Coverage timeline
- Nov 9, 16:27 UTC r/LocalLLaMA lead source RustingStrata vs llama.cpp, DeepSeek-V4.1-Flash Q2 (249 GB) on a single RTX 3060 12 GB with 30 GB RAM