Basalt is an inference engine for Qwen 3.8 Flash Next, tuned for Blackwell and supporting vision; it requires the image encoder in VRAM or CPU continuously, with CPU encoding being slow.
Read the original at www.reddit.com→Dynamic vision, in action Basalt is an inference engine for 3.8 Flash Next, forked from Strata and heavily tuned for Blackwell. It supports vision, and for this to work you need to have the image encoder either in...
Original headline: "Basalt: Fast Blackwell inference engine for Qwen 3.8 Flash Next (and how we got vision for free)"
Coverage timeline
- Oct 13, 14:08 UTC r/LocalLLaMA lead source Basalt: Fast Blackwell inference engine for Qwen 3.8 Flash Next (and how we got vision for free)