r/LocalLLaMA ·2h ago

Engine runs Qwen-Flash-Next at nearly 400 t/s on three 32GB V100 GPUs in an old R740; engine gutted from the Strata fork and built for Volta generation.

submitted by /u/jfinkpottery [link] [comments]

Original headline: "I built an engine that runs Qwen-Flash-Next at nearly 400t/s on cheap(ish) hardware. 3x V100 32GB in an old R740. Originally forked from strata but the engine guts all built for the old Volta generation."

Coverage timeline

Oct 26, 21:11 UTC r/LocalLLaMA lead source I built an engine that runs Qwen-Flash-Next at nearly 400t/s on cheap(ish) hardware. 3x V100 32GB in an old R740. Originally forked from strata but the engine guts all built for the old Volta generation.

Qwen

Qwen investigation traces release of model traces for testing by developers; OpenAI? (ignore) The text mentions Qwen3.8 and release of traces for developers to test. Wait need accurate: "Qwen investigation traces release" could be headline. We must not add extra. From excerpt: releasing the traces so developers can test this out; developers running Qwen3.8 on their own machines spotted the strange links. So headline: "Qwen investigation traces release of model traces for developers to test" Keep capitalization: sentence case only first word and proper nouns. "Qwen investigation traces release of model traces for developers to test" But "Qwen" is a proper noun. "model traces" ok. Might be awkward. Could be: "Qwen investigation traces release of traces for testing by developers" We'll do: "Qwen investigation traces release of model traces for developers to test" Ensure under 200 chars. Let's craft. Qwen investigation traces release of model traces for developers to test

r/LocalLLaMA · 1h ago · source ↗

Auditing residual interventions in tool-use models shows targeted condition reuse can improve target-selection accuracy in Qwen3.5-27B across 32 worlds, though gains may not generalize.

arXiv cs.CL · 19h ago · source ↗

4B coding model demonstrates 3D scene generation capability; independent fine-tune of Qwen3.5-4B with Q4_K_M and Q8_0 GGUFs available on Hugging Face for ongoing training.

r/LocalLLaMA · 1d ago · source ↗

Engine runs Qwen-Flash-Next at nearly 400 t/s on three 32GB V100 GPUs in an old R740; engine gutted from the Strata fork and built for Volta generation.

Coverage timeline

Related stories