LIVE · refreshes every 20 min

updated Oct 18, 21:23 UTC

110010.art / topic

Qwen

Oct 7

11d ago Model evaluation question: users test newly released models with a prompt about describing main cast of a niche 2010s cartoon to gauge coding quality; many 30b models fail, some succeed. r/LocalLLaMA → story

11d ago I re-trained the DFlash 2 drafter for Ternary Bonsai 2 27B: 2.2x on an L4, 3.2x on code edits with ngram lookup, 1.5x on a Mac, and 1.2x in Chrome. r/LocalLLaMA → story

Oct 6

11d ago Budget of about $4000 for a setup to run Qwen 3.8-Flash-Next; options include 2x Radeon AI R9700 with 64GB VRAM, Strix Halo box with 128GB unified memory, or 6x Intel Arc B60 GPUs with 144GB VRAM, plus a compatible motherboard/CPU. r/LocalLLaMA → story

12d ago Qwen3.8-Flash-Next adds official Strata support for Strix Halo on Linux (experimental) with up to 1M context length r/LocalLLaMA → story

12d ago Meta and University of Washington researchers allow small models to edit their own context on every turn; results show performance gains with smaller models like Qwen 3.5 9b and Qwen 3.6 27b r/LocalLLaMA → story

12d ago Qwen3.8: 27b outperforms flash next in user workflow impressions, despite benchmark expectations r/LocalLLaMA → story

12d ago RDNA4 performance meta with Qwen 3.8: user questions about architecture-specific inference engines and potential gains against RDNA4 r/LocalLLaMA → story

12d ago Running local LLMs on Orange Pi 5 Plus with RK3588: Ollama throughput gains from core pinning and NPU offloading; thermals and Tok/s measured r/LocalLLaMA → story

12d ago Gemma 4 26B-A4B and a 37 GB Qwen3.6 MoE run in a browser tab on a 24 GB Mac; experts streamed from disk, output matches llama.cpp r/LocalLLaMA → story

12d ago Unsloth updates Qwen3.8-Flash-Next-GGUF to work with llama.cpp r/LocalLLaMA → story

Oct 5

12d ago A benchmark shows LLMs playing Civilization V; GLM-5.3 leads Opus-5.5, with Qwen-3.8-27B performing surprisingly well. r/LocalLLaMA → story

12d ago Qwen image 2.1 is newer than Qwen image 3.0 r/LocalLLaMA → story

13d ago How is qwen 27b so good compared with GPT-4o; questions arise about training data and technologies underlying its performance r/LocalLLaMA → story

13d ago Qwen for daily QnA? r/LocalLLaMA → story

13d ago Qwen3.8-Flash-Next appears overly trigger-happy in coding tasks, reviewers report behavior including frequent tool calls and automatic code changes r/LocalLLaMA → story

13d ago Finetuned 1.5B Qwen to generate bash commands at gpt-4o level using 400k synthetic examples; fully opensource finetune dataset r/LocalLLaMA → story

13d ago Control vector generation tool in C++ for any LLM in a single prompt pair; UCvg.cpp r/LocalLLaMA → story

13d ago Qwen3.8-27b appreciation moment r/LocalLLaMA → story

13d ago oMLX, Rapid-MLX, Splash, and MTPLX compared on M3 Max: ~110 tok/s with Qwen3.6-35B-A3B-4bit and ~32 tok/s with Qwen3.8-27B-4bit r/LocalLLaMA → story

13d ago Hardware recommendations around £6000–£7000 for coding workloads and high-VRAM needs r/LocalLLaMA → story

13d ago OntoPrune speeds TTFT on local CPU with Ollama by neuro-symbolic context pruning, claiming 6.7x faster performance and 83-86% token savings with 0% hallucinations r/LocalLLaMA → story

13d ago MoE SSD streaming on a 64 GB Mac mini: GPU still waits 27% of decode on experts r/LocalLLaMA → story

13d ago Ok how to actually learn vLLM? r/LocalLLaMA → story

13d ago Qwen 3.8-Flash-Next generated a signed URL to Alibaba Cloud during a web tool session; user reports suspicion of potential leakage. r/LocalLLaMA → story

Oct 4

13d ago Upgrading from 1xR9700 to 2xR9700; seeking build recommendations before purchasing additional parts r/LocalLLaMA → story

13d ago Qwen3.8 27B addition in words tested; GPT-4o used to compute sums in words across large numbers, with many incorrect results, per Colin Frasier and Bluesky post Simon Willison → story

13d ago Moving from Qwen 27B to cloud agents; author reflects on eye-opening shift and no regrets r/LocalLLaMA → story

14d ago QFN llama.cpp: user asks for config tips for running a squished ISTA model on dual RTX 5060 Ti and 32 GB RAM r/LocalLLaMA → story

14d ago Post-training finetune of AliceAI-80B-A3B-Base; instruct model capable of agentic work and conversation using local data and shallow distill of qwen 3.8 27b r/LocalLLaMA → story

14d ago Poorman inference engine enables 35B Qwen 3.6 to run MoE expansion with 8 routed experts per token on a 16GB GPU; Claude Code compatibility via OpenAI and Anthropic APIs r/LocalLLaMA → story

14d ago Rust tool repOx packs repos into prompts in under 15ms to avoid token waste from lockfiles and binaries r/LocalLLaMA → story

14d ago Local models still lag behind Opus 5.5 for 3D modeling, survey finds; user reports using Qwen 3.8/flash on 5090. r/LocalLLaMA → story

14d ago Intel hybrid CPUs: Strata calibrate nearly triples decode speed for Qwen3.8-Flash-Next IQ3_S with 262K context on a 16 GB card. r/LocalLLaMA → story

14d ago Home GPU bottleneck delays as user scales from 1x3090 to 20 DGX Sparks to run large language models locally; reports first bottleneck in house fuses r/LocalLLaMA → story

14d ago Improving creative writing for Local Models (Qwen) r/LocalLLaMA → story

14d ago Qwen3.8 Flash Next improvements expected to aid Qwen4 development; discussion on optimization efforts vaega r/LocalLLaMA → story

Oct 3

15d ago Arex-2 vs swift vs qwen3.8 27b r/LocalLLaMA → story

15d ago I built ninfer 4080 for 16gb class GPUs r/LocalLLaMA → story

15d ago I tried building a small RAG search node for Qwen3.8 27B with a fake AliExpress Mini PC; Intel pushed me back to 2018. r/LocalLLaMA → story

Oct 2

16d ago Microsoft releases FrogNano-4B-2609, an agentic model derived from Qwen3.5-4B with post-training focused on repository-level software engineering; trained with reinforcement learning on synthetic SWE data r/LocalLLaMA → story

← 1 2 3 4 5 →