LIVE · refreshes every 20 min

updated Oct 18, 20:23 UTC

110010.art / topic

Qwen

Oct 18

11h ago New local coding LLMs show strong analytic output, marking a big improvement over past behemoths r/LocalLLaMA → story

13h ago AI model changes router firmware after bypassing guard; user reports Qwen3.8 27b successfully updated OpenWrt firmware r/LocalLLaMA → story

14h ago Qwen vibecode project uses motherboard temperature sensor with offset to pause heating during inference; building an ESP32-based thermostat for local control r/LocalLLaMA → story

15h ago Qwen 4 models to think less while maintaining or increasing intelligence, says user observations r/LocalLLaMA → story

17h ago I accidentally bought 3 RTX 8000 48GB cards; is it feasible to run Strata on a system with multiple GPUs? r/LocalLLaMA → story

17h ago You don’t need a high-end build for local LLMs; a single 16GB GPU with 24GB DDR5 supports Qwen 3.8 27b at 262k context and kv-cache streaming with modest performance. r/LocalLLaMA → story

Oct 17

23h ago Qwen 3.8 Flash Next achieves 37-39 tok/s at 60k context using 2 gaming PCs, an M4 Pro MacBook, and 2 iPhone 17 Pro Maxes over Ethernet/USB-C r/LocalLLaMA → story

23h ago 32GB to 64GB RAM enables UD-IQ4_XS with 4-bit quantization on a single RTX 4090 (IQ2_XS to UD-IQ4_XS progression) r/LocalLLaMA → story

1d ago Older models for technical writing? r/LocalLLaMA → story

1d ago XT-Luna 1B releases v1 of a fine-tuned MiniCPM5 1B focused on agentic and coding workloads; benchmarks against MiniCPM5 1B SFT and Qwen 3.5 4B shared in model card r/LocalLLaMA → story

1d ago Qwen 3.8 Flash Next performance affected by quantized n-gram table on SSD, with measurements and discussion in related Reddit posts r/LocalLLaMA → story

1d ago Strata - Qwen 3.8 Flash Next boosts decoding speed by adjusting --adapt-every value, testers report gains across prompts r/LocalLLaMA → story

1d ago Qwen3.8-27B uncensored Defiance mode enables selection of Joker, Dr. House, Einstein panel, or Socratic tutor with uncensored responses; compares HauhauCS weights and Turbo-Brilliance chat template r/LocalLLaMA → story

1d ago vLLM runs on 4 x Intel B70 with QFN 3.8 FP8; LLM tests show 450 t/s prefill and 20 t/s generation r/LocalLLaMA → story

Oct 16

1d ago 10 things you can do with Qwen 3.6 27B right now (for noobs) r/LocalLLaMA → story

2d ago Improved Qwen3.8-Flash chat template with Sharp template terse option r/LocalLLaMA → story

2d ago Understanding how neural networks learn through interactive visualizations r/LocalLLaMA → story

2d ago Qwen 27B sacrifices context to run better quants; pros and cons r/LocalLLaMA → story

2d ago Qwen3.8-27B-antislop RL’d against slop and ranks 4 on EQBench as BF16+MXFP4; user reports on Reddit and HuggingFace models r/LocalLLaMA → story

2d ago Qwen3.8-27B-UD-IQ4_XS yields images after providing more detailed prompts; developer notes suggest small models also require detailed instructions to avoid lazy responses. r/LocalLLaMA → story

2d ago OpenMOSS releases MOSS-Image; Apache-licensed base model available r/LocalLLaMA → story

2d ago Recommended skill/tool for visual learning like Cognito r/LocalLLaMA → story

2d ago Qwen Flash Next claims to outperform Strata QFN rivals on KLD, size, and top-1 performance; AGANTAI’s Gyro quants highlighted in contrast to ISTA-lab offerings r/LocalLLaMA → story

2d ago RTX 2080 Ti 22GB modified cards for local LLM inference; user asks about testing one r/LocalLLaMA → story

2d ago Alibaba Qwen releases BlenderWorld Benchmark to measure visual agents’ ability to create Blender 3D scenes from real-world references r/LocalLLaMA → story

2d ago Task-phase routing metrics do not reliably indicate quantization sensitivity in MoE FFN tensors arXiv cs.LG → story

Oct 15

2d ago Qwen3.8FN vLLM vs. llama.cpp vs Ninfer6000 compared; Decode demonstrates strong performance with Prefill trails vLLM, close to the reported 400 tokens/s in ideal conditions r/LocalLLaMA → story

3d ago QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer; closer to BF16 than Google’s and NVIDIA’s 4-bit releases r/LocalLLaMA → story

3d ago Exploring options for a local, privacy-focused Alexa-style AI home assistant with ESP32 devices and a central server r/LocalLLaMA → story

3d ago What a £300 35W Snapdragon mini PC can actually do; 35B coder at ~30 tok/s and an 80B model that doesn’t fit in RAM running at 17 tok/s r/LocalLLaMA → story

3d ago Nemotron 3.5 Bolt, Nemo 3.5 Super, and Qwen 3.8 27B/FN benchmarks summarized across multiple tasks r/LocalLLaMA → story

3d ago Best model for 24–30gb RAM local use on devices with 48gb VRAM r/LocalLLaMA → story

3d ago Qwen3.8 shows reduced Finnish accuracy with Q8 quantization when using default wiki, English books, and Finnish books r/LocalLLaMA → story

3d ago Strata may be detrimental for intelligence; comparisons with Swift and GSQ-RCO show mixed results r/LocalLLaMA → story

3d ago No model is better than another; tools and templates cause variation in local models, and clean filenames are needed r/LocalLLaMA → story

3d ago Speed of prefill for Qwen 27b and Qwen Flash remains stagnant despite faster decode; user reports improving prefill with QFN but accuracy tradeoffs ongoing r/LocalLLaMA → story

3d ago Qwen flash 3.8 next “coder” model used on real-world tasks; user asks about experience and usefulness versus iq3 r/LocalLLaMA → story

Oct 14

3d ago Microsoft announces UserRepGen-4B, a fine-tuned Qwen3.5-4B model that generates structured user representations from multi-turn conversations to condition an LLM-based user simulator. r/LocalLLaMA → story

3d ago Qwen 3.8 Flash-Next vs GLM 5.3 Flash compared on collaboration and conversational behavior r/LocalLLaMA → story

3d ago Sabi-Noema: a capability- and efficiency-focused fine-tune of Qwen 3.8 27B r/LocalLLaMA → story

← 1 2 3 4 5 →