LIVE · refreshes every 20 min

updated Sep 4, 00:22 UTC

110010.art / topic

Llama

Sep 2

1d ago Asymmetries in spontaneous and instructed deception in Llama-3.1-70B-Instruct arXiv cs.AI → story

Sep 1

2d ago Gurukul AI: an interactive AI-driven educational platform aligned with Indian syllabi and regional curricula arXiv cs.CL → story

Aug 20

14d ago Mechanistic interpretability of structure-aware numerical reasoning in LLaMA 3.1 8B arXiv cs.LG → story

Aug 19

15d ago llama.cpp adds --n-cpu-ffn option for Dense models (building on --n-cpu-moe / --cpu-moe for MOE models) via pull request 26622 r/LocalLLaMA → story

15d ago DumpsterCluster: using retired GPUs to serve LLaMA-70B on 60 GPUs arXiv cs.LG → story

15d ago Temporal leakage in financial news NLP: a multi-architecture audit with a regime-specific M&A signal arXiv cs.CL → story

Aug 18

16d ago DFlash 2 available for Qwen 3.8 27B and Muse Glimmer r/LocalLLaMA → story

16d ago OpenCode overrides Qwen model samplers to top-p 1.0 instead of 0.95 or 0.80 r/LocalLLaMA → story

16d ago Llama.cpp lacks support for changing thinking amount; user requests on-the-fly mode switching with qwen 3.8 27b referenced r/LocalLLaMA → story

16d ago Combining MTP with ngram-mod to improve repeated token output in coding tasks; user tests show bursts of output when repeating a code block with spec-type and spec-ngram-mod settings r/LocalLLaMA → story

Aug 17

17d ago Qwen 3.8 27B outperforms alternatives and raises pricing concerns; user questions its reasonableness and notes continued Alibaba training after prior release r/LocalLLaMA → story

17d ago Llama.cpp adds adaptive MTP mode using a counting-style state machine to dynamically determine MTP depth; aims to automate depth selection as content density varies r/LocalLLaMA → story

17d ago llama.cpp releases semantic version v0.1.0 r/LocalLLaMA → story

17d ago EXL3 fades from r/LocalLLaMa conversations as its VRAM-focused, OpenAI-compatible API deployment (TabbyAPI) limits practical value on GPUs under 24 GB. r/LocalLLaMA → story

17d ago Ling 3.0 support merged into llama.cpp r/LocalLLaMA → story

17d ago Qwen3.8-27B Q8_0 on Strix Halo demonstrates strong performance on a local test of a single-page HTML flight simulator generation r/LocalLLaMA → story

Aug 16

18d ago Llama.cpp upgrades ROCm to 7.14 for Radeon 780m iGPU benchmarks; ROCm 7.14 adds gfx1103 support, but prebuilt binaries lack the target, requiring a source build r/LocalLLaMA → story

18d ago Qwen3.8 27B Q2 vs Q3 and Qwen3.6 35B-A3B MoE on 12GB VRAM r/LocalLLaMA → story

18d ago Let’s all thank Georgi Gerganov who gave use llama.cpp r/LocalLLaMA → story

18d ago Qwen 3.8 27b—Acquarium panel failure; Q8_K_XL_unsloth r/LocalLLaMA → story

18d ago Qwen 3.8 27b shows 22 t/s performance with Q4, max context, llama.cpp, and MTP enabled; user reports and configurations posted on Reddit r/LocalLLaMA → story

18d ago Best setup for a 16 GB VRAM + 128 GB RAM system for running LLMs like Qwen 3.6 35B and related GGUF quantizations; user tests with 12700k, 5060 Ti, and 128 GB RAM explored performance. r/LocalLLaMA → story

18d ago Show-off Saturday: Intel Arc B140 build with 10-core Xeon W-2255, 64GB RAM, and llama.cpp SYCL back-end r/LocalLLaMA → story

18d ago Redstart: a local AI server using Llama.cpp seeks feedback on its two applications, Redstart-N and another component r/LocalLLaMA → story

18d ago Local privacy focus on cache AI CLI and llama.cpp branch + Qwen3.x Hacker News (AI) → story

Aug 15

19d ago Windows Manager for llama.cpp offers a visual interface to manage runtimes, switch models, and run multiple local endpoints without scripts or manual server management r/LocalLLaMA → story

19d ago Qwen 3.8 27B Q8 faster than Q6 with MTP on Apple Silicon using llama.cpp and lmstudio gguf r/LocalLLaMA → story

19d ago ggml-org/llama.cpp adds Kimi-K3 text model via pwilkin in Pull Request #26185 r/LocalLLaMA → story

19d ago Quantized AI9Stars' G9v3-39A5B to GGUF and created a llama.cpp fork to support it r/LocalLLaMA → story

Aug 14

20d ago RetroCraft uses Qwen 3.8 27B Q8_K_XL for a one-shot demo with dual 3090s showing exact performance data r/LocalLLaMA → story

20d ago Open labs embrace continued post-training on existing models to achieve performance gains without retraining new base models r/LocalLLaMA → story

20d ago Llama.cpp server can run tools in rootless sandboxed containers via --tools option r/LocalLLaMA → story

20d ago KV cache tricks for agents: prompt caching in llama.cpp stores memory-resident KV cache and ejects on prompt delta; used to run subagents when only one large model fits on GPU r/LocalLLaMA → story

Aug 13

21d ago DS4 cloud vs. Qwen3.6 36B vs. Muse Glimmer 30B speed benchmark on Llama.cpp (RTX 5080) r/LocalLLaMA → story

21d ago Fine-tuned Qwen2.5-Coder-1.5B on 125k command pairs can write shell commands on a laptop CPU in about 1 second; runs via llama.cpp on 1.6GB RAM with 31.9 tok/s and 0.59s median per query r/LocalLLaMA → story

21d ago Qwen3.8-2.4T-A95B runs locally on RTX 5090 + RTX 5060 Ti at about 0.80 tokens per second using llama.cpp with Unsloth GGUF quantization and 512 routed experts, 10 active per token. r/LocalLLaMA → story

21d ago ggml-cpu/ops vectorizes flash-attention F16 to F32 conversion using F16C intrinsics; PR #26947 r/LocalLLaMA → story

21d ago Open-source LLMs for a 5060 Ti 16GB GPU: evaluating model options and throughput on Qwen2.5-14B with 32768 context r/LocalLLaMA → story

Aug 12

22d ago Gemma 4 QAT handles KV cache quantization significantly better, according to KLD benchmarks comparing non-QAT and QAT configurations. r/LocalLLaMA → story

22d ago Tested Nemotron 3.5 Lightning locally on coding; Hermes Agent shows strong tool-calling capabilities but overall code quality below expectations for its size r/LocalLLaMA → story

← 1 2 3 4 →