LIVE · refreshes every 20 min

updated Oct 11, 14:43 UTC

← 110010.art all stories

r/LocalLLaMA ·1h ago

Now you can grow Bonsai on your potato

Read the original at www.reddit.com→

No more excuses for GPU-poor folks not to start LLMing! Full 27B-class reasoning in ternary transformer weights, for llama.cpp (CUDA, Metal, CPU) ~9.3x smaller than FP16 (ideal) | 98.2% of FP16 intelligence retained...

Coverage timeline

Oct 11, 12:58 UTC r/LocalLLaMA lead source Now you can grow Bonsai on your potato

Related stories

Local semantic file search for Linux uses EmbeddingGemma 2 with Rust, llama.cpp, and in-process embedding across text, images, video frames, and audio windows; hybrid ranking combines vector similarity with SQLite FTS5

r/LocalLLaMA · 12h ago · source ↗

Qwen 3.8 models tested on AtCoder problems across four thinking efforts

r/LocalLLaMA · 20h ago · source ↗

OpenMed 3.0 ships; Apache-2.0 medical AI runs fully local with no cloud calls, 422 open issues for 3.1

r/LocalLLaMA · 1h ago · source ↗

How fragile is on-device language model safety? Localizing safety-critical parameters for sparse fault analysis

arXiv cs.AI · 3d ago · source ↗

Llama.cpp update adds probabilistic MTP with improvements in prose generation; draft-n-max and draft-p-min align with greedy sampling, per merge of PR 27694

r/LocalLLaMA · 5h ago · source ↗