LIVE · refreshes every 20 min
updated Oct 13, 21:43 UTC
110010.art(ificial intelligence)
AI products, research, and launches — clustered and ranked, not just re-blogged.
← 110010.art all stories
r/LocalLLaMA ·1h ago

Why AnythingLLM is moving from Ollama to Lemonade and llama.cpp

Read the original at www.reddit.com→

I'm excited to see our Lemonade embedded SDK getting used out there! submitted by /u/jfowers_amd [link] [comments]

Coverage timeline

Llama

Related stories

Running decision models: picking quantization and VRAM usage
r/LocalLLaMA · 15h ago · source ↗
MoE experts loaded from disk in llama.cpp's WebGPU backend in a Chrome tab for an 80B Qwen3-Next model (48 GB GGUF)
r/LocalLLaMA · 7h ago · source ↗
SonicBoom achieves 52 tok/s decode on a laptop RTX 3050 (llama.cpp 45) with the same quantized kernels; the difference is a graph compiler, with no Python involved.
r/LocalLLaMA · 11h ago · source ↗
Local models could start optimizing their own runtime stacks; open-source parity and recent forks suggest progress next year, with Claude and OpenAI-scale models informing developments
r/LocalLLaMA · 20h ago · source ↗
How fragile is on-device language model safety? Localizing safety-critical parameters for sparse fault analysis
arXiv cs.AI · 5d ago · source ↗