LIVE · refreshes every 20 min

updated Oct 22, 13:03 UTC

← 110010.art all stories

r/LocalLLaMA ·2h ago

Llama.cpp PR: how to beat StrataDecode performance with a R9700

Read the original at www.reddit.com→

submitted by /u/keyboardhack [link] [comments]

Original headline: "Llama.cpp PR: How to beat strata decode performance with a R9700"

Coverage timeline

Oct 22, 10:48 UTC r/LocalLLaMA lead source Llama.cpp PR: How to beat strata decode performance with a R9700

Related stories

Carbon-X, a 14B model, runs locally with llama.cpp and combines DNA and natural language; claims open-source DNA language model outperforms open lms on five DNA benchmarks at lower cost

r/LocalLLaMA · 2h ago · source ↗

Reflection releases Beam-1.0 with a 501B-parameter sparse MoE model (23B active) supporting 1M-token context; instruction-tuned in BF16, FP8, and NVFP4 across English-focused deployment.

r/LocalLLaMA · 5d ago · source ↗

Llama.cpp adds WebGPU Q2_0 support with testing on RTX 3060 using native Dawn WebGPU

r/LocalLLaMA · 3h ago · source ↗

llampart 2.0.1 released; a self-hosted Web UI for chatting with LLMs via llama-server, vLLM, and OpenAI-compatible APIs

r/LocalLLaMA · 23h ago · source ↗

Fast LoRA in llama.cpp lacks fast kernels, according to updates and examples showing LoRA usage with Qwen3.8-Flash-Next models

r/LocalLLaMA · 1d ago · source ↗