LIVE · refreshes every 20 min
updated Nov 11, 06:44 UTC
110010.art(ificial intelligence)
AI products, research, and launches — clustered and ranked, not just re-blogged.
← 110010.art all stories
r/LocalLLaMA ·1h ago

llama.cpp: add FP8 KV-cache

Read the original at www.reddit.com→

submitted by /u/Kahvana [link] [comments]

Original headline: "llama.cpp: Add FP8 KV-cache"

Coverage timeline

Llama

Related stories

Third Eye: immediate gains from self-update are near zero; further native updates can improve performance, according to tests on 3-8B backbones across math and code
arXiv cs.LG · 1h ago · source ↗
ggml-org/llama.cpp adds --shard support to load models from multiple shard locations and enables PLE (engram) file loading from separate GGUFs
r/LocalLLaMA · 23h ago · source ↗
Reflection releases Beam-1.0 with a 501B-parameter sparse MoE model (23B active) supporting 1M-token context; instruction-tuned in BF16, FP8, and NVFP4 across English-focused deployment.
r/LocalLLaMA · 25d ago · source ↗
XeMaya, an Intel Arc inference engine, enables native running of DeepSeek V4.1 and GLM 5.3 via SYCL and Level Zero
r/LocalLLaMA · 6h ago · source ↗
DNA Factory open-sources a fine-tuning framework with five training methods and opinionated defaults
r/LocalLLaMA · 19h ago · source ↗