LIVE · refreshes every 20 min
updated Aug 8, 05:01 UTC
110010.art(ificial intelligence)
AI products, research, and launches — clustered and ranked, not just re-blogged.
← 110010.art all stories
r/LocalLLaMA ·1h ago

BeeLLama issues with kvarn6 cache types and llama-server options for Qwen3.6-35B-A3B-IQ4 model

Read the original at old.reddit.com→

Tried to use Beellama , and using the kvarn6 flag, i notice that its in llama-server --help but its not working. I must be doing something wrong. trying to run the following: llama-server.exe ^ --model...

Original headline: "BeeLLama issues"

Coverage timeline

Llama

Related stories

AMD acquires Taalas; startup demos Llama 3.1 8B at 17k tok/s
Hacker News (AI) · 1d ago · source ↗
KV cache quantization benchmarks: 413 pairs tested on Qwen 3.6 27B and Gemma 4 31B; KLD with BeeLlama.cpp v0.4.0 shows KVarN 6-bit beating q8_0 with precision tail dominating
r/LocalLLaMA · 1d ago · source ↗
90 agentic bakeoff compares ThinkingCap, Fable Fusion, and stock Qwen3.6-27B across 90 runs with 6 self-grading tasks and 5 reps per model
r/LocalLLaMA · 12d ago · source ↗
TensorSharp adds MoE CPU-offload feature to main, enabling up to 35B-A3B MoE to fit with long-context KV cache on 12-16 GB GPUs; router, shared experts stay on accelerator.
r/LocalLLaMA · 2d ago · source ↗
GFX1030/Multiple V620 users: set -ub 384 and -b to a multiple of that to fix llama.cpp tensor split crashes
r/LocalLLaMA · just now · source ↗