LIVE · refreshes every 20 min
updated Oct 21, 07:43 UTC
110010.art(ificial intelligence)
AI products, research, and launches — clustered and ranked, not just re-blogged.
← 110010.art all stories
r/LocalLLaMA ·2h ago

Strata speeds up on Apple Silicon?

Read the original at www.reddit.com→

Strata is the new hotness - claims of 4x tok/s increase over llama.cpp. I havent seen any posts talking about performance on Apple silicon however. Curious if anyone's run comparisons on Apple Silicon against...

Original headline: "Strata speed up on Apple Silicon?"

Coverage timeline

Llama

Related stories

Reflection releases Beam-1.0 with a 501B-parameter sparse MoE model (23B active) supporting 1M-token context; instruction-tuned in BF16, FP8, and NVFP4 across English-focused deployment.
r/LocalLLaMA · 4d ago · source ↗
EAGLE-4 release achieves faster performance than DFlash2 and DSpark, with MTP, DSpark, DFlash 2, and EAGLE-4 benchmarks showing speedups; Qwen 3.8-27B currently supported
r/LocalLLaMA · 8h ago · source ↗
Fast LoRA in llama.cpp lacks fast kernels, according to updates and examples showing LoRA usage with Qwen3.8-Flash-Next models
r/LocalLLaMA · 2h ago · source ↗
Used HP Z640 with 2x E5-2680 v4, 64GB ECC, and Quadro M6000; plan to add two 3060s for Qwen 3.8 Flash Next on Strata, llama.cpp, and PyTorch workloads under Ubuntu.
r/LocalLLaMA · 23h ago · source ↗
How fragile is on-device language model safety? Localizing safety-critical parameters for sparse fault analysis
arXiv cs.AI · 13d ago · source ↗