LIVE · refreshes every 20 min

updated Aug 15, 06:41 UTC

← 110010.art all stories

r/LocalLLaMA ·2h ago

Quantized AI9Stars' G9v3-39A5B to GGUF and created a llama.cpp fork to support it

Read the original at old.reddit.com→

submitted by /u/linuxid10t [link] [comments]

Coverage timeline

Aug 15, 04:35 UTC r/LocalLLaMA lead source Quantized AI9Stars' G9v3-39A5B to GGUF and created a llama.cpp fork to support it

Related stories

Open-source LLMs for a 5060 Ti 16GB GPU: evaluating model options and throughput on Qwen2.5-14B with 32768 context

r/LocalLLaMA · 1d ago · source ↗

Open labs embrace continued post-training on existing models to achieve performance gains without retraining new base models

r/LocalLLaMA · 15h ago · source ↗

Gemma 4 QAT handles KV cache quantization significantly better, according to KLD benchmarks comparing non-QAT and QAT configurations.

r/LocalLLaMA · 2d ago · source ↗

90 agentic bakeoff compares ThinkingCap, Fable Fusion, and stock Qwen3.6-27B across 90 runs with 6 self-grading tasks and 5 reps per model

r/LocalLLaMA · 19d ago · source ↗

RetroCraft uses Qwen 3.8 27B Q8_K_XL for a one-shot demo with dual 3090s showing exact performance data

r/LocalLLaMA · 9h ago · source ↗