Llama.cpp fork combines QFN, specific quant, and ultra-specific hardware config for high pp and tg; upvote prompts, ParaboloidalCrest reports
Read the original at www.reddit.com→Upvote, now! submitted by /u/ParaboloidalCrest [link] [comments]
Original headline: "[llama.cpp fork]: QFN + [specific quant] + [ultra specific hardware config] = [incredible and irreproducible pp and tg]"
Coverage timeline
- Nov 3, 22:48 UTC r/LocalLLaMA lead source [llama.cpp fork]: QFN + [specific quant] + [ultra specific hardware config] = [incredible and irreproducible pp and tg]