Laguna S 2.1 Q4_K_M size increases from 68GB to 96GB, adds 8 FP16 layers while keeping others at 4-bit
Read the original at old.reddit.com→I've been occasionally checking Laguna S 2.1 to see if there's any updates/fixes to the issues they've been having. I just noticed that they recently updated their Q4_K_M and it's now ballooned to 96GB, bumping up 8...
Original headline: "Laguna S 2.1 GGUF Q4_K_M went from 68GB to 96GB?"
Coverage timeline
- Jul 28, 16:17 UTC r/LocalLLaMA lead source Laguna S 2.1 GGUF Q4_K_M went from 68GB to 96GB?