12GB VRAM gang, what’s our plan? focuses on qwen finetuned MoEs and dense models for smaller setups; asks whether upgrading to 24GB VRAM is the only option
Read the original at old.reddit.com→Seems like we're limited to qwen finetuned MoEs for now. Looking at the current landscape - focus seems to be on dense models (muse glimmer 30b, qwen 3.8 27b) for smaller setups. Is upgrading to 24GB VRAM the only...
Original headline: "12GB VRAM gang, what's our plan?"
Coverage timeline
- Aug 11, 07:31 UTC r/LocalLLaMA lead source 12GB VRAM gang, what's our plan?