You can train your own LLMs with less memory on gaming GPUs, including a 27B model on a 3090 with 24GB VRAM.
Read the original at www.reddit.com→TL;DR: You can train your own 27B model on a 3090 with 24GB VRAM, though you would have to go through hundreds of billions of tokens for it to be good. I am working on conversion of existing models. Check repos for...
Original headline: "You can now train your own LLMs with less memory, on your gaming GPUs"
Coverage timeline
- Nov 11, 12:36 UTC r/LocalLLaMA lead source You can now train your own LLMs with less memory, on your gaming GPUs