Train LoRA directly on quantized GGUFs without PyTorch or a parent FP16; use the same GGUF for inference afterward
Read the original at www.reddit.com→I've seen this one floating around quite a bit now and since this is something that can be done without the parent and or other dependencies i thought i'd share something. Usually when you fine-tune a model you...
Original headline: "Train LoRA directly on Quantized GGUFs, no PyTorch, no Parent(FP16) needed, just your GGUF and the data"
Coverage timeline
- Oct 14, 05:34 UTC r/LocalLLaMA lead source Train LoRA directly on Quantized GGUFs, no PyTorch, no Parent(FP16) needed, just your GGUF and the data