Progress on continuous learning prompts: will model weights remain frozen or gain plasticity with repeated data ingestion?
Read the original at www.reddit.com→So I'm wondering if we til ever have repeated data ingestion without quality degradation and without full retraining. LoRA and friends are excluded, will we stay forever with frozen weights or will be be able to...
Original headline: "Any progress on continuous learning prompt, will we have meaningful weights plasticity or they'll stay forever frozen?"
Coverage timeline
- Oct 31, 11:27 UTC r/LocalLLaMA lead source Any progress on continuous learning prompt, will we have meaningful weights plasticity or they'll stay forever frozen?