d3-edge (0.6B) fine-tuned outperforms d3 (27B) decision model
Read the original at www.reddit.com→Took vLLM-SR d3-edge (0.6B), fine-tuned it with simple SFT + LoRA, and compared it against the much larger d3 (27B). With just a few thousand training examples, the 0.6B model actually outperformed the 27B model on...
Original headline: "d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model"
Coverage timeline
- Oct 16, 14:38 UTC r/LocalLLaMA lead source d3-edge (0.6B) fine-tuned outperformed d3 (27B) decision model