EdgeRazor uses entropy-guided distillation to translate teacher logit distributions into a low-bit, mixed-precision student; preserves more of teacher competence at very low parameters
Read the original at old.reddit.com→The EdgeRazor method uses an entropy-guided distillation process to better translate a teacher model's logit probability distributions into the student model's low-bit / mixed-precision hidden-layer features, without...
Original headline: "[Paper] EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation"
Coverage timeline
- Aug 2, 19:55 UTC r/LocalLLaMA lead source [Paper] EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation