NVIDIA trims a 30B speech LLM from 67.5GB to 10GB with zero retraining; achieves 5.16% WER vs 4.12% teacher
Read the original at www.reddit.com→submitted by /u/Illustrious_Row_9971 [link] [comments]
Original headline: "pruned NVIDIA's new 30B speech LLM from 67.5GB to 10GB with zero retraining, it still transcribes at 5.16% WER (teacher: 4.12%)"
Coverage timeline
- Oct 29, 05:54 UTC r/LocalLLaMA lead source pruned NVIDIA's new 30B speech LLM from 67.5GB to 10GB with zero retraining, it still transcribes at 5.16% WER (teacher: 4.12%)