Microsoft/VibeVoice-ASR-BitNet: a compressed variant optimized for real-time edge CPU inference, reducing size from 4.62 GB to 1.58 GB with 1.6–2.3× faster inference than Whisper.cpp.
Read the original at old.reddit.com→VibeVoice-ASR-BitNet is a compressed variant of VibeVoice-ASR optimized for real-time inference on edge CPUs — no GPU required. Through heterogeneous quantization, the model is compressed from 4.62 GB to 1.58 GB...
Original headline: "microsoft/VibeVoice-ASR-BitNet"
Coverage timeline
- Jul 28, 04:10 UTC r/LocalLLaMA lead source microsoft/VibeVoice-ASR-BitNet