Drama3 in audio.cpp runs up to 5× faster than real time at full speed; 2× real-time on RTX 5090 with <8 GB VRAM, CUDA-focused optimizations noted
Read the original at www.reddit.com→Drama3 support in audio.cpp was contributed by https://github.com/JarodMica. Many thanks for the great work! So far, follow-up optimizations have primarily focused on CUDA. The model also runs on Vulkan and Metal....
Original headline: "Drama3 in audio.cpp: Up to 5× faster than real time at full speed, or 2× real-time speed with < 8 GB of VRAM on an RTX 5090!"
Coverage timeline
- Oct 16, 03:38 UTC r/LocalLLaMA lead source Drama3 in audio.cpp: Up to 5× faster than real time at full speed, or 2× real-time speed with < 8 GB of VRAM on an RTX 5090!