OpenAI-compatible TTS endpoint using OmniVoice achieves 0.3s response time and voice cloning from a short clip

I want to share a TTS server with an OpenAI-compatible API that generates speech really fast (about 0.3 seconds for a sentence on an RTX 3080) and can clone a voice from a short reference clip. I’ve optimized the...