VoxGen, an AMD-optimized TTS inference engine for VoxCPM 2 models

Reddit r/LocalLLaMA Tools
text-to-speech inference-engine amd-gpu vulkan rust open-source lightweight

Summary

VoxGen is a new lightweight native inference engine for VoxCPM2 models, optimized for AMD cards using Rust and Vulkan compute to enhance performance and remove Python/PyTorch dependencies.

Hi, everyone, I’ve just released VoxGen, a lightweight native inference engine for VoxCPM2, written in Rust and using Vulkan compute instead of Python/PyTorch/CUDA. Why VoxGen? The main reason I started the project was because I needed a decent local text-to-speech solution. I therefore saw VoxCPM 2 as a reasonable solution. However, most frameworks are NVIDIA-first, and VoxCPM 2 is no exception; as a result, my card was severely stuttering, and my GPU was always spiking. Also, having Python and Pytorch as a dependency is absolute hell. This is why VoxCPM was created: not only we sidestep Pytorch completely, but performance on AMD cards is buttery smooth (and if you have a XTX 7900, I have designed a mode with even more aggressive power and speed optimizations)! This application can also be run from a shell, so it can be integrated with other programs and scripts! Installation: You'll only need voxgen.exe (or the Linux equivalent) and the following files at https://huggingface.co/DennisHuang648/VoxCPM2-GGUF: VoxCPM2-BaseLM-Q8_0.gguf VoxCPM2-Acoustic-F16.gguf And that's it! If you are interested, check out the Github page: https://github.com/NullMagic2/VoxGen Prebuilt binaries (for now, Windows only) are available here: https://github.com/NullMagic2/VoxGen/releases
Original Article

Similar Articles

openbmb/VoxCPM2

Hugging Face Models Trending

VoxCPM2 is an open-source, tokenizer-free diffusion autoregressive Text-to-Speech model supporting 30 languages with 2B parameters, 48kHz audio output, and features including voice design from natural language descriptions, controllable voice cloning, and real-time streaming capabilities.

Vox

Product Hunt

Vox is a product that enables users to talk to GitHub Copilot out loud, providing a voice interface for coding assistance.

OpenBMB/VoxCPM

GitHub Trending (daily)

OpenBMB releases VoxCPM2, a 2B-parameter tokenizer-free TTS model trained on 2M+ hours of multilingual speech data, supporting 30 languages, voice design, controllable cloning, and 48kHz output.

Voxatron

Hacker News Top

Voxatron is a fantasy console and collection of games made entirely out of voxels, including an arena shooter and action-adventure cartridges, along with powerful design tools for creating custom voxel games.