Audio8/Audio8-TTS-Preview-0.6b · Hugging Face

Source: https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b

Audio8 TTS Preview 0.6B: SOTA-Class TTS at Compact Scale

A 0.6B-parameter multilingual text-to-speech model with zero-shot voice cloning.

Audio8 TTS Preview supports multilingual speech generation and zero-shot voice cloning. This repository contains the complete checkpoint, its 44.1 kHz neural audio codec, tokenizer, processor, and Hugging Face remote code.

**Preview status:**Language coverage is intentionally limited in this release. For the best results, use one of the 11 recommended languages below. Broader multilingual coverage and Chinese dialect support are planned for future releases.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#supported-languagesSupported Languages

Cantonese·Chinese·Dutch·English French·German·Italian·Japanese Korean·Polish·Spanish

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#model-detailsModel Details

Audio8 TTS uses a DualAR architecture inspired byFish Audio S2 Pro. The slow AR transformer predicts one semantic token for each audio frame. The fast AR transformer predicts the frame’s codec codebooks, conditioned on the slow hidden state and preceding codebooks.

ComponentConfigurationMain model601,159,424 parameters, excluding the codecSlow AR24 layers, width 896, 14 attention heads, 2 KV headsFast AR4 layers, width 896, 14 attention heads, 2 KV headsAcoustic tokens10 codebooks, 4,096 entries per codebookCodec44.1 kHz, 2,048 samples per model frame (~21.5 frames/s)ContextUp to 2,048 packed text/audio positions The bundled codec handles both reference-audio encoding and waveform decoding, so no additional codec checkpoint is required.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#installationInstallation

Python 3.10 or newer and a CUDA-capable GPU are recommended.

pip install "torch>=2.5.0" "torchaudio>=2.5.0" \
  "transformers>=4.57.0,<5" "soundfile>=0.12" "safetensors>=0.4"

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#usageUsage

The model uses custom Transformers code. Review the files in this repository, then load it withtrust\_remote\_code=True.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#zero-shot-voice-cloningZero-shot voice cloning

The reference transcript must match the spoken content in the reference audio.

import soundfile as sf
import torch
from transformers import AutoModel, AutoProcessor

model_id = "AutoArk-AI/Audio8-TTS-Preview-0.6b"
device = "cuda" if torch.cuda.is_available() else "cpu"
dtype = torch.bfloat16 if device == "cuda" else torch.float32

processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
model = AutoModel.from_pretrained(
    model_id,
    trust_remote_code=True,
    dtype=dtype,
).eval().to(device)

inputs = processor(
    text=["Welcome to Audio8 TTS."],
    reference_audio=["reference.wav"],
    reference_text=["The exact transcript of the reference recording."],
    return_tensors="pt",
)
inputs = {name: value.to(device) for name, value in inputs.items()}

with torch.inference_mode():
    output = model.generate(
        **inputs,
        max_new_tokens=1024,
        temperature=0.8,
        top_p=0.95,
        top_k=50,
        do_sample=True,
        return_dict_in_generate=True,
    )
    waveforms, waveform_lengths = model.decode_audio(output.codes)

audio = waveforms[0, : int(waveform_lengths[0])].float().cpu().numpy()
sf.write("output.wav", audio, model.config.codec_sample_rate)

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#generation-without-a-referenceGeneration without a reference

Omitreference\_audioandreference\_textwhen a cloned voice is not needed:

inputs = processor(
    text=["This utterance does not use a reference voice."],
    return_tensors="pt",
)

For command-line inference, batching, and supervised fine-tuning, see theAudio8 TTS repository.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#evaluationEvaluation

Audio8 TTS Preview is the smallest model in this comparison at just0.6B parameters. Despite using only a fraction of the parameters of the other systems, it delivers results in the first tier of industry-leading SOTA TTS models on the benchmarks below. In particular, it achieves the best English WER and competitive Chinese CER on Seed-TTS, while remaining competitive across the CV3 multilingual evaluation.

Lower WER/CER is better; higher SIM is better. Seed-TTS similarity values are shown as percentages.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#seed-ttsSeed-TTS

ModelParametersEN WER / SIMZH CER / SIMHard ZH CER / SIMAudio8 TTS Preview0.6B1.506/ 63.20.950 / 73.111.510 / 68.7Fish S2 Pro4.6B1.607 / 64.61.038 / 73.810.149 / 70.1Higgs Audio v24.7B1.524 / 66.40.806/ 72.110.622 / 69.3CosyVoice3-1.5B1.5B2.22 / 72.01.12 / 78.15.83/75.8MOSS-TTS8.5B1.85 / 73.41.20 / 78.8-VoxCPM22.3B1.84 /75.30.97 /79.58.13 / 75.3

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#cv3-multilingual-error-rateCV3 multilingual error rate

ModelParameterszhenhard-zhhard-enjakodeesfritruAudio8 TTS Preview0.6B3.205****3.12810.5355.9977.2054.2233.4473.6418.7904.790-Fish S2 Pro4.6B3.6003.49310.5887.3495.1394.1113.6052.9728.6004.2294.702Higgs Audio v24.7B3.3783.40410.4245.754****4.7424.2603.300****2.9299.4253.5555.423CosyVoice3-1.5B1.5B3.914.999.7710.557.575.696.434.4711.810.56.64VoxCPM22.3B3.655.008.558.485.965.694.773.809.854.255.21 Parameter counts are calculated directly from the released weight tensors. MOSS-TTS contains 8,489,841,664 parameters. VoxCPM2’s main model contains 2,290,004,544 parameters; the separate AudioVAE is not included in the parameter comparison.

Fish S2 Pro was reevaluated because its official evaluation uses its own normalizer. Higgs Audio v2 was evaluated locally because concrete values were unavailable. All other baseline values were collected from their official reports through theVoxCPM repository.

Different normalizers and evaluators make cross-project values reference comparisons rather than a strictly matched ranking. Evaluation coverage does not expand the Preview checkpoint’s supported-language claim beyond the 11 languages listed above.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#limitations-and-responsible-useLimitations and Responsible Use

• This is a Preview checkpoint with limited multilingual and dialect coverage.
• Very long, noisy, or incorrectly transcribed reference clips can reduce stability and speaker similarity.
• Generated speech can be misused for impersonation or misinformation. Obtain consent before cloning a voice and clearly disclose synthetic audio where appropriate.
• Evaluate the model for accuracy, safety, and legal compliance before deployment.

https://huggingface.co/Audio8/Audio8-TTS-Preview-0.6b#license-and-acknowledgementsLicense and Acknowledgements

The code and model weights are released under theApache License 2.0. See the upstreamNOTICEfor attribution details.

We thank the Fish Audio team for publishing the DualAR architecture used in Fish Audio S2 Pro.