@Tao_Builds: Today, I kept tinkering and managed to integrate Fish Audio into Muse as well. This time, it's pretty interesting: • Su…
Summary
The author shares the complete process of integrating the Fish Audio speech service into Muse, with support for Chinese dubbing, multiple voice timbre options, voice cloning, and the ability to call the free s2.1-pro-free model.
View Cached Full Text
Cached at: 10/09/26, 04:32 PM
Today, I kept tinkering and managed to integrate Fish Audio into Muse as well. This time, it’s pretty interesting:
• Supports Chinese dubbing • Allows selection of different voice timbres • Supports voice cloning • Can also invoke the free s2.1-pro-free model
From
Integrating Fish Audio with Muse: From Sign-Up to First Words, Full Walkthrough
In short: Azure is stable but with limited voice variety; Fish Audio lets you clone voices and play with distinctive timbres. Six steps to get connected, about 5 minutes total.
You can simply tell Muse in the chat that you want to integrate Fish Audio, and follow Muse’s step-by-step guidance.
Here’s the detailed tutorial:
Step 1: Create a Fish Audio Account
Head to fish.audio and sign up — an email address is all you need.
Step 2: Switch to Developer Mode
After logging in, click the menu in the top-left corner and switch the mode from Creative to Developer:
Only in Developer mode will you see the API Billing, My Voices, and Developer Docs entries — your API Key is hiding in there.
Step 3: Confirm Your Free Credits
Go to Team Settings and take a look:
- Current Plan: Free Plan — no payment required
- Credits Remaining: 8,000 / 8,000 — refreshed monthly (Next Refresh), more than enough for tinkering
Step 4: Create an API Key
Go to the API Keys page and click Create API Key:
- Key name: fill in
Muse(easier to recognize later) - Expiration: select Never (avoids having to redo this when it expires)
Click Create. Two things to note:
- The key is only shown in full once — copy and save it immediately when the popup appears; if you lose it, the only option is to delete and recreate
- There’s a notice at the top of the page: the S1 model retires on December 31, 2026, and traffic will automatically route to S2.1 Pro — our script already defaults to
s2.1-pro-free, so no action needed
Step 5: Enter Your Key in Muse
Head back to the Muse chat, say you want to integrate Fish Audio, find the Fish Audio connector card Muse sent, click “Link,” paste your key in, and submit.
Step 6: Write the Invocation Script + Live Test (Done)
Asked Muse to test the voice — audio comes through fine. Pipeline is working.
How to Use It After Connecting
- Keep using Azure for Muse’s everyday voice (stable and free)
- Want a distinctive timbre? Just tell Muse the style you want, and Muse will generate it with Fish Audio
- Want to clone your own voice: go to the official site’s My Voices, upload a 10-second recording, send the voice model’s ID to Muse, and your cloned voice will be used for dubbing from then on
Caveats
- Free credits refresh monthly — don’t burn through them all in one go
- Never clone a real person’s voice (streamers, celebrities, etc.) and publish it publicly — this is a hard line
- If your key leaks, just go to the API Keys page, delete it, and create a new one
Similar Articles
Fish Audio Drama 3
Fish Audio 推出其最新 AI 语音模型 Drama 3,支持通过自然语言控制情感、节奏、耳语、笑声和停顿,可生成多角色场景、有声书与游戏对话,覆盖 83 种语言,并以社区许可证开放权重供自托管。
Fish Audio Drama 3 Technical Report
Fish Audio 发布开源语音生成模型 Fish Audio Drama 3 的技术报告:基于 35B 参数混合专家骨干(每 token 激活 3B),支持多参考语音克隆、自然语言导演指令、多轮修订、多人场景配音、编辑式填充、长音频与流式合成,单张 H200 推理速度达 271 帧/秒。
Fish Audio launches S2.1 Pro with support for 83 languages (2 minute read)
Fish Audio launches S2.1 Pro, a production voice model with 90ms latency, support for 83 languages, voice cloning from short samples, and multi-speaker dialogue, available via API with a free tier for development.
@svpino: This is the first audio model I've seen that lets you edit individual words. Text-to-Speech models have gotten really g…
Fish Audio 推出了 Drama 3 语音模型,支持音频修复(audio inpainting),可以只重新生成音频中的单个词或短语,其余部分保持不变,并支持 83+ 种语言。
fishaudio/drama-3
Fish Audio 发布新一代文本转语音模型 Drama 3,采用 35B 参数 MoE 架构(每 token 激活 3B),支持最多 16 个说话人的多角色长文本生成、语音克隆与自然语言控制,并可在 SGLang-Omni 上流式部署。