Fish Audio Drama 3 says it needs a 48 GB NVIDIA card. My 16 GB Radeon disagrees.

Reddit r/LocalLLaMA Tools

Summary

A developer built Red Curtain to run Fish Audio's Drama 3 text-to-speech model (35B MoE, ~3B active) on a 16 GB Radeon RX 9070 despite its official 48 GB NVIDIA requirement, offloading FP8 experts to system RAM and caching active ones on the GPU. The tool ships with a web UI supporting voice cloning and multi-speaker scripts, and the author shares tuning tips and a known first-line silence issue.

Drama 3 officially needs an NVIDIA GPU with 48 GB. I wanted it on my RX 9070, so I built Red Curtain together with Claude. How it works: it's a 35B MoE with ~3B active per token. The FP8 experts (~32 GB) stay in system RAM and only the ones that actually get used are cached on the GPU. Everything else runs in BF16 on the card. Numbers on my machine: - load ~17 s - 3.3 s of speech in ~13 s, 11.6 s in ~37 s - ~11–12 GB VRAM, ~35 GB RAM So it's slower than realtime, but fine for short takes. Comes with a small web UI: voice cloning from a reference clip, multi-speaker scripts, and the same tags as Fish's own editor ([laughing], [sighing], <whisper>…</whisper> etc.). Known issue: sometimes a take says the first line and then goes silent. That's a known Drama 3 thing (the vLLM recipe mentions it too), I checked it against Fish's reference code and it's not the AMD port. What helped a lot: top-k off instead of 30, giving each speaker a reference voice, and not starting a line with a sound tag. All of that is the default now. Only tested on the RX 9070 (gfx1201) so far, would be cool to hear if it works on other cards. Weights aren't included, you download them from Hugging Face. Not affiliated with Fish Audio. Built with Fish Audio. https://github.com/re133/red-curtain
Original Article

Similar Articles

Fish Audio Drama 3 Technical Report

Hugging Face Daily Papers

Fish Audio 发布开源语音生成模型 Fish Audio Drama 3 的技术报告:基于 35B 参数混合专家骨干(每 token 激活 3B),支持多参考语音克隆、自然语言导演指令、多轮修订、多人场景配音、编辑式填充、长音频与流式合成,单张 H200 推理速度达 271 帧/秒。

Fish Audio S2 Technical Report

Papers with Code Trending

Fish Audio S2 is an open-source text-to-speech system featuring multi-speaker capabilities, multi-turn generation, and instruction-following control, backed by a production-ready inference engine with low latency.