@DanKornas: Writing a two-person audio demo shouldn’t mean stitching together separate speech clips. Dia is a 1.6B-parameter text-t…
Summary
Dia is a 1.6B-parameter open-source text-to-speech model that generates English dialogue from transcripts, supporting two-speaker generation, audio conditioning, and nonverbal cues.
View Cached Full Text
Cached at: 07/22/26, 04:34 PM
Writing a two-person audio demo shouldn’t mean stitching together separate speech clips.
Dia is a 1.6B-parameter text-to-speech model for researchers and builders generating English dialogue from transcripts.
It helps you create scripted conversations by alternating [S1] and [S2] tags, with optional audio prompts for voice, emotion, and tone conditioning.
Key features: • Two-speaker generation – turns tagged transcripts into a dialogue track • Audio conditioning – accepts a 5–10-second prompt plus its transcript • Nonverbal cues – supports cues such as laughs, coughs, sighs, and applause • Flexible interfaces – examples cover Transformers, CLI, and a Gradio UI • Public artifacts – includes inference code and links to pretrained checkpoints
The repo is open-source (Apache 2.0 license). The README says the model currently supports English and has only been tested on GPUs; it also prohibits identity misuse, deceptive content, and illegal or malicious use.
Link in the reply
GitHub: https://github.com/nari-labs/dia
If you’re into AI, ML, agents, and building real systems, join my newsletter (it’s free): http://dankornas.substack.com
Similar Articles
@DanKornas: Building a live voice agent requires coordinating audio streaming, turn detection, interruptions, model calls, and medi…
VideoSDK AI Agents is an open-source Python framework for building production-ready real-time voice and multimodal AI agents that join VideoSDK rooms as participants, with unified pipeline configuration and multiple execution modes.
@DanKornas: myshell-ai/OpenVoice instant voice cloning with style and language control GitHub: Archive:
OpenVoice is an open-source instant voice cloning model with style and language control, now available on GitHub.
DuplexDrama: A Synthesized Dialogue Dataset with Scenarios, Full-Duplex Behaviors, Expressive Speech, and Sound Events
DuplexDrama is the first synthesized spoken dialogue dataset that covers personas, scenarios, full-duplex behaviors, expressive speech, and sound events, designed to advance full-duplex dialogue model research with over 2,000 hours of audio data.
@DanKornas: Building a person-specific talking head shouldn’t require piecing together preprocessing, training, and inference from …
Ultralight Digital Human is an open-source Python project that lets you train a person-specific, audio-driven talking head from a 3–5 minute video, with support for HuBERT/WeNet audio features, ONNX export, and streaming inference.
@rohanpaul_ai: VoiceArena launched Diarization Bench to compare 12 diarization systems on the same real-world audio and scoring rules.…
VoiceArena launched Diarization Bench, a benchmark comparing 12 diarization systems on real-world audio, highlighting how accuracy drops with overlap and the impact of collar effect on error rates.