DEFINE: Exemplar-Guided Accent Control for Zero-Shot TTS
Summary
DEFINE is an end-to-end zero-shot TTS framework that decouples speaker identity from accent by conditioning each on separate audio exemplars, with an inference-time guidance weight controlling accent strength on top of F5-TTS using LoRA adaptation.
View Cached Full Text
Cached at: 10/05/26, 04:46 AM
Paper page - DEFINE: Exemplar-Guided Accent Control for Zero-Shot TTS
Source: https://huggingface.co/papers/2609.32777
Abstract
Zero-shottext-to-speech(TTS)canreproduceanunseenspeakerfromashortreferencerecording,buttypicallyentanglesspeakeridentityandaccentwithinthesamereference.WeintroduceDEFINE,anend-to-endframeworkthatdecouplesthesefactorsbyconditioningspeakeridentityandtargetaccentonseparateaudioexemplars.Asingleinference-timeguidanceweightcontinuouslycontrolsaccentstrengthwithoutretraining.BuiltonF5-TTSwithparameter-efficientLoRAadaptation,DEFINEmapsshortaccentexemplarsintoaconditioningspaceusinganexemplarencodersupervisedthroughlearnedaccentprototypes,requiringneitheraccentlabelsatinferencetimenorpost-synthesiswaveformconversion.Onseenaccents,increasingaccentguidanceimprovesaccent-probeaccuracyfrom6.5%to19.6%.Moreimportantly,asingleDEFINEmodelgeneralizesaccentcontrolbeyonditstrainingaccentset:onseenandout-of-domainaccents,thoughnotonheld-outaccents,itmatchestheaccenttransferperformanceofatwo-modelTTS-voice-conversioncascadewhileachievinghigherspeakersimilarityandcomparablepredictedspeechquality.Theseresultsdemonstratethatspeakeridentityandaccentcanbeindependentlycontrolledfromaudioexemplarswithinasinglezero-shotTTSmodel,includingforaccentsunseenduringtraining.
View arXiv pageView PDFProject pageGitHub2Add to collection
Get this paper in your agent:
hf papers read 2609\.32777
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2609.32777 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2609.32777 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2609.32777 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Edge0/Audio8-TTS-Realistic-Air
Edge0/Audio8-TTS-Realistic-Air is an Apache-2.0 text-to-speech model finetuned from Edge0/Audio8-TTS-Preview-0.6b, supporting zero-shot voice cloning and multilingual synthesis across 25+ languages (zh, en, ja, ko, de, fr, es, and more).
GRAFT: Grafted Reference Audio for Fine-grained Pronunciation in Zero-shot Text-to-Speech
GRAFT is a per-word pronunciation conditioning mechanism for zero-shot text-to-speech that uses a spoken sample of a target word to control its pronunciation, achieving significant improvements in target-word phoneme error rates across multiple languages while preserving speaker similarity.
IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
IndexTTS is an enhanced text-to-speech system that combines XTTS and Tortoise models with hybrid character-pinyin modeling and optimized vector quantization, achieving improved naturalness, controllable pronunciation, and faster inference than existing open-source TTS systems.
Scenema Audio: Zero-shot expressive voice cloning and speech generation [N]
Scenema AI releases Scenema Audio, an open-source diffusion-based model for zero-shot expressive voice cloning and speech generation, separating emotional performance from voice identity to allow any voice to perform any emotion.
Mixture of Phonetic Experts Based Low-Rank Adaptation of Conformer Models for Accented English Speech Recognition
该论文提出 MoPE-LoRA,一种基于音素类别(发音方式)而非口音身份组织低秩专家的参数高效适配框架,用于带口音的英语语音识别;在 L2-ARCTIC 上零样本口音评估中相对单 LoRA 提升 12.3%。