BanglaKontho: 填补孟加拉语文本到语音中长篇韵律的空白
摘要
BanglaKontho 推出了一套20小时单说话人孟加拉语TTS语料库,源自专业有声读物,并配备开源文本归一化器和预处理管道,旨在解决低资源孟加拉语语音合成中长篇韵律的不足。
arXiv:2609.29146v1 Announce Type: new
Abstract: Bangla, the seventh most spoken language in the world, remains under-resourced for neural text-to-speech. Public Bangla speech corpora are dominated by short read-prompt utterances collected for speech recognition, leaving long-form prosody and consistent single-speaker narration uncovered. We present BanglaKontho, a single-speaker Bangla TTS corpus of 20 hours derived from professional audiobook recordings: 7,050 segmented utterances with verified transcripts at 24 kHz. We also release a reusable Bangla text normalizer covering Bangladeshi-style digit grouping, currency and date expressions, Danda punctuation and Unicode normalization, together with the full preprocessing pipeline. An MB-iSTFT-VITS baseline trained from scratch reaches 9.5% WER and 4.46 naturalness MOS, against 16.0% and 3.16 for the same architecture retrained on the 12-hour IndicTTS-Bn corpus. The corpus is released openly under CC BY-NC 4.0.
查看缓存全文
缓存时间: 2026/09/25 09:17
# BanglaKontho: Closing the Long-Form Gap in Bangla Text-to-Speech
Source: [https://arxiv.org/html/2609.29146](https://arxiv.org/html/2609.29146)
\[ Script=Bengali, Path=\./, Extension=\.ttf, Renderer=HarfBuzz \]\\usetikzlibrarypositioning,arrows\.meta Maruf
###### Abstract
Bangla, the seventh most spoken language in the world, remains under\-resourced for neural text\-to\-speech\. Public Bangla speech corpora are dominated by short read\-prompt utterances collected for speech recognition, leaving long\-form prosody and consistent single\-speaker narration uncovered\. We present BanglaKontho, a single\-speaker Bangla TTS corpus of 20 hours derived from professional audiobook recordings: 7,050 segmented utterances with verified transcripts at 24 kHz\. We also release a reusable Bangla text normalizer covering Bangladeshi\-style digit grouping, currency and date expressions, Danda punctuation and Unicode normalization, together with the full preprocessing pipeline\. An MB\-iSTFT\-VITS baseline trained from scratch reaches 9\.5% WER and 4\.46 naturalness MOS, against 16\.0% and 3\.16 for the same architecture retrained on the 12\-hour IndicTTS\-Bn corpus\. The corpus is released openly under CC BY\-NC 4\.0\.
###### keywords
speech synthesis, speech corpus, low\-resource languages, Bangla, text normalization
††address:1Vivasoft Limited, Dhaka, Bangladesh††email:mizbaul\.haque@vivasoftltd\.com## 1Introduction
Bangla \(Bengali\) is the seventh most spoken language in the world, with over 230 million speakers, yet text\-to\-speech \(TTS\) research for Bangla materially lags English and Mandarin\. The principal barrier is data: high\-quality TTS training corpora for Bangla are scarce, fragmented across multiple small releases, and dominated by short read\-prompt recordings originally collected for automatic speech recognition \(ASR\)\[[1](https://arxiv.org/html/2609.29146#bib.bib1),[2](https://arxiv.org/html/2609.29146#bib.bib2)\]\. Modern end\-to\-end neural TTS architectures such as VITS\[[3](https://arxiv.org/html/2609.29146#bib.bib3)\]and its lightweight variants\[[4](https://arxiv.org/html/2609.29146#bib.bib4)\]require tens of hours of clean speech aligned with verified text in order to produce natural, intelligible output\. Existing Bangla resources are insufficient for this regime, particularly when prosody, sentence\-level intonation, and long\-form rhythm are required for downstream applications such as audiobook synthesis, screen readers, and conversational agents\.
In this paper we describeBanglaKontho\\xspace, a single\-speaker Bangla audiobook corpus of 20 hours with verified transcripts, released openly under CC BY\-NC 4\.0\.111Dataset and normalizer:[https://github\.com/mizba\-grad/BanglaKontho](https://github.com/mizba-grad/BanglaKontho)The audiobook domain is deliberate: studio recordings by a single trained narrator over long\-form material yield acoustic and prosodic patterns that complement the read\-prompt corpora that dominate existing Bangla TTS releases\. Together with the audio\-text pairs, we release the full preprocessing pipeline and an open\-source Bangla text normalizer\.
Contributions\.
1. 1\.The first dedicated single\-speaker Bangla audiobook TTS corpus with verified transcripts: 20 hours / 7,050 utterances at\\SI24\\kilo\\hertz, openly released under CC BY\-NC 4\.0 \(Section[3](https://arxiv.org/html/2609.29146#S3)\)\.
2. 2\.An open\-source Bangla text normalizer with Bangladeshi\-style digit grouping, lakh / koti scale, decimal and date handling, and a strict Bangla\-Unicode\-block mode \(Section[3\.5](https://arxiv.org/html/2609.29146#S3.SS5)\)\.
3. 3\.A reproducible end\-to\-end preprocessing pipeline and an MB\-iSTFT\-VITS baseline with MCD, WER, and naturalness MOS, benchmarked against the same architecture retrained on IndicTTS\-Bn and against a normalizer\-disabled ablation \(Section[4](https://arxiv.org/html/2609.29146#S4)\)\.
## 2Related work
Bangla speech resources\.The most widely cited Bangla speech corpus is the crowd\-sourced read\-prompt collection of Kjartansson et al\.\[[1](https://arxiv.org/html/2609.29146#bib.bib1)\], hosted on OpenSLR, containing roughly 200 hours from over 500 speakers\. Its many\-speaker design makes it well\-suited for ASR but less so for single\-voice TTS, and utterance durations are typically short\. The IndicTTS project\[[5](https://arxiv.org/html/2609.29146#bib.bib5)\]released paired studio TTS recordings for major Indian languages including Bangla, with roughly 12 hours per voice; Kumar et al\.\[[6](https://arxiv.org/html/2609.29146#bib.bib6)\]later trained open FastPitch \+ HiFi\-GAN models on this database for 13 languages\. The Bangla release contains more than one voice; throughout this paper IndicTTS\-Bn refers to the single 12\-hour Bangla voice we use as a baseline, not to the full Bangla release\. The Bangla subset of Mozilla Common Voice\[[2](https://arxiv.org/html/2609.29146#bib.bib2)\]consists of validated short\-form crowd\-sourced utterances\. Shrutilipi\[[7](https://arxiv.org/html/2609.29146#bib.bib7)\]mines 6,400\+ hours of weakly aligned Indic speech \(including Bangla\) from broadcast audio, but transcript\-alignment quality is variable and the corpus targets ASR rather than TTS\. None of these resources simultaneously offers \(i\) a single trained speaker, \(ii\) long\-form audiobook prosody, \(iii\) studio\-clean audio, and \(iv\) verified transcripts\. Table[1](https://arxiv.org/html/2609.29146#S2.T1)summarizes the resource landscape\.
Bangla TTS\.Early work on Bangla TTS adopted statistical\-parametric methods\[[8](https://arxiv.org/html/2609.29146#bib.bib8)\]on small read\-prompt collections such as SHRUTI\[[9](https://arxiv.org/html/2609.29146#bib.bib9)\]\. More recent neural approaches have explored zero\-shot voice cloning\[[10](https://arxiv.org/html/2609.29146#bib.bib10)\], achieving high speaker similarity but relying on centralized fine\-tuning that aggregates raw speech on a server, with attendant privacy and licensing risks\. To our knowledge, no prior work has released a single\-speaker, long\-form Bangla audiobook corpus\. Outside Bangla, recent end\-to\-end systems including VITS2\[[11](https://arxiv.org/html/2609.29146#bib.bib11)\], Matcha\-TTS\[[12](https://arxiv.org/html/2609.29146#bib.bib12)\], and StyleTTS 2\[[13](https://arxiv.org/html/2609.29146#bib.bib13)\]have set new quality bars; we adopt a VITS\-based architecture for direct comparability with prior Bangla work, but the corpus is architecture\-agnostic\.
Text normalization for Indic scripts\.Bangla text normalization is non\-trivial because of \(i\) Bangladeshi\-style digit grouping and non\-compositional number words in the range 20–99, \(ii\) conjunct characters and decomposed vowel signs that are visually identical but Unicode\-distinct, and \(iii\) mixed Bangla / ASCII digits in modern web sources\. Gutkin et al\.\[[8](https://arxiv.org/html/2609.29146#bib.bib8)\]note the need for language\-specific normalization but do not release a reusable tool; we address this gap\.
Table 1:Bangla speech corpora most commonly used as TTS data sources\.BanglaKontho\\xspacefills the long\-form, single\-speaker audiobook slot\. The IndicTTS\-Bn row describes the single 12\-hour Bangla voice used as our baseline, not the full Bangla release\.\{tikzpicture\}
\[ node distance=0\.4cm and 0\.4cm, block/\.style=rectangle, draw, rounded corners, minimum width=2\.0cm, minimum height=0\.8cm, font=, align=center, fill=blue\!5, arrow/\.style=\-Stealth\[length=2\.5mm\], thick \]\\node\[block\] \(src\) Audiobook source;\\node\[block, right=of src\] \(prep\)\\SI16\\kilo\\hertz analysis copy;\\node\[block, right=of prep\] \(vad\) VAD \+ speaker verif\.;\\node\[block, right=of vad\] \(seg\) Sentence segmentation;\\node\[block, right=of seg\] \(asr\) Gemini ASR \+ human QA;\\node\[block, right=of asr\] \(norm\) Bangla normalizer;\\node\[block, right=of norm\] \(rel\)\\SI24\\kilo\\hertz release;
\\draw
\[arrow\] \(src\) – \(prep\);\\draw\[arrow\] \(prep\) – \(vad\);\\draw\[arrow\] \(vad\) – \(seg\);\\draw\[arrow\] \(seg\) – \(asr\);\\draw\[arrow\] \(asr\) – \(norm\);\\draw\[arrow\] \(norm\) – \(rel\);
Figure 1:End\-to\-endBanglaKontho\\xspaceconstruction pipeline\. A\\SI16\\kilo\\hertzanalysis copy of the source audiobook is filtered by voice activity detection and narrator verification and split at sentence boundaries; clips are transcribed by an ASR first pass followed by full human verification and normalized with the released Bangla text normalizer\. The released audio is cut from the native\-rate source at the resulting timings and resampled to\\SI24\\kilo\\hertz\.
## 3Dataset construction
Figure[1](https://arxiv.org/html/2609.29146#S2.F1)summarizes the end\-to\-end pipeline\. We describe each stage below\.
### 3\.1Audio acquisition and preprocessing
Source audio was acquired in its native delivery format\. The source is a mastered audiobook delivery and therefore carries post\-production processing such as dynamic\-range compression, which we do not attempt to invert\. The pipeline maintains two parallel representations of every recording\. An*analysis*copy at\\SI16\\kilo\\hertz, 16\-bit PCM, mono, with peak normalization, drives the segmentation and speaker\-verification stages, which operate at the\\SI16\\kilo\\hertzinput rate expected bypyannote\.audio; these stages yield only timing decisions\. The*release*audio is then cut from the native\-rate source at those timings and resampled to\\SI24\\kilo\\hertz, the sampling rate of the LibriTTS corpus\[[14](https://arxiv.org/html/2609.29146#bib.bib14)\]and of universal neural vocoders trained on it, such as BigVGAN\[[15](https://arxiv.org/html/2609.29146#bib.bib15)\]; released clips therefore retain the full bandwidth of the source delivery\. Music intros/outros and other non\-narrator material are removed automatically by the speaker\-verification stage of Section[3\.2](https://arxiv.org/html/2609.29146#S3.SS2); the author spot\-checked the retained and discarded regions by ear\.
### 3\.2Speaker verification
Because the corpus is single\-speaker by construction, the preprocessing challenge is not multi\-speaker diarization but reliable removal of non\-narrator audio \(music intros / outros, chapter\-announcement voices distinct from the narrator, occasional guest readings\)\. We usepyannote\.audio3\.1\[[16](https://arxiv.org/html/2609.29146#bib.bib16)\]for voice activity detection and segment\-level speaker embeddings \(ECAPA\-TDNN\[[17](https://arxiv.org/html/2609.29146#bib.bib17)\]\), then verify each speech segment against a manually enrolled narrator reference via cosine similarity\. Segments below a calibrated threshold are discarded\.
### 3\.3Segmentation
Segmentation is guided by VAD\-derived silence boundaries, using pause duration to favor cuts at likely sentence ends\. Clips shorter than\\SI1\.0\\secondor longer than\\SI20\\secondare dropped; the operating target range is 2–\\SI15\\second, the standard window for most TTS\.
### 3\.4Transcription and manual verification
A first\-pass transcript is produced by Google Gemini 2\.0 Flash\-Lite\[[18](https://arxiv.org/html/2609.29146#bib.bib18)\]for each clip, exploiting its broad Indic\-language coverage\. On a randomly sampled 500\-clip subset hand\-transcribed by the author, Gemini achieved 2\.7% WER against the gold reference, which we treat as a strong but imperfect starting point rather than ground truth\. Two volunteer native Bangla speakers then independently reviewed 100% of clips for word\-level lexical accuracy, phoneme\-relevant punctuation, and audio defects missed by the automated stage; word\-level inter\-annotator agreement was Cohen’sκ=0\.91\\kappa=0\.91on a 500\-clip overlap subset, and remaining disagreements were resolved by discussion\.
### 3\.5Bangla text normalization
We releasebangla\_normalize, a stand\-alone Python module used to clean every transcript in the corpus\. The pipeline is intended to be reusable across Bangla TTS / ASR projects and is byte\-equivalent to the cleaner shipped in the training filelists\.
1. 1\.Unicode NFC\.Decomposed vowel signs \(e\.g\.,\\banglafontে \+\\banglafontা→\\to\\banglafontো\) are composed so that each visible grapheme corresponds to a single codepoint\.
2. 2\.Symbol\-to\-word\.Currency symbols \(\\banglafont৳, £, €,\\banglafont₹\), percent, ampersand, and other ASCII symbols are rewritten to their Bangla word equivalents\.
3. 3\.Numeric expansionover both Bangla \(\\banglafont০–\\banglafont৯\) and ASCII\(0–9\)digits\. The normalizer hard\-codes the 80 unique Bangla compound words for 20–99, since Bangla number words in this range are not productively compositional \(26 is*chhabbish*, not*bish\-chhoy*\)\.
4. 4\.Bangladeshi digit groupingon the lakh / koti scale to arbitrary magnitude \(e\.g\.,\\banglafont১,২৩,৪৫,৬৭৮→\\to*ek koti teish lakh poyetallish hajar chhayshô attattôr*\)\.
5. 5\.Decimals and dates:\\banglafont১২\.৫→\\to*baro doshomik pānch*;\\banglafont২০২৪\-০৪\-২৩→\\to*dui hajar chobbish chār teish*\.
6. 6\.Danda/Daari punctuation: repeated Danda/Daari are collapsed \(\\banglafont।।।→\\to\\banglafont।\); double\-Danda/Daari is folded \(\\banglafont॥→\\to\\banglafont।\); spacing around the Danda/Daari is normalized\.
7. 7\.Strict mode \(optional\)restricts output to the Bangla Unicode blockU\+0980–U\+09EFplus a safe\-punctuation set, suitable for downstream G2P with a fixed symbol table\.
Example:\\banglafontআজ ১২\.৫ টাকা ও 50%\\banglafontছাড়→\\to\\banglafontআজ বারো দশমিক পাঁচ টাকা ও পঞ্চাশ শতাংশ ছাড়\.
### 3\.6Quality filtering and statistics
After transcription and normalization we drop clips with residual non\-speech tails, anomalous duration\-to\-text ratios, or verifier flags from Section[3\.4](https://arxiv.org/html/2609.29146#S3.SS4)\. Final statistics are reported in Table[2](https://arxiv.org/html/2609.29146#S3.T2)\.
Table 2:BanglaKontho\\xspacedataset statistics\. The chapter\-disjoint split \(no chapter contributes utterances to more than one of train / val / test\) prevents same\-chapter prosodic leakage between training and evaluation\.
## 4Baseline TTS and evaluation
To benchmark the corpus we train MB\-iSTFT\-VITS\[[4](https://arxiv.org/html/2609.29146#bib.bib4)\]from scratch\. MB\-iSTFT\-VITS replaces the HiFi\-GAN\-style decoder\[[19](https://arxiv.org/html/2609.29146#bib.bib19)\]of standard VITS\[[3](https://arxiv.org/html/2609.29146#bib.bib3)\]with a multi\-band iSTFT head and PQMF subband synthesis, yielding a lightweight, real\-time\-friendly model directly comparable to prior single\-speaker VITS work\. Training and evaluation audio is prepared at\\SI22050\\hertz, the canonical reference configuration of MB\-iSTFT\-VITS, from the\\SI16\\kilo\\hertzanalysis copy of Section[3](https://arxiv.org/html/2609.29146#S3)rather than from the\\SI24\\kilo\\hertzrelease; the baseline is therefore trained on band\-limited audio and, if anything, understates what the released clips support\. All evaluation is reported at\\SI22050\\hertz\. The architecture combines a Transformer text encoder, a posterior encoder, a stochastic duration predictor, a normalizing\-flow prior, and a multi\-band iSTFT decoder, with 34\.7 M parameters at our configuration \(hidden / inter 192, filter 768, two attention heads, six layers; ResBlock\-1 kernels\[3,7,11\]\[3,7,11\]; upsample rates\[4,4\]\[4,4\]; initial channel 512; four PQMF subbands\)\. Training uses batch size 128 with AdamW \(β1=0\.8,β2=0\.99\\beta\_\{1\}\{=\}0\.8,\\beta\_\{2\}\{=\}0\.99\), learning rate2×10−42\{\\times\}10^\{\-4\}with decay0\.9998750\.999875, segment size 8192 samples, and FP16 mixed precision\. All training and preprocessing was conducted on a single NVIDIA H100 SXM5\\SI80\\giga\\byteGPU\.
### 4\.1Evaluation protocol
We hold out 472 utterances as a test split, drawn from chapters disjoint from those used for training or validation to avoid intra\-chapter prosodic leakage that would inflate evaluation scores under a naive utterance\-level random split\. We report: \(i\)MCD\[[20](https://arxiv.org/html/2609.29146#bib.bib20)\], DTW\-aligned 13\-dim MFCC distance; \(ii\)WERcomputed by transcribing the synthesized audio with IndicWav2Vec\[[21](https://arxiv.org/html/2609.29146#bib.bib21)\], a Bangla\-capable ASR \(generic multilingual models such as Whisper\-base\[[22](https://arxiv.org/html/2609.29146#bib.bib22)\]produce uninformative scores on Bangla synthesis\); and \(iii\)naturalness MOSon a 5\-point scale, with 15 volunteer native Bangla raters scoring 50 utterances per system \(balanced for length\) following the ITU\-T P\.800 protocol\[[23](https://arxiv.org/html/2609.29146#bib.bib23)\], reported as mean±\\pm95% confidence interval\. All MOS sessions used headphones in a quiet environment, with system identity hidden and clip order randomized per rater; Krippendorff’sα=0\.74\\alpha=0\.74across raters\. As an ASR\-floor calibration, IndicWav2Vec on the*natural*test\-split audio \(i\.e\., human ground truth\) yields 8% WER, so our reported synthesis WERs should be read relative to this floor rather than to 0%\. We further include aground\-truth MOSceiling obtained by submitting the natural test\-split audio to the same rating protocol\. We compare our model against an MB\-iSTFT\-VITS baseline that we retrained from scratch on the single\-speaker IndicTTS\-Bn dataset\[[5](https://arxiv.org/html/2609.29146#bib.bib5)\]\(12 hours\) using the same configuration as our model; we do not use any released checkpoint\.
### 4\.2Baseline results
Table[3](https://arxiv.org/html/2609.29146#S4.T3)compares our MB\-iSTFT\-VITS model trained onBanglaKontho\\xspaceagainst the same architecture retrained on IndicTTS\-Bn and against the natural\-speech ceiling\. Our model achieves substantially lower WER \(9\.5% vs\. 16\.0%\) and higher naturalness MOS \(4\.46 vs\. 3\.16\), with comparable MCD \(5\.85 vs\. 5\.97\), and approaches the natural\-speech ceiling of 4\.90 MOS / 8% ASR\-floor WER\. Because the data\-size gap betweenBanglaKontho\\xspaceand IndicTTS\-Bn is modest \(\\SI20\\hourvs\.\\SI12\\hour, a factor of 1\.67\), the large WER and MOS gaps cannot be explained by scale alone; they are consistent with the domain difference \(consistent long\-form audiobook narration vs\. short read\-prompt recordings\) being the principal driver\.
Table 3:Comparison of our VITS\-based model trained onBanglaKontho\\xspaceagainst the same architecture trained on IndicTTS\-Bn \(\\SI12\\hour\) and against natural speech\. MCD is in dB and WER in %, both lower\-is\-better; WER is computed with IndicWav2Vec on the synthesized audio\. Naturalness MOS is averaged over 15 native Bangla raters following the ITU\-T P\.800 protocol\[[23](https://arxiv.org/html/2609.29146#bib.bib23)\]and reported with a 95% confidence interval\.
### 4\.3Normalizer ablation
To isolate the contribution ofbangla\_normalize, we retrained the same MB\-iSTFT\-VITS architecture onBanglaKontho\\xspacewith the normalizer disabled \(raw verified transcripts only\)\. The ablated model degrades to WER 14\.0% and naturalness MOS 3\.80 \(Table[3](https://arxiv.org/html/2609.29146#S4.T3)\); MCD is comparable \(5\.81\)\. The gap is concentrated on utterances containing numerals, dates, currency symbols, or mixed Bangla/ASCII digits \(18% of the test set\), where the ablated model frequently mispronounces symbol\-bearing tokens; on the symbol\-free remainder, the gap narrows substantially\. This pattern confirms that Bangla\-specific text normalization contributes a localized but consistent intelligibility gain, a contribution distinct from corpus scale\.
## 5Limitations and ethical considerations
Scope\.The corpus is single\-speaker by construction; multi\-speaker extension is left to future work\. The audiobook domain shapes prosody toward narrative reading style, which differs from conversational TTS; for conversational use we recommend combiningBanglaKontho\\xspacewith a small in\-domain adaptation set\.
License and release\.The full 20\-hourBanglaKontho\\xspacecorpus is openly released under CC BY\-NC 4\.0\. The license does not rest on the recordings’ public availability online: the rights holder of the source recordings has authorized their redistribution under this license, and the narrator has consented to the release\. The corpus consists of isolated sentence\-level clips drawn from multiple books and distributed in shuffled order, so it does not reproduce any book as continuous text\. The accompanying preprocessing pipeline, including thebangla\_normalizelibrary, is released under a permissive open\-source license\.
Data provenance and ethical use\.The corpus is redistributed strictly for non\-commercial academic research; commercial use, voice cloning for impersonation, fraud, and the synthesis of political content are explicitly prohibited by the accompanying data\-use agreement that all downloaders must accept\. We operate a standing takedown process: any request from a rights holder of the source books will be honored and the corresponding clips removed from the release\. For additional provenance protection we recommend that downstream systems trained onBanglaKontho\\xspaceapply inaudible neural watermarking to synthesized audio\.
Speaker anonymity\.We omit the narrator’s identity from the released metadata, but acknowledge that voice\-based identification remains possible for anyone in possession of the audio; we make no cryptographic anonymity claim about the speech signal itself\.
ASR\-based intelligibility\.WER depends on the Bangla ASR’s own accuracy, which is improving rapidly but not error\-free\. We accordingly report the ASR floor measured on natural speech \(8% WER, Table[3](https://arxiv.org/html/2609.29146#S4.T3)\) and read all synthesis WERs relative to that floor rather than to 0%\.
## 6Conclusion
We releaseBanglaKontho\\xspace, a 20\-hour single\-speaker Bangla audiobook corpus built from professional recordings, together with a reusable Bangla text normalizer and an MB\-iSTFT\-VITS baseline\. The resource addresses a documented gap in long\-form Bangla speech data and provides ready\-to\-use tooling for the broader Indic\-TTS community\. Future work will \(i\) extend to multiple narrators, \(ii\) develop a Bangla\-specific CMOS / preference\-test benchmark, and \(iii\) evaluate downstream applications such as screen readers and audiobook synthesis\.
## 7Generative AI Use Disclosure
Generative AI was used in two clearly delimited roles, both under full author responsibility\. First, as part of the described method, Google Gemini 2\.0 Flash\-Lite\[[18](https://arxiv.org/html/2609.29146#bib.bib18)\]produced the first\-pass transcript of every clip \(Section[3\.4](https://arxiv.org/html/2609.29146#S3.SS4)\); no machine\-generated transcript entered the release without independent verification by two native Bangla speakers, and the measured quality of that first pass \(2\.7% WER on a hand\-transcribed subset\) is reported in the paper\. Second, generative AI assistants were used for language editing and formatting of the manuscript\. No part of the scientific content, experimental design, analysis, or conclusions was produced by a generative AI tool, and the author takes full responsibility for the content of this paper\.
## References
- \[1\]O\. Kjartansson, S\. Sarin, K\. Pipatsrisawat, M\. Jansche, and L\. Ha, “Crowd\-sourced speech corpora for Javanese, Sundanese, Sinhala, Nepali, and Bangladeshi Bengali,” in*Proceedings of the 6th International Workshop on Spoken Language Technologies for Under\-Resourced Languages \(SLTU\)*, 2018, pp\. 52–55\.
- \[2\]R\. Ardila, M\. Branson, K\. Davis, M\. Kohler, J\. Meyer, M\. Henretty, R\. Morais, L\. Saunders, F\. Tyers, and G\. Weber, “Common Voice: A massively\-multilingual speech corpus,” in*Proceedings of the 12th Language Resources and Evaluation Conference \(LREC\)*, 2020, pp\. 4218–4222\. \[Online\]\. Available:[https://aclanthology\.org/2020\.lrec\-1\.520/](https://aclanthology.org/2020.lrec-1.520/)
- \[3\]J\. Kim, J\. Kong, and J\. Son, “Conditional variational autoencoder with adversarial learning for end\-to\-end text\-to\-speech,” in*Proceedings of the 38th International Conference on Machine Learning \(ICML\)*, 2021, pp\. 5530–5540\. \[Online\]\. Available:[https://proceedings\.mlr\.press/v139/kim21f\.html](https://proceedings.mlr.press/v139/kim21f.html)
- \[4\]M\. Kawamura, Y\. Shirahata, R\. Yamamoto, and K\. Tachibana, “Lightweight and high\-fidelity end\-to\-end text\-to\-speech with multi\-band generation and inverse short\-time Fourier transform,” in*Proceedings of ICASSP*\. IEEE, 2023, pp\. 1–5\.
- \[5\]A\. Baby, A\. L\. Thomas, N\. L\. Nishanthi, and TTS Consortium, “Resources for Indian languages,” in*Proceedings of the Workshop on Community\-Based Building of Language Resources \(CBBLR\)*\. Brno, Czech Republic: Tribun EU, 2016, pp\. 37–43\.
- \[6\]G\. K\. Kumar, P\. S\. V\., P\. Kumar, M\. M\. Khapra, and K\. Nandakumar, “Towards building text\-to\-speech systems for the next billion users,” in*Proceedings of ICASSP*\. IEEE, 2023, pp\. 1–5\.
- \[7\]K\. S\. Bhogale, A\. Raman, T\. Javed, S\. Doddapaneni, A\. Kunchukuttan, P\. Kumar, and M\. M\. Khapra, “Effectiveness of mining audio and text pairs from public data for improving ASR systems for low\-resource languages,” in*Proceedings of ICASSP*\. IEEE, 2023, pp\. 1–5\.
- \[8\]A\. Gutkin, L\. Ha, M\. Jansche, K\. Pipatsrisawat, and R\. Sproat, “TTS for low resource languages: A Bangla synthesizer,” in*Proceedings of the Tenth International Conference on Language Resources and Evaluation \(LREC’16\)*, 2016, pp\. 2005–2010\. \[Online\]\. Available:[https://aclanthology\.org/L16\-1317/](https://aclanthology.org/L16-1317/)
- \[9\]B\. Das, S\. Mandal, and P\. Mitra, “Bengali speech corpus for continuous automatic speech recognition system,” in*2011 International Conference on Speech Database and Assessments \(Oriental COCOSDA\)*\. IEEE, 2011, pp\. 51–55\.
- \[10\]A\. Ahmed, P\. Roy, D\. C\. Paul, and M\. S\. Rahman, “Efficient zero\-shot voice cloning for Bengali speech synthesis,” in*Proceedings of the 27th International Conference on Computer and Information Technology \(ICCIT\)*\. IEEE, 2024, pp\. 1470–1474\.
- \[11\]J\. Kong, J\. Park, B\. Kim, J\. Kim, D\. Kong, and S\. Kim, “VITS2: Improving quality and efficiency of single\-stage text\-to\-speech with adversarial learning and architecture design,” in*Proceedings of Interspeech*, 2023, pp\. 4374–4378\.
- \[12\]S\. Mehta, R\. Tu, J\. Beskow, É\. Székely, and G\. E\. Henter, “Matcha\-TTS: A fast TTS architecture with conditional flow matching,” in*Proceedings of ICASSP*\. IEEE, 2024, pp\. 11 341–11 345\.
- \[13\]Y\. A\. Li, C\. Han, V\. S\. Raghavan, G\. Mischler, and N\. Mesgarani, “StyleTTS 2: Towards human\-level text\-to\-speech through style diffusion and adversarial training with large speech language models,” in*Advances in Neural Information Processing Systems \(NeurIPS\)*, vol\. 36, 2023\. \[Online\]\. Available:[https://proceedings\.neurips\.cc/paper\_files/paper/2023/hash/3eaad2a0b62b5ed7a2e66c2188bb1449\-Abstract\-Conference\.html](https://proceedings.neurips.cc/paper_files/paper/2023/hash/3eaad2a0b62b5ed7a2e66c2188bb1449-Abstract-Conference.html)
- \[14\]H\. Zen, V\. Dang, R\. Clark, Y\. Zhang, R\. J\. Weiss, Y\. Jia, Z\. Chen, and Y\. Wu, “LibriTTS: A corpus derived from LibriSpeech for text\-to\-speech,” in*Proceedings of Interspeech*, 2019, pp\. 1526–1530\.
- \[15\]S\.\-g\. Lee, W\. Ping, B\. Ginsburg, B\. Catanzaro, and S\. Yoon, “BigVGAN: A universal neural vocoder with large\-scale training,” in*Proceedings of the 11th International Conference on Learning Representations \(ICLR\)*, 2023\. \[Online\]\. Available:[https://openreview\.net/forum?id=iTtGCMDEzS\_](https://openreview.net/forum?id=iTtGCMDEzS_)
- \[16\]A\. Plaquet and H\. Bredin, “Powerset multi\-class cross entropy loss for neural speaker diarization,” in*Proceedings of Interspeech*, 2023, pp\. 3222–3226\.
- \[17\]B\. Desplanques, J\. Thienpondt, and K\. Demuynck, “ECAPA\-TDNN: Emphasized channel attention, propagation and aggregation in TDNN based speaker verification,” in*Proceedings of Interspeech*, 2020, pp\. 3830–3834\.
- \[18\]Gemini Team, Google, “Gemini 2\.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities,”*arXiv preprint arXiv:2507\.06261*, 2025\. \[Online\]\. Available:[https://arxiv\.org/abs/2507\.06261](https://arxiv.org/abs/2507.06261)
- \[19\]J\. Kong, J\. Kim, and J\. Bae, “HiFi\-GAN: Generative adversarial networks for efficient and high fidelity speech synthesis,” in*Advances in Neural Information Processing Systems \(NeurIPS\)*, vol\. 33, 2020, pp\. 17 022–17 033\.
- \[20\]R\. Kubichek, “Mel\-cepstral distance measure for objective speech quality assessment,” in*Proceedings of the IEEE Pacific Rim Conference on Communications, Computers and Signal Processing*, vol\. 1, 1993, pp\. 125–128\.
- \[21\]T\. Javed, S\. Doddapaneni, A\. Raman, K\. S\. Bhogale, G\. Ramesh, A\. Kunchukuttan, P\. Kumar, and M\. M\. Khapra, “Towards building ASR systems for the next billion users,” in*Proceedings of the AAAI Conference on Artificial Intelligence*, vol\. 36, no\. 10, 2022, pp\. 10 813–10 821\.
- \[22\]A\. Radford, J\. W\. Kim, T\. Xu, G\. Brockman, C\. McLeavey, and I\. Sutskever, “Robust speech recognition via large\-scale weak supervision,” in*Proceedings of the 40th International Conference on Machine Learning \(ICML\)*, 2023, pp\. 28 492–28 518\. \[Online\]\. Available:[https://proceedings\.mlr\.press/v202/radford23a\.html](https://proceedings.mlr.press/v202/radford23a.html)
- \[23\]ITU\-T, “Methods for subjective determination of transmission quality,” International Telecommunication Union, Tech\. Rep\. Recommendation P\.800, 1996\.相似文章
BanglaTurn: 一个用于 Bangla 语音回合结束检测的基准与 Whisper 基础模型
论文介绍了 BanglaTurn,这是一个用于 Bangla 语音回合结束检测的基准语料库和基于 Whisper 的模型,实现了 84.33% 的准确率,而基线为 69.28%。
构建和评估用于电信客户服务的合成孟加拉语音资源
本文介绍了一个用于电信客户服务场景的合成孟加拉语音数据集,包含10,000个音频-文本对,使用OmniVoice语音克隆技术生成,并通过ASR模型评估,实现了较低的单词错误率。
Lipi-Ghor:一个大规模、带说话人分离标注的多领域孟加拉语语音语料库及其可扩展构建流程
Lipi-Ghor 推出了一个时长 885 小时、标注了说话人、涵盖多个领域的孟加拉语语音语料库。该语料库通过可复现的流程从 YouTube 视频中构建,并提供了四种自动语音识别(ASR)模型的基准测试结果,以及一个经人工核验、依据 CC-BY-4.0 许可发布的黄金评估子集。
BanglaRhet:面向孟加拉语政治演讲中修辞与说服技巧检测的经典模型与 Transformer 模型基准评测
该论文提出了 BanglaRhet,一个包含 30,289 个片段标注的孟加拉语政治演讲语料库,并对经典模型与 Transformer 模型(BanglaBERT、SahajBERT、XLM-RoBERTa)在修辞与说服技巧检测任务上进行了基准评测,其中 BanglaBERT 取得了最佳的宏平均 F1 值 66.46%。
孟加拉地区方言的多方言神经机器翻译系统
本文提出了一个统一的用于12种孟加拉地区方言的多方言神经机器翻译系统,引入了迄今最大的多方言平行语料库,并通过使用DoRA微调的BanglaT5模型取得了最先进的BLEU分数。