GigaAM Multilingual: Foundation Model for Underrepresented Languages
Summary
This paper introduces GigaAM Multilingual, a Conformer encoder pre-trained on 2M hours of audio with a HuBERT-style objective, addressing data scarcity for Central Asian languages (Kazakh, Kyrgyz, Uzbek). It employs cluster-level data balancing and domain-aware sampling to outperform strong baselines like Whisper Large v3 on target languages.
View Cached Full Text
Cached at: 07/21/26, 10:36 AM
Paper page - GigaAM Multilingual: Foundation Model for Underrepresented Languages
Source: https://huggingface.co/papers/2607.10371
Abstract
Despiterecentscalingsuccesses,multilingualASRperformanceremainshighlyuneven,withlong-taillanguagessufferingfromseveredatascarcity.ThisworkaddressesthechallengeofbuildingrobustfoundationmodelsforunderrepresentedCentralAsianlanguages(Kazakh,Kyrgyz,Uzbek).WepresentGigaAMMultilingual,aConformerencoderpre-trainedon2MhoursofaudiousingaHuBERT-styleobjective.Crucially,weintroduceacluster-leveldatabalancingstrategyduringpre-trainingandadomain-awaresamplingmethodduringfine-tuningtomitigatehead-languagedominance.Incontrolledcomparisons,ourapproachoutperformsstrongopenpretrainedencoders(WhisperLargev3,Omnilingual-1B)ontargetlanguages,achievingsignificantgainsonspontaneousspeechwhilemaintainingefficiency.WereleasethefoundationencoderandASRmodel,offeringaprovenrecipeforeffectivemultilingualadaptationunderrealisticdataimbalance.
Similar Articles
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models
GaoYao introduces a 182k-sample benchmark across 26 languages and 51 regions to systematically evaluate LLMs’ multilingual and multicultural capabilities, revealing large geographical performance gaps.
GigaChat Audio: Time-aware Large Audio Language Model
This paper introduces GigaChat Audio, a time-aware large audio language model that answers questions with explicit timestamps for up to 120 minutes of audio, using interleaved periodic time markers and synthetic supervision. The model achieves strong temporal grounding accuracy on benchmarks and the authors release model weights and datasets.
Command A Plus GGUFs posted
Cohere has released GGUF quantized versions of its Command A+ model (25B active / 218B total parameters, Apache 2.0) for local inference, optimized for agentic and multilingual tasks.
Adding E4B audio encoder to larger models
The author proposes a method to add the E4B audio encoder to larger models by extracting the encoder, creating a linear projection layer, and fine-tuning only that layer with text-audio pairs, similar to a referenced paper but using Gemma instead of Whisper.
Can Large Language Models Imitate Human Speech for Clinical Assessment? LLM-Driven Data Augmentation for Cognitive Score Prediction
This paper proposes a large language model-driven data augmentation framework using GPT-5 to generate synthetic oral monologues from written anchors for cognitive score prediction from speech. A similarity-guided selection strategy consistently reduces prediction error, particularly for minority low-score participants.