GigaAM Multilingual: Foundation Model for Underrepresented Languages
Summary
This paper introduces GigaAM Multilingual, a Conformer encoder pre-trained on 2M hours of audio with a HuBERT-style objective, addressing data scarcity for Central Asian languages (Kazakh, Kyrgyz, Uzbek). It employs cluster-level data balancing and domain-aware sampling to outperform strong baselines like Whisper Large v3 on target languages.
View Cached Full Text
Cached at: 07/21/26, 10:36 AM
Paper page - GigaAM Multilingual: Foundation Model for Underrepresented Languages
Source: https://huggingface.co/papers/2607.10371
Abstract
Despiterecentscalingsuccesses,multilingualASRperformanceremainshighlyuneven,withlong-taillanguagessufferingfromseveredatascarcity.ThisworkaddressesthechallengeofbuildingrobustfoundationmodelsforunderrepresentedCentralAsianlanguages(Kazakh,Kyrgyz,Uzbek).WepresentGigaAMMultilingual,aConformerencoderpre-trainedon2MhoursofaudiousingaHuBERT-styleobjective.Crucially,weintroduceacluster-leveldatabalancingstrategyduringpre-trainingandadomain-awaresamplingmethodduringfine-tuningtomitigatehead-languagedominance.Incontrolledcomparisons,ourapproachoutperformsstrongopenpretrainedencoders(WhisperLargev3,Omnilingual-1B)ontargetlanguages,achievingsignificantgainsonspontaneousspeechwhilemaintainingefficiency.WereleasethefoundationencoderandASRmodel,offeringaprovenrecipeforeffectivemultilingualadaptationunderrealisticdataimbalance.
Similar Articles
The GaoYao Benchmark: A Comprehensive Framework for Evaluating Multilingual and Multicultural Abilities of Large Language Models
GaoYao introduces a 182k-sample benchmark across 26 languages and 51 regions to systematically evaluate LLMs’ multilingual and multicultural capabilities, revealing large geographical performance gaps.
GigaChat Audio: Time-aware Large Audio Language Model
This paper introduces GigaChat Audio, a time-aware large audio language model that answers questions with explicit timestamps for up to 120 minutes of audio, using interleaved periodic time markers and synthetic supervision. The model achieves strong temporal grounding accuracy on benchmarks and the authors release model weights and datasets.
X-AuT: Progressive Audio-Encoder Compression for Speech LLMs with Cross-Scale Distillation
X-AuT is a progressive framework for compressing audio-encoder layers in speech large language models, reducing inference cost while restoring accuracy via techniques like cross-scale distillation and LoRA adaptation.
Command A Plus GGUFs posted
Cohere has released GGUF quantized versions of its Command A+ model (25B active / 218B total parameters, Apache 2.0) for local inference, optimized for agentic and multilingual tasks.
Multilingual Emotion Neurons in Large Audio-Language Models
A first neuron-level interpretability study of how large audio-language models encode multilingual emotion, introducing Consistency-Regularized Fusion to identify Multilingual Emotion Neurons across 12 languages and showing cross-lingual transfer benefits.