Compressed Whisper large-v3-turbo to 368 MB with Q3_K-matched QAT — multilingual WER results
Summary
Whisper large-v3-turbo has been compressed to 368 MB using Q3_K-matched quantization-aware training, with multilingual word error rate results reported.
Similar Articles
openai/whisper-large-v3
OpenAI released Whisper large-v3, an updated automatic speech recognition model with 128 Mel frequency bins and a new Cantonese token, trained on 5 million hours of data and achieving 10-20% error reduction over large-v2.
Post-Training Ternarization of Qwen3-4B Capability, Effective Bit Budget, Storage Compression, and Deployment
This research report evaluates post-training ternarization of the Qwen3-4B model, achieving a 1.641-bit effective weight representation with substantial storage compression, while noting a performance trade-off and unresolved deployment acceleration issues.
QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization
QTEA is a sub-2-bit post-training quantization framework for large language models that achieves ternary weight compression with improved accuracy and hardware efficiency through sparse residual salient weights and column-wise optimization.
Qwen 3.8 27b is strong even at Q3_xxs
The user finds Qwen 3.8 27b in Q3 quantization highly effective for coding tasks with fast inference speeds, outperforming previous models, despite minor issues in general conversations.
Qwen3.6-27B Quantization Benchmark
This article benchmarks various Qwen3.6-27B quantizations (Q8 to Q2) using KLD and Same Top P metrics, comparing providers like Unsloth and mradermacher, and offers recommendations for quality-size trade-offs.