tencent/Hy3

Simon Willison's Blog Models
tencent hy3 mixture-of-experts moe open-source apache-2.0 large-language-model

Summary

Tencent released Hy3, a 295B-parameter Mixture-of-Experts model with 21B active parameters, under Apache 2.0 license, outperforming similar-size models and rivaling larger open-source models with 2-5x parameters.

No content available
Original Article
View Cached Full Text

Cached at: 07/07/26, 02:38 AM

# tencent/Hy3 Source: [https://simonwillison.net/2026/Jul/6/hy3/](https://simonwillison.net/2026/Jul/6/hy3/) 6th July 2026 \- Link Blog **[tencent/Hy3](https://huggingface.co/tencent/Hy3)**\. New Apache 2\.0 licensed model from Tencent in China: > Hy3 is a 295B\-parameter Mixture\-of\-Experts \(MoE\) model with 21B active parameters and 3\.8B MTP layer parameters, developed by the Tencent Hy Team\. Following the Hy3 Preview launch in late April, we gathered feedback from 50\+ products and scaled up post\-training with higher quality data\. Today, we introduce Hy3, which outperforms similar\-size models and rivals flagship open\-source models with 2\-5x parameters\. It also shows significant gains in utility across various products and productivity tasks\. The full\-sized model is 598GB on Hugging Face, and the FP8 quantized one[is 300GB](https://huggingface.co/tencent/Hy3-FP8/tree/main)\. The context length is 256K\. It's available for free[on OpenRouter until July 21st](https://openrouter.ai/tencent/hy3:free)\. I had it "Generate an SVG of a pelican riding a bicycle" there and got this: ![Flat-style cartoon illustration of a white pelican with a large orange beak riding a red bicycle across a pale blue background, its long orange legs stretched down to the pedals, with gray horizontal motion lines behind it suggesting speed.](https://static.simonwillison.net/static/2026/hy3-pelican.png)

Similar Articles

HY-3 PREVIEW

Reddit r/LocalLLaMA

Tencent releases Hy3-preview, a 295B-parameter MoE model with 21B active parameters that excels in STEM reasoning, instruction following, coding and agent tasks.