Hy4-770B-A49B · Hugging Face
Summary
腾讯发布了 Hy4 的权重,这是其原生多模态旗舰 MoE 模型(总参数 770B,激活参数 49B),现已上线 Hugging Face。
Similar Articles
Tencent Hy4 (flagship multimodal MoE A49B/770B) released
Tencent released open weights for Hy4, its natively multimodal flagship MoE model with 770B total/49B active parameters and 1M context, along with GitHub repo, GGUF quantizations, license, and system card.
@AdinaYakup: Hy4's weights are now available on the hub https://huggingface.co/tencent/Hy4 - 770B/49B - 1M context - Custom license …
Tencent's Hy4 MoE flagship model weights are released on Hugging Face, featuring 770B total/49B active parameters, 1M context, multimodal text-image-video understanding, and optimized inference via DFly2 speculative decoding.
@heyshrutimishra: tencent just put the weights for a 770B model on hugging face, free to download. it's called hy4, their new flagship. 4…
Tencent released open weights for HY4, a 770B multimodal flagship model with 49B active params per token and 1M token context, including instruct, FP8 and base variants. The model card also describes HY4 autonomously training a variant that beat their baseline, further narrowing the open-vs-closed gap alongside DeepSeek, Kimi and GLM releases.
tencent/Hy4
Tencent's Hy Team released Hy4, a new-generation MoE flagship model with 770B total parameters (49B activated per token) supporting text, image, and video understanding, featuring Gated DeepSeek Sparse Attention, IndexCache, and a built-in DFly2 drafter for speculative decoding.
Tencent/Hy4-preview 770B-A49B weight dropped
Tencent releases Hy4-preview, a new Mixture-of-Experts flagship AI model with 770B total parameters and 49B activated per token, featuring advanced techniques like Gated DeepSeek Sparse Attention and identity Hyper-Connections.