mo

Tag

Cards List
#mo

@Xudong07452910: A flagship large model with 295B parameters can now run on a single 96GB inference GPU, with 50% faster decoding. Tencent Hunyuan team releases quantized versions for Hy3 (295B parameters). The 1-bit version (IQ1_M) compresses weights from 598GB to 85.5GB, a 6…

X AI KOLs Timeline · 23h ago Cached

Tencent Hunyuan team releases quantized versions for the 295B-parameter Hy3 large model. The 1-bit version compresses weights to 85.5GB, enabling deployment on a single 96GB inference GPU with ~50% faster decoding. The open-source GGUF format is compatible with the llama.cpp ecosystem.

0 favorites 0 likes
← Back to home

Submit Feedback