quants for K2-Horizon are now available
Summary
Quantized versions of the K2-Horizon AI model series are now available for download on Hugging Face, supporting various sizes from 0.9B to 36B parameters. However, the llama.cpp support is still in progress, requiring a fork for use.
Similar Articles
@IFM_AI: Introducing K2 Horizon: a connected fleet of six foundation models ranging from 0.9 billion to 375 billion parameters. …
IFM AI introduces K2 Horizon, a fully open-source fleet of six foundation models ranging from 0.9B to 375B parameters, claiming frontier performance in coding and agentic tasks. The release is touted as the largest fully open-source model launch in AI history, with complete transparency and open access to training data and code.
The new k2 horizon models seem like an absolute beast
The k2 horizon AI models, particularly the 7B variant, are praised for outperforming muse glimmer despite smaller size, with full open-sourcing that could set a new standard if benchmarks are accurate.
IFM/K2-Horizon-MoVA-36B-A4B-GGUF · Hugging Face
This is the GGUF version of the K2-Horizon-MoVA-36B-A4B model, a Mixture-of-Experts AI model with 36B total parameters and 4B active per token, optimized for use with llama.cpp. It demonstrates frontier-class performance on agentic and reasoning benchmarks, competing with larger and closed models.
@HuggingPapers: NVIDIA just released the NVFP4 quantized Kimi-K2.7-Code on Hugging Face A 1T-parameter Moonshot AI model quantized to F…
NVIDIA released the NVFP4 quantized Kimi-K2.7-Code, a 1 trillion-parameter Moonshot AI model quantized to FP4 for Blackwell GPUs, preserving accuracy with reduced memory usage.
We quantized the new Ornith 1.5 9B and 35B-A3B
The post details the quantization of Ornith 1.5 9B and 35B-A3B AI models using Atomic Dynamic methods, providing benchmarks against stock quantizations and sharing Hugging Face collections.