The new k2 horizon models seem like an absolute beast

Reddit r/LocalLLaMA Models

Summary

The k2 horizon AI models, particularly the 7B variant, are praised for outperforming muse glimmer despite smaller size, with full open-sourcing that could set a new standard if benchmarks are accurate.

Especially the 7B one seems very interesting, it casually destroys muse glimmer with a way smaller size. And they open source literally everything, every step of the way. Anyone tried that model? It can be a new milestone if 7b and 3.7b ones are actually good, and not just benchmaxed.
Original Article

Similar Articles

quants for K2-Horizon are now available

Reddit r/LocalLLaMA

Quantized versions of the K2-Horizon AI model series are now available for download on Hugging Face, supporting various sizes from 0.9B to 36B parameters. However, the llama.cpp support is still in progress, requiring a fork for use.