Ornith-1.0-35B Q3_K_M: ~17 GB VRAM, KLD-checked against BF16
Summary
Ornith-1.0-35B Q3_K_M is a 3-bit quantized version of a 35B parameter model, requiring about 17 GB VRAM, with KLD checking against BF16 to ensure fidelity.
Similar Articles
We quantized the new Ornith 1.5 9B and 35B-A3B
The post details the quantization of Ornith 1.5 9B and 35B-A3B AI models using Atomic Dynamic methods, providing benchmarks against stock quantizations and sharing Hugging Face collections.
I benchmarked IFM/K2-Horizon-7B on 16GB VRAM
The article benchmarks three AI models on 16GB VRAM, showing that Qwen3.8-27B performs best, followed by Ornith-1.5-9B, with IFM/K2-Horizon-7B lagging behind in speed and task completion.
@malikwas1f: Ornith-1.0-35B: a Qwen3.6-35B-A3B coding fine-tune that edges the base on real coding (aider 15/30 vs 13) — full 262K a…
Announces Ornith-1.0-35B, a coding fine-tune of Qwen3.6-35B-A3B that slightly outperforms the base model on aider benchmarks. Also promotes the club-3090 repository for running LLMs on RTX 3090s.
@anvie: Tested Ornith-1.0-9B, and its impressive for a model of that size. I don't believe this is just 9B!
Ornith-1.0 is a family of open-source LLMs specialized for agentic coding, spanning sizes from 9B to 397B and achieving state-of-the-art performance among open-source models of comparable size.
@SlimTradeyBaby: Attention all 8-12GB GPU users! This new Ornith-1.0-9B is looking like it will be a serz player for smaller VRAM setups…
Ornith-1.0-9B is a new 9B parameter AI model optimized for 8-12GB GPUs, achieving strong performance on agentic coding benchmarks, matching or surpassing models 2-3x its size.