CohereLabs/North-Mini-Code-1.0-eagle · Hugging Face
Summary
Cohere Labs releases North-Mini-Code-1.0-eagle, a draft model for speculative decoding to accelerate code generation. It features three dense transformer layers with sliding window attention and is compatible with fp8/w4a4 target models.
View Cached Full Text
Cached at: 07/28/26, 04:35 PM
CohereLabs/North-Mini-Code-1.0-eagle · Hugging Face
Source: https://huggingface.co/CohereLabs/North-Mini-Code-1.0-eagle Eagle model forCohereLabs/North-mini-code-1.0.
Key highlights include:
- three layers with dense transformer blocks
- all draft layers use sliding window attention
- compatible with fp8/w4a4 target model checkpoints
https://huggingface.co/CohereLabs/North-Mini-Code-1.0-eagle#vllmvllm
To start vllm server with this draft model, run the following
vllm serve CohereLabs/North-Mini-Code-1.0 \
-tp 2 \
--max-model-len 320000 \
--tool-call-parser cohere_command4 \
--reasoning-parser cohere_command4 \
--enable-auto-tool-choice \
--speculative_config "{\"method\": \"eagle\", \"model\": \"CohereLabs/North-Mini-Code-1.0-eagle\", \"num_speculative_tokens\": 3, \"draft_tensor_parallel_size\": 2}"
Similar Articles
CohereLabs/North-Mini-Code-1.0
Cohere Labs released North Mini Code, a 30B-parameter (3B active) open-weights model optimized for code generation, agentic software engineering, and terminal tasks, licensed under Apache 2.0.
unsloth/North-Mini-Code-1.0-GGUF · Hugging Face
This page hosts GGUF quantized versions of Cohere's North-Mini-Code-1.0 model, a 30B-A3B MoE model optimized for code generation and agentic tasks. Instructions are provided for building llama.cpp from a specific PR to support the cohere2moe architecture.
Updates on North Mini Code: 4 bit quant + Ollama + OpenRouter
Cohere releases North Mini Code, a 30B-A3B open-weights model with 4-bit quantization for code generation and agentic coding tasks, supporting 256K context.
Releasing Cohere North Mini Code
Cohere officially launches North Mini Code, a coding model, with weights available on Hugging Face and deployment support for vLLM and MLX.
Introducing North Mini Code: Cohere’s First Model For Developers
Cohere released North Mini Code, a 30B-parameter Mixture-of-Experts model with 3B active parameters under Apache 2.0, optimized for agentic software engineering tasks and outperforming similar-sized models on coding benchmarks.