ServiceNow-AI/SuperApriel-15B-Instruct · Hugging Face

Source: https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#superapriel-15b-instructSuperApriel-15b-Instruct

/ˈɑː\.pri\.əl/

A 15B-parametertoken-mixer supernetwith8 optimized deployment presetsspanning 1.0× to 10.7× decode throughput at 32K sequence length, all from a single checkpoint. Derived fromApriel-1.6through stochastic distillation and targeted supervised fine-tuning.

• **Model Size:**15B parameters
• **Layers:**48 decoder layers, each with 4 mixer variants
• **Context Length:**262K positions (runtime dependent)
• **Languages:**English (best)

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#highlightsHighlights

• Flexible deployment from a single checkpoint: multiple presets trading throughput for quality
• Four mixer types per layer: Full Attention (FA), Sliding Window Attention (SWA), Gated DeltaNet (GDN), Kimi Delta Attention (KDA)
• Instruction-tuned: targeted SFT with multiple Pareto-optimal placements
• Speculative decoding support: use all-attention as target with efficient placements as drafts from the same checkpoint

See the report for detailed benchmarks, quality retention curves, and the full story.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#performance-overviewPerformance Overview

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#pareto-frontier-speedup-vs-qualityPareto Frontier: Speedup vs Quality

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#throughput-comparisonThroughput Comparison

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#deployment-presetsDeployment Presets

Each preset is a specific assignment of one mixer per layer. All presets share the same checkpoint—only mixer selection differs at inference time.

PresetFASWAKDAGDNSpeedup @32kSpeedup @16kAvg Acc.Quality Retentionall-attention480001.0×1.0×74.2100%Reg|Lklhd‑261226642.85×1.5×71.196%Idealized|All‑181332121.99×1.1×71.897%Reg|Lklhd‑183254164.76×2.2×69.794%Idealized|Lklhd‑60305136.2×2.4×66.890%Idealized|All‑60305136.13×2.5×65.388%Reg|Lklhd‑1301613196.9×2.7×60.281%Reg|Lklhd‑1001053310.69×4.2×57.277%

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#benchmark-resultsBenchmark Results

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#full-results-s2-targeted-sft-with-8-placementsFull Results (S2: Targeted SFT with 8 Placements)

Config@32kAIME’24AIME’25MATH-500GSM8KFDASWDERULERTau2MMLU-ProAIME(NV)GPQAHLELCBIFBenchAllall-attention1.0×93.386.791.892.378.389.579.456.776.882.772.08.268.663.174.2Reg|Lklhd‑262.85×86.783.392.091.179.988.274.430.776.280.070.710.069.263.171.1Idealized|All‑181.99×90.086.792.092.178.086.667.152.676.382.268.26.967.358.871.8Reg|Lklhd‑184.76×86.776.792.491.781.789.860.546.276.374.468.76.664.859.369.7Idealized|Lklhd‑66.2×83.376.792.492.376.988.966.140.473.662.265.06.157.054.966.8Idealized|All‑66.13×83.380.092.291.775.687.461.934.273.356.761.05.955.955.365.3Reg|Lklhd‑136.9×76.773.390.491.268.685.157.028.669.326.761.25.552.657.160.2Reg|Lklhd‑1010.69×76.766.790.690.865.282.948.623.468.224.452.54.550.256.257.2

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#comparison-with-other-hybrid-modelsComparison with Other Hybrid Models

ModelSpeedup @32kMath (Avg)All TasksSuper Aprielall-attention1.0×91.074.2Super AprielReg|Lklhd‑262.85×88.371.1Super AprielReg|Lklhd‑184.76×86.869.7Super AprielIdealized|Lklhd‑66.2×86.266.8Apriel-H1 15B1.97×80.458.4Nemotron-Nano 12B v25.85×74.562.4Falcon-H1R 7B4.61×78.664.9Nemotron-3-Nano 30B4.09×89.072.6

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#model-overviewModel Overview

SuperApriel-15b-Instruct is trained in two stages:

1. Stage 1 — Stochastic Distillation: All four mixer types trained simultaneously via distillation from frozen Apriel-1.6 teacher on 266B tokens. SeeSuperApriel-15b-Base.
2. Stage 2 — Targeted SFT: Supervised fine-tuning on 60B tokens with 8 Pareto-optimal placements identified via Bayesian placement optimization. Shared parameters (FFNs, embeddings, norms) remain frozen; only mixer weights are trained.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#architecture-detailsArchitecture Details

ComponentDetailsParameters15BDecoder layers48Query / KV heads32 / 8 (grouped-query attention), d_h = 128Hidden dimension5,120FFN width14,336 (SiLU-gated)Vocabulary131,072 tokensVision encoderPixtral (16×16 patches)

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#mixer-typesMixer Types

MixerTimeMemoryDescriptionFull Attention (FA)O(n²)O(n) KV cacheStandard grouped-query attentionSliding Window (SWA)O(w·n)O(w)Local window of 4,096 tokensGated DeltaNet (GDN)O(n)O(1) fixed stateMatrix-valued recurrent state with delta ruleKimi Delta Attention (KDA)O(n)O(1) fixed stateLinear attention with channel-wise gating

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#how-to-useHow to Use

The recommended serving backend isvLLMwith the Fast-LLM plugin, which supports preset selection and runtime switching. For simpler use cases, Transformers is also supported (seeUse with Transformersbelow).

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#use-with-vllmUse with vLLM

Preset selection and throughput-optimized serving require the vLLM plugin fromFast-LLM. Two serving modes are available:

• Single-preset mode: Only the weights for the selected mixer placement are loaded (approx. 27 GiB in bf16). Unused mixer weights are never loaded, so the model fits comfortably on a single GPU with room for KV cache.
• Supernet mode: All four mixer weights are loaded per layer (approx. 46 GiB in bf16), enabling instant placement switching at runtime viacollective\_rpc(3-20 ms per switch, no engine reload).

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#installationInstallation

Install vLLM and the Apriel2 plugin (no need to install the full Fast-LLM training framework):

python -m venv .venv
source .venv/bin/activate

pip install vllm==0.14.1

git clone [email protected]:ServiceNow/Fast-LLM.git
cd Fast-LLM && git checkout feature/vllm-apriel2-models

# Install only the vLLM plugin (not the full training framework)
pip install -e ./apriel2-vllm-plugin/

This installs a thin wrapper that registers the Apriel2 model with vLLM via its plugin system. It only pulls intorch,transformers, andeinops— no training dependencies.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#single-preset-modeSingle-Preset Mode

Load one preset on a single GPU. Copy the desired preset config over the model’sconfig\.json:

import json, shutil
from vllm import LLM, SamplingParams

model_dir = "ServiceNow-AI/SuperApriel-15b-Instruct"  # or local path

# Select a preset (copies its config.json as the model's main config)
preset = "Reg_Lklhd-26"  # see preset_configs/ for all options
shutil.copy(f"{model_dir}/preset_configs/{preset}/config.json",
            f"{model_dir}/config.json")

llm = LLM(
    model=model_dir,
    trust_remote_code=True,
    gpu_memory_utilization=0.90,
    max_model_len=4096,
)

output = llm.generate(
    ["What is 2 + 3?"],
    SamplingParams(max_tokens=200, temperature=0.6),
)
print(output[0].outputs[0].text)

Available presets:all\-attention,Reg\_Lklhd\-26,Reg\_Lklhd\-18,Reg\_Lklhd\-13,Reg\_Lklhd\-10,Idealized\_All\-18,Idealized\_All\-6,Idealized\_Lklhd\-6,extra\_bayesian\-mix\-7.

**Note:**Custom placements must include at least one attention-type layer (FA or SWA). Configurations using only recurrent mixers (GDN/KDA) are not currently supported due to a vLLM KV cache coordinator limitation. All shipped presets satisfy this requirement.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#supernet-mode-runtime-switchingSupernet Mode (Runtime Switching)

Load the full supernet and switch presets at runtime without reloading the engine. Useenforce\_eager=Trueon a single GPU (saves memory by skipping CUDA graph capture):

import json
from vllm import LLM, SamplingParams

model_dir = "ServiceNow-AI/SuperApriel-15b-Instruct"  # or local path
# Ensure the base supernet config.json is active (the default in the repo)

llm = LLM(
    model=model_dir,
    trust_remote_code=True,
    gpu_memory_utilization=0.90,
    max_model_len=4096,
    enforce_eager=True,   # required for single GPU; optional with tensor_parallel_size=2
    # tensor_parallel_size=2,  # uncomment for 2-GPU setup (enables CUDA graphs)
)

# Check available mixers
mixer_names = llm.collective_rpc("get_mixer_names")
print(mixer_names[0])  # ['attention', 'gdn', 'kda', 'sliding_window']

# Load a preset pattern and switch
preset = "Reg_Lklhd-26"
with open(f"{model_dir}/preset_configs/{preset}/config.json") as f:
    pattern = json.load(f)["decoder"]["pattern"]

llm.collective_rpc("set_layer_placements", args=(pattern,))  # ~3-20ms

output = llm.generate(
    ["What is 2 + 3?"],
    SamplingParams(max_tokens=200, temperature=0.6),
)
print(output[0].outputs[0].text)

# Switch to another preset instantly
with open(f"{model_dir}/preset_configs/all-attention/config.json") as f:
    pattern = json.load(f)["decoder"]["pattern"]
llm.collective_rpc("set_layer_placements", args=(pattern,))

SetupModel SizeAvailable for KV CacheNotesSingle-preset, 1 GPU27 GiB39 GiBBest for fixed deploymentsSupernet, 1 GPU (enforce\_eager)46 GiB20 GiBRuntime switching, lower KV capacitySupernet, 2 GPU (TP=2)23 GiB/GPU50 GiB/GPUFull compile + CUDA graphs

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#serving-openai-compatible-apiServing (OpenAI-Compatible API)

Serve a single preset as an OpenAI-compatible endpoint usingvllm serve. Select the preset before launching:

# Select a preset
MODEL_DIR="ServiceNow-AI/SuperApriel-15b-Instruct"  # or local path
cp $MODEL_DIR/preset_configs/Reg_Lklhd-26/config.json $MODEL_DIR/config.json

# Launch the server
vllm serve $MODEL_DIR \
  --trust-remote-code \
  --gpu-memory-utilization 0.90 \
  --max-model-len 4096 \
  --served-model-name SuperApriel-15b-Instruct

Query with curl:

curl http://localhost:8000/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "SuperApriel-15b-Instruct",
    "messages": [{"role": "user", "content": "What is 2 + 3?"}],
    "max_tokens": 200,
    "temperature": 0.6
  }'

Or with the OpenAI Python client:

from openai import OpenAI

client = OpenAI(base_url="http://localhost:8000/v1", api_key="unused")

response = client.chat.completions.create(
    model="SuperApriel-15b-Instruct",
    messages=[{"role": "user", "content": "What is 2 + 3?"}],
    max_tokens=200,
    temperature=0.6,
)
print(response.choices[0].message.content)

To switch presets, stop the server, copy a different preset config, and restart.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#per-request-preset-selectionPer-Request Preset Selection

The supernet mode above switches the active placement globally for all requests. For production deployments, it is also possible to route individual requests to different presets — for example, routing latency-sensitive requests to a fast placement and complex reasoning requests to all-attention.

🔴 TODO: Add per-request placement selection via the vLLM serving API (e.g.placement\_idfield in the request body). This is managed separately from the globalcollective\_rpcswitching shown above.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#use-with-transformersUse with Transformers

The model works withAutoModelForCausalLMfor standard Transformers inference. Each preset config selects one mixer per layer, and the model automatically loads only the relevant weights from the supernet checkpoint.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#installation-1Installation

pip install transformers torch einops accelerate

Presets that include GDN or KDA mixers additionally require:

pip install causal-conv1d mamba-ssm

Attention-only presets (all\-attention, and others using only FA/SWA) work without these extra packages.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#usageUsage

The repo ships with the supernet config as default (for vLLM). Before loading with Transformers, you must select a preset by copying itsconfig\.json:

import re
import shutil
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

model_dir = "ServiceNow-AI/SuperApriel-15b-Instruct"  # or local path

# Select a preset (required — the default supernet config is for vLLM only)
preset = "all-attention"  # or any preset from preset_configs/
shutil.copy(f"{model_dir}/preset_configs/{preset}/config.json",
            f"{model_dir}/config.json")

tokenizer = AutoTokenizer.from_pretrained(model_dir, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_dir,
    trust_remote_code=True,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)

prompt = "Positive real numbers $x$ and $y$ satisfy $y^3=x^2$ and $(y-x)^2=4y^2$. What is $x+y$?\nMark your solution with \\boxed"
messages = [{"role": "user", "content": prompt}]

text = tokenizer.apply_chat_template(
    messages, tokenize=False, add_generation_prompt=True, tools=[]
)
model_inputs = tokenizer([text], return_tensors="pt").to(model.device)

generated_ids = model.generate(**model_inputs, max_new_tokens=1024)
output = tokenizer.decode(generated_ids[0], skip_special_tokens=True)

response = re.findall(
    r"\[BEGIN FINAL RESPONSE\](.*?)\[END FINAL RESPONSE\]", output, re.DOTALL
)[0].strip()
print("response:", response)

Available presets:all\-attention,Reg\_Lklhd\-26,Reg\_Lklhd\-18,Reg\_Lklhd\-13,Reg\_Lklhd\-10,Idealized\_All\-18,Idealized\_All\-6,Idealized\_Lklhd\-6,extra\_bayesian\-mix\-7.

SeeApriel-1.6-15b-Thinkerfor recommended inference settings.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#chat-templateChat Template

<|begin_system|>
You are a thoughtful, systematic AI assistant from ServiceNow Language Models (SLAM) lab. Analyze each question carefully, present your reasoning step-by-step, then provide the final response after the marker [BEGIN FINAL RESPONSE].
<|begin_user|>
# user message here

<|begin_assistant|>
Here are my reasoning steps:
# thoughts here
[BEGIN FINAL RESPONSE]
# assistant response here
[END FINAL RESPONSE]
<|end|>

The model first generates its thinking process, then its final response between\[BEGIN FINAL RESPONSE\]and\[END FINAL RESPONSE\].

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#usage-guidelinesUsage Guidelines

1. Use the model’s default chat template, which already includes a system prompt. Add additional instructions within the user message.
2. The model starts withHere are my reasoning steps:\\nduring generation (implemented in the default chat template).
3. SeeApriel-1.6-15b-Thinkerfor recommended inference settings.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#intended-useIntended Use

SuperApriel-15b-Instruct is designed for a variety of instruction-following tasks, including:

• Code assistance and generation
• Logical reasoning and multi-step tasks
• Question answering and information retrieval
• Function calling, complex instruction following and agent use cases

It isnot intendedfor use in safety-critical applications without human oversight or in scenarios requiring guaranteed factual accuracy.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#limitationsLimitations

• **Factual accuracy:**May produce incorrect, misleading, or outdated content. Outputs should be verified before use in critical contexts.
• **Bias:**May reflect societal, cultural, or systemic biases present in training data.
• **Ethics:**Do not use the model to produce harmful, unlawful, or unethical content.
• **Language:**Strongest performance is in English. Output quality may degrade in underrepresented languages.
• **Critical use:**Not suitable for medical, legal, financial, or other high-risk applications without safeguards.
• **Long-context degradation:**Aggressive placements (fewer FA layers) may show reduced performance on long-range tasks like RULER/NIAH.
• **vLLM pure-recurrent limitation:**Custom placements using only GDN/KDA mixers (no FA or SWA layers) are not supported with vLLM due to a KV cache coordinator constraint. All shipped presets include attention-type layers.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#security-and-responsible-useSecurity and Responsible Use

**Security Responsibilities:**Deployers and users are strongly encouraged to align their security practices with established frameworks and regulatory guidelines such as the EU AI Act and the NIST AI Risk Management Framework (RMF).

Guidelines for Deployers:

• Regularly conduct robustness assessments to identify and mitigate adversarial inputs.
• Implement validation and filtering processes to prevent harmful or biased outputs.
• Continuously perform data privacy checks to guard against unintended data leaks.
• Document and communicate the model’s limitations, intended usage, and known security risks to all end-users.
• Schedule periodic security reviews and updates to address emerging threats and vulnerabilities.

Guidelines for Users:

• Follow established security policies and usage guidelines provided by deployers.
• Protect and manage sensitive information when interacting with the model.
• Report anomalies, suspicious behavior, or unsafe outputs to deployers or developers.
• Maintain human oversight and apply judgment to mitigate potential security or ethical risks during interactions.

**Disclaimer:**Users accept responsibility for securely deploying, managing, and using this open-source LLM. The model is provided “as-is,” without explicit or implied warranty regarding security or fitness for any specific application or environment.

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#softwareSoftware

• Training stack:Fast-LLM
• Serving:Fast-LLM vLLM plugin

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#licenseLicense

MIT

https://huggingface.co/ServiceNow-AI/SuperApriel-15B-Instruct#citationCitation

@misc{super_apriel_2026,
  title        = {Super Apriel: One Checkpoint, Many Speeds},
  author       = {ServiceNow Language Models Lab},
  year         = {2026},
  eprint       = {TODO},
  archivePrefix= {arXiv},
  primaryClass = {cs.CL}
}