@jimmysmith1919: Another nice release today. New draft models for speculative decoding of several of our LFM2.5 models. 1.2B: https://hu…
Summary
LiquidAI releases draft models for speculative decoding to accelerate their LFM2.5 models, achieving up to 2× faster inference on H100 and Apple silicon without quality degradation.
View Cached Full Text
Cached at: 08/21/26, 01:11 PM
Another nice release today. New draft models for speculative decoding of several of our LFM2.5 models. 1.2B: https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark… 2.6B: https://huggingface.co/LiquidAI/LFM2.5-2.6B-DSpark… 8B-A1B: https://huggingface.co/LiquidAI/LFM2.5-8B-A1B-DSpark… Blog: https://liquid.ai/blog/lfm2.5-dspark…
LiquidAI/LFM2.5-1.2B-Instruct-DSpark · Hugging Face
Source: https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark

LFM2.5-DSparkis a family of speculative-decoding draft models that adapt DSpark for the LFM2.5 architecture. They allow LFM2.5 models to run faster without degrading quality.
This is a drafter for**LiquidAI/LFM2\.5\-1\.2B\-Instruct**. In SGLang, decoding runs about 2× faster. It also runs on-device on Apple silicon through the Metal backend.
Find more information about LFM2.5-DSpark in ourblog post.
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#%F0%9F%97%92%EF%B8%8F-model-details🗒️ Model Details
LFM2.5-1.2B-Instruct-DSpark is a DSpark speculative-decoding draft model with the following features:
- Target model:
LiquidAI/LFM2\.5\-1\.2B\-Instruct - Draft parameters:295.7M(BF16)
- Backbone: 5 full attention layers,
hidden\_size=2048,intermediate\_size=6144with SiLU/SwiGLU, GQA withnum\_attention\_heads=32/num\_key\_value\_heads=8,head\_dim=64 - Extra heads: Markov head (rank 256) + confidence head
- Block size: 9
- Vocabulary: 65,536
Other models in the LFM2.5-DSpark family:
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#%F0%9F%93%8A-performance📊 Performance
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#benchmarksBenchmarks
Speculative decoding isexact: the target verifies every proposed token, so the generated text is what the target would have produced on its own. SeeLiquidAI/LFM2\.5\-1\.2B\-Instructfor performance benchmarks.
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#acceptanceAcceptance
Mean accepted tokens per decoding step, by benchmark (1×H100, batch size 1, greedy decoding). Higher means more of the draft’s proposed block is accepted per target forward pass, so decoding is faster (at block size 9, the ceiling is 10).
BenchmarkAccepted tokens / stepMATH-5005.78GSM8K4.25HumanEval5.51MBPP5.41MT-Bench3.11Mean****4.81
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#on-device-and-gpu-inferenceOn-device and GPU Inference
DatasetAcceptance (of 10)Speedup on H100Speedup on M4 MaxMATH5006.022.56x 668 → 1712 tok/s2.62x 140 → 366 tok/sHumanEval5.312.26x 664 → 1499 tok/s2.87x 136 → 389 tok/sMBPP5.522.37x 667 → 1578 tok/s2.74x 137 → 375 tok/sGSM8K4.341.67x 624 → 1041 tok/s2.73x 140 → 381 tok/sMT-Bench3.901.66x 657 → 1091 tok/s1.72x 137 → 237 tok/sMean5.022.10x 656 → 1384 tok/s2.54x 138 → 350 tok/s
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#%F0%9F%8F%83-how-to-run-sglang🏃 How to run (SGLang)
Requires a build of SGLang with DSpark support for LFM2 targets (PR #31041). Launch the target with the drafter attached:
python -m sglang.launch_server \
--model-path LiquidAI/LFM2.5-1.2B-Instruct \
--speculative-algorithm DSPARK \
--speculative-draft-model-path LiquidAI/LFM2.5-1.2B-Instruct-DSpark \
--speculative-draft-attention-backend flashinfer \
--disable-radix-cache --mem-fraction-static 0.75 --port 30000
Then query the OpenAI-compatible endpoint athttp://localhost:30000/v1. The block size is read from the draft’sconfig\.json; the baseline is the same command without the three\-\-speculative\-\*flags.
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#%F0%9F%93%AC-contact📬 Contact
- Got questions or want to connect?Join our Discord community
- If you are interested in custom solutions with edge deployment, please contactour sales team.
https://huggingface.co/LiquidAI/LFM2.5-1.2B-Instruct-DSpark#citationCitation
@article{liquidAI202626B,
author = {Liquid AI},
title = {LFM2.5-2.6B: Agents Everywhere},
journal = {Liquid AI Blog},
year = {2026},
note = {www.liquid.ai/blog/lfm2-5-2-6b},
}
@article{liquidAI2026dspark,
author = {Liquid AI},
title = {LFM2.5-DSpark: Up to 3.2x Faster Inference from H100 to MacBook},
journal = {Liquid AI Blog},
year = {2026},
note = {www.liquid.ai/blog/lfm2.5-dspark},
}
Liquid AI (@liquidai): Today, we release DSpark draft models for LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B. These add a speculative decoding path that trades a minimal memory increase for a large decoding speedup without changing output quality.
A lightweight draft model proposes a block of
Similar Articles
@ramin_m_h: yesterday we made them more compressed! today we make them faster than ever with speculative decoding! up to 4x decode …
Liquid AI releases DSpark draft models for their LFM series, incorporating speculative decoding to achieve up to 4x decode speedup on device while maintaining output quality.
LiquidAI/LFM2.5-2.6B
Liquid AI released LFM2.5-2.6B, a 2.6B-parameter hybrid model optimized for on-device deployment with 128K context, agentic post-training, and fast inference (220 tok/s on Apple M5 Max) under 2.5GB memory.
@charles_irl: Speculation Is All You Need. In this blog post, we announce the co-release (w/ Z Lab) of six more state-of-the-art DFla…
Modal and Z Lab release six new DFlash speculative decoding draft models for Qwen 3.x, achieving over 1000 tokens per second on a B200 and arguing that speculative decoding is the most impactful inference optimization.
@liquidai: Introducing LFM2.5-230M: our smallest model yet, built to run fast anywhere (CPUs, NPUs, and GPUs) to enable agentic ta…
Liquid AI releases LFM2.5-230M, a small 230M parameter model optimized for fast inference on CPUs, NPUs, and GPUs, targeting agentic tasks on devices like phones and robots.
@charles_irl: On Friday, we released six new state-of-the-art drafters for accelerated inference. We also put out a blog post on why …
On Friday, we released six new state-of-the-art drafters for accelerated inference, along with a blog post on speculative decoding and a roofline model tool to estimate speedups.