Ling 3.0 support merged into llama.cpp
Summary
Support for the new Ling 3.0 reasoning models has been integrated into llama.cpp, making them accessible via this development tool.
Similar Articles
Ling-3.0 (BailingMoE3) lands in llama.cpp mainline - Quick benchmarks on Intel Arc B580
Ling-3.0 (BailingMoE3) is now officially supported in llama.cpp, with benchmarks on Intel Arc B580 showing efficient local inference including 128K context in 12GB VRAM.
Ling-3.0-flash weights: SGLang says day-0, vLLM says when they land, llama.cpp closed the 2.6 request as not_planned
The article details the current support status for the Ling-3.0-flash model weights across inference engines: SGLang commits to day-0 integration, vLLM awaits open weights, and llama.ccp lacks conversion for the Bailing MoE variant. It notes that the release pattern involves a free API window followed by open-sourcing, as seen with Ling-2.6-flash.
@AdinaYakup: Ling 3.0 flash a native hybrid-linear reasoning model from @AntLingAGI Ling series is built around: strong reasoning pe…
AntLingAGI announces Ling 3.0 flash, a native hybrid-linear reasoning model with 124B total parameters and 5.1B active, MIT-licensed, claiming to match a 1T flagship with much less compute and faster response times.
pi 0.81.0 adds support for llama.cpp
Pi 0.81.0 adds support for llama.cpp, enabling local LLM inference within the Pi coding agent harness.
server, webui: support continue generation on reasoning models by ServeurpersoCom · Pull Request #22727 · ggml-org/llama.cpp
This pull request adds support for continuing generation on reasoning models within the llama.cpp server and WebUI.