Liquid Inference
Summary
Liquid Inference 是一款 LLM 路由器,让多家模型提供商针对每次 prompt 动态竞价,从而为用户提供最低推理成本,兼容 Claude Code、Cursor 等主流 agentic 编码工具,支持数百个开源与闭源模型。
View Cached Full Text
Cached at: 10/08/26, 12:38 PM
Similar Articles
LFM2.5-24B-A2B (7 minute read)
Liquid AI 发布 LFM2.5-24B-A2B,一个 24B 参数、仅 2B 激活参数的开源权重推理模型,专为快速、私密的设备端智能体设计,在多个智能体与工具使用基准上超越更大的 MoE 模型。
BerriAI/litellm
LiteLLM 是一个开源 AI 网关,提供统一接口以 OpenAI 格式调用 100 多个 LLM 提供商,可作为 Python SDK 或自托管代理服务器使用,面向企业级部署。
@FakeMaidenMaker: MIT just open-sourced an inference library that lets large models read tens of millions of tokens at once—RLM from MIT CSAIL's OASYS lab, with involvement from DSPy and ColBERT author Omar Khattab, even VentureBeat covered it…
MIT open-sourced the RLM (Recursive Language Models) inference library, which handles ultra-long contexts by having the model recursively call itself programmatically, solving the limited context window problem of traditional models.
LiquidAI/LFM2.5-8B-A1B-GGUF
LiquidAI releases a GGUF quantized version of their LFM2.5-8B-A1B model, with instructions for use across multiple inference engines.
@AlexJonesax: Two open-source MLX inference servers worth knowing about if you run LLMs on Mac: MTPLX (@youssofal) Uses a model's own…
This article highlights two open-source MLX inference servers for Mac: MTPLX, which optimizes token speed using speculative decoding without a draft model, and oMLX, which improves workflow efficiency with persistent KV caches for coding agents.