LiquidAI/LFM3-1.7B-GGUF

Hugging Face Models Trending Models
gguf local-inference quantization llama-cpp small-language-model open-source

Summary

Liquid AI 发布 LFM3-1.7B 的 GGUF 版本，支持在 CPU/GPU 上本地推理，兼容 llama.cpp、Ollama、LM Studio 等工具，并提供经过量化感知蒸馏（QAD）的 Q4_0 检查点以恢复量化损失的精度。

Task: text-generation Tags: gguf, liquid, lfm3, llama.cpp, text-generation, en, ar, zh, fr, de, it, ja, ko, pt, es, vi, th, id, hi, ru, pl, base_model:LiquidAI/LFM3-1.7B, base_model:quantized:LiquidAI/LFM3-1.7B, license:other, endpoints_compatible, region:us, conversational
Original Article
View Cached Full Text

Cached at: 10/30/26, 09:10 PM

LiquidAI/LFM3-1.7B-GGUF · Hugging Face

Source: https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF Liquid AI

GGUF version ofLFM3-1.7Bfor local inference on CPUs and GPUs.

Find architecture and usage details in theoriginal model card.

https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF#how-to-run-lfm3-17bHow to run LFM3-1.7B

Recommended sampling: temperature 0.1, top_k 50, repeat penalty 1.1. For math and science: temperature 1.0, top_p 0.95, top_k 20.

  • Llama.app(Use this model > Llamain the menu), for macOS and Windows. Requires llama.cpp versionv0.8.0or newer.
  • LM Studio(Use this model > LM Studioin the menu), for macOS, Windows and Linux. Requires LM Studio with llama.cpp engine 2.65.1 or newer.
  • Ollama(ollama run lfm3), for macOS. Requires Ollama versionv0.40.12or newer.

https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF#use-with-llamacppUse with llama.cpp

Supported inllama.cppb11960(v0.8.0) and newer.

Add a quantization tag to pick a file.

llama-cli -hf LiquidAI/LFM3-1.7B-GGUF:Q4_K_M \
  --temp 0.1 --top-k 50 --repeat-penalty 1.1

For math and science, use\-\-temp 1\.0 \-\-top\-p 0\.95 \-\-top\-k 20instead. More options in thellama.cpp guide.

https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF#qad-q4_0-ggufQAD Q4_0 GGUF

The Q4_0 build in this repository is the Quantization-Aware Distillation (QAD) checkpoint,LFM3\-1\.7B\-QAD\-Q4\_0\.gguf. It was trained to recover the accuracy lost to Q4_0 quantization.

Example usage withllama.cpp:

llama-cli -hf LiquidAI/LFM3-1.7B-GGUF \
  --hf-file LFM3-1.7B-QAD-Q4_0.gguf \
  --temp 0.1 --top-k 50 --repeat-penalty 1.1

Similar Articles

LiquidAI/LFM3-Omni-2B-GGUF

Reddit r/LocalLLaMA

Liquid AI 发布 LFM3-Omni-2B 的 GGUF 版本，支持在 CPU/GPU 上本地推理。该模型可理解文本、图像、视频和音频，并以文本和语音输出，专为设备端使用打造。

LiquidAI/LFM2.5-24B-A2B-GGUF

Hugging Face Models Trending

Liquid AI 发布 LFM2.5-24B-A2B 的 GGUF 量化版本，专为边缘 AI 和端侧部署设计，并包含通过量化感知蒸馏（QAD）训练的 Q4_0 检查点以恢复量化损失的精度。

LiquidAI/LFM2.5-8B-A1B-GGUF

Hugging Face Models Trending

LiquidAI releases a GGUF quantized version of their LFM2.5-8B-A1B model, with instructions for use across multiple inference engines.

LiquidAI/LFM2.5-2.6B-GGUF

Hugging Face Models Trending

This Hugging Face model card presents LiquidAI's LFM2.5-2.6B model in GGUF quantized format, with instructions for running it locally via llama.cpp, vLLM, Ollama, and other tools.

LiquidAI/LFM3-1.7B

Hugging Face Models Trending

Liquid AI released LFM3-1.7B, a 1.73B-parameter tri-hybrid text model designed for local agents and edge deployment with a 256K-token context window, fitting in about 1 GB of memory at 4-bit precision and supporting single-GPU fine-tuning for domain specialization.