GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

Hugging Face Models Trending Models
gguf think-model minicpm5 function-calling fine-tuning open-source tool-calling

Summary

GnLOLot releases GGUF quantizations of the MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking model, a 1B parameter thinking model fine-tuned on Fable 5 data with improved tool/function calling compared to V1, designed for local deployment via llama.cpp and compatible runtimes.

Task: text-generation Tags: gguf, llama.cpp, quantized, minicpm5, thinking, fable5, tool-calling, function-calling, coding, instruction-following, conversational, text-generation, en, zh, base_model:GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking, base_model:quantized:GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking, license:apache-2.0, endpoints_compatible, region:us
Original Article
View Cached Full Text

Cached at: 07/16/26, 04:22 AM

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF · Hugging Face

Source: https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#minicpm5-1b-claude-opus-fable5-v2-thinking-ggufMiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF

GGUF quantizations of**MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking**forllama.cpp, Ollama, LM Studio, jan, KoboldCpp, and other GGUF runtimes.

中文说明

This repository provides local-deployment builds of a 1BThinkingmodel fine-tuned onFable 5data (V2) atopopenbmb/MiniCPM5-1B. Compared with V1, V2 strengthenstool calling / function calling, while keeping MiniCPM5’s native chat template embedded in the GGUF files.

Transformers checkpoint:MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking

Previous GGUF version:MiniCPM5-1B-Claude-Opus-Fable5-Thinking-GGUF(V1)

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#filesFiles

FileQuantSizeNotesMiniCPM5\-1B\-Claude\-Opus\-Fable5\-V2\-Thinking\-Q8\_0\.ggufQ8_0~1.1 GBrecommended defaultMiniCPM5\-1B\-Claude\-Opus\-Fable5\-V2\-Thinking\-F16\.ggufF16~2.1 GBfull-precision conversion base Q8_0is the recommended default quant for this 1B model.

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#quick-startQuick start

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#llamacpp-llama-clillama.cpp (llama\-cli)

llama-cli \
  -m MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-Q8_0.gguf \
  -p "Write a Python function to merge two sorted lists." \
  -n 512 \
  --temp 0.9 --top-p 0.95 \
  -c 8192

The model supports up to128K tokens(131,072) perconfig\.json. Set\-caccording to your available VRAM/RAM.

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#llamacpp-serverllama.cpp server

llama-server \
  -m MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-Q8_0.gguf \
  -c 8192 --port 8080

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#lm-studio–jan–koboldcppLM Studio / jan / KoboldCpp

Load any\.gguffile from this repository. The MiniCPM5 chat template is embedded in the GGUF metadata.

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#sampling-recommendationsSampling recommendations

Generation defaults are inherited from**MiniCPM5-1B**:

ModeParamsThink(default)temperature=0\.9, top\_p=0\.95No Thinktemperature=0\.7, top\_p=0\.95,enable\_thinking=False

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#capabilitiesCapabilities

  • Tool calling (enhanced in V2)— stronger function-calling / tool-use behavior
  • Fable 5 fine-tune (V2)— post-trained on Fable 5 data
  • Coding— code generation, debugging, and software-engineering workflows
  • Instruction following— more reliable adherence to user prompts and task constraints
  • Thinking mode— chain-of-thought reasoning; MiniCPM5 chat template baked into the GGUF
  • Long context— up to128K tokens(131,072 tokens per upstreamconfig\.json)

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#benchmarkBenchmark

Scores for the Transformers checkpointMiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking:

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#bfcl–api-bankBFCL + API-Bank

ModelBFCL non_liveBFCL liveAPI-BankMiniCPM5-1B (Base)41.51%60.24%7.30%MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking43.06%63.33%22.10%

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#tau-benchTau-Bench

DomainMiniCPM5-1B (Base)MiniCPM5-1B-Claude-Opus-Fable5-V2-ThinkingAirline0.34 (17/50)0.36 (18/50)Retail0.052 (6/115)0.070 (8/115)

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#limitationsLimitations

  • Thinking outputs— the model may emit reasoning blocks before the final answer
  • 1B scale— lightweight local deployment; not frontier-scale
  • Runtime context— actual usable context depends on your GGUF runtime and hardware limits

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#provenance–licensingProvenance & licensing

Apache-2.0, inherited fromMiniCPM5-1B.

https://huggingface.co/GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-V2-Thinking-GGUF#acknowledgementsAcknowledgements

Similar Articles

GnLOLot/MiniCPM5-1B-Claude-Opus-Fable5-Thinking

Hugging Face Models Trending

MiniCPM5-1B-Claude-Opus-Fable5-Thinking is a compact 1B thinking language model fine-tuned from openbmb/MiniCPM5-1B on Fable 5 data, enhancing coding and instruction-following while retaining the native thinking chat template and tool-call format. It supports up to 128K context and is suitable for local deployment.

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Hugging Face Models Trending

Empero AI releases Qwythos-9B-Claude-Mythos-5-1M-GGUF, a 9B parameter reasoning model fine-tuned on 500M+ tokens of Claude Mythos/Fable traces with chain-of-thought, achieving significant gains over Qwen3.5-9B and supporting 1M-token context via YaRN rope-scaling. The GGUF quantizations enable local inference on llama.cpp and compatible runtimes.

unsloth/North-Mini-Code-1.0-GGUF · Hugging Face

Reddit r/LocalLLaMA

This page hosts GGUF quantized versions of Cohere's North-Mini-Code-1.0 model, a 30B-A3B MoE model optimized for code generation and agentic tasks. Instructions are provided for building llama.cpp from a specific PR to support the cohere2moe architecture.

bottlecapai/ThinkingCap-Qwen3.6-27B-GGUF

Hugging Face Models Trending

ThinkingCap-Qwen3.6-27B is a fine-tuned version of Qwen3.6-27B that uses 50% fewer thinking tokens on average while maintaining answer quality. This repository provides GGUF quantizations for local inference with llama.cpp.