HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF · Hugging Face

Source: https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#qwen38-27b-uncensored-hauhaucs-aggressive-mtpQwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP

HauhauCS FastMTP: up to 3.02x document TG and 1.93x reasoning TG versus non-MTP — plus up to 35.2% more document TG and 21.1% more reasoning TG than standard embedded MTP.

**Join the Discord**for updates, roadmaps, projects, or just to chat.

Qwen3.8-27B uncensored by HauhauCS0/465 Refusals* .

This is theAggressive variant: direct answers, no refusal behavior, and minimal preamble on hard prompts.

**Every text GGUF preserves Qwen3.8’s native NextN head, and this release adds HauhauCS FastMTP: a specific acceleration sidecar qualified across the complete quant lineup at maximum native context.**Vision is included through the separate BF16 projector.

Hugging Face’s Hardware Compatibility widget may not recognize K_P quants.If files appear to be missing, clickView variantsor openFiles and versions.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#aboutAbout

No changes to datasets or intended capabilities. This release preserves Qwen3.8-27B’s text, reasoning, agentic, image, and video capabilities while applying the HauhauCS Aggressive uncensoring profile.

Pick Aggressive when you specifically want the model to get to the answer without first talking itself into compliance. For reliability-critical, specifically long-context agentic work, a Balanced release is normally the safer default when/if one is available.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#downloadsDownloads

BPW is the encoded tensor-payload average across the complete text model, including its embedded MTP tensors, rounded to two decimals. The projector and FastMTP sidecar work with every text quant; download the projector only for image or video input.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#what-are-k_p-quantsWhat are K_P quants?

K_P (“Perfect”) quants are HauhauCS custom quantizations that use model-specific analysis to selectively preserve quality where it matters most. Every model gets its own optimized quantization profile.

A K_P quant effectively bumps quality up by one or two quant levels at only around 5–15% more size than the base quant. The files remain standard GGUFs and work with llama.cpp, LM Studio, and other GGUF-compatible runtimes with no special build or plugin.

**Note:**K_P quants may show as?in LM Studio’s quant column. This is a display issue only—the model loads and runs normally.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#specsSpecs

• Dense 27B causal language model with a vision encoder
• 64 language-model layers
• Hidden size 5,120; FFN size 17,408
• 248,320-token padded vocabulary
• 48 Gated DeltaNet layers and 16 gated-attention layers
• Native embedded MTP/NextN preserved, plus the HauhauCS FastMTP 32K acceleration profile
• 262,144-token native context; extensible up to 1,000,000 with framework-specific configuration
• Native text, image, and video understanding
• Based onQwen/Qwen3.8-27B

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#what-is-hauhaucs-fastmtpWhat is HauhauCS FastMTP?

HauhauCS FastMTP is the custom, variant-specific acceleration profile built for this exact Aggressive release: a compact 32K draft sidecar and per-quant serving profiles qualified for TG, acceptance, maximum native context, and VRAM.

It delivers**up to 3.02x document TG and 1.93x reasoning TG versus non-MTP, plus up to 35.2% more document TG and 21.1% more reasoning TG than the standard embedded-MTP profile.**The unchanged full target verifies every drafted token, so FastMTP accelerates generation without replacing the target model or changing its answers. The construction and selection methodology is exclusive to HauhauCS releases.

The benchmark ladder:

ComparisonDocument TGReasoning TGScopeStandard embedded MTP vs MTP disabled2.23x(\+123\.4%)1.60x(\+59\.6%)Final Q8_K_P, depth 2HauhauCS FastMTP profile vs standard embedded MTP**+35.2%+21.1%Final Q8_K_P, depth 3 vs depth 2HauhauCS FastMTP vs embedded MTP at identical depth+11.1%+18.2%Final Q8_K_P, depth 3HauhauCS FastMTP vs MTP disabled3.02x**(\+202\.0%)1.93x(\+93\.3%)Final Q8_K_P service These results were measured on one RTX PRO 6000 Blackwell 96 GB per isolated lane at204800configured context, full CUDA offload,\-\-no\-mmap, and the official reasoning sampler. FastMTP accelerates TG; PP is reported alongside it for a complete serving comparison.

There are two acceleration paths:

• **Embedded MTP:**use any target GGUF by itself with\-\-spec\-type draft\-mtpin a current upstream llama.cpp build.
• **HauhauCS FastMTP:**pair that same target withQwen3\.8\-27B\-Uncensored\-HauhauCS\-Aggressive\-FastMTP\-32K\.ggufand the HauhauCS runtime patch below.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#run-hauhaucs-fastmtpRun HauhauCS FastMTP

The compact draft uses a standard GGUFd2ttoken map plus a minimal Qwen3.8 runtime consumer. Build it once. The example below uses CUDA; for ROCm/HIP or Vulkan, replace\-DGGML\_CUDA=ONwith\-DGGML\_HIP=ONor\-DGGML\_VULKAN=ON. For CPU-only, omit the backend flag.

git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
git checkout 4df29be4f4c3673f428170fda944a5b19f743bb8

curl -L -o HauhauCS-FastMTP-llama.cpp.patch \
  https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF/resolve/main/HauhauCS-FastMTP-llama.cpp.patch
git apply --check HauhauCS-FastMTP-llama.cpp.patch
git apply HauhauCS-FastMTP-llama.cpp.patch

cmake -S . -B build -DGGML_CUDA=ON -DCMAKE_BUILD_TYPE=Release
cmake --build build --config Release -j"$(nproc)"

If draft loading reportsexpected 5120, 248320, got 5120, 32768, the FastMTP sidecar is correct but the executable is unpatched. Launch the freshly built\./build/bin/llama\-serverfrom this checkout.

Then serve any target quant with the one shared FastMTP sidecar:

MODEL=Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-Q4_K_P.gguf
DRAFT=Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-FastMTP-32K.gguf
DEPTH=3

CUDA_VISIBLE_DEVICES=0 ./build/bin/llama-server \
  --model "$MODEL" \
  --spec-draft-model "$DRAFT" \
  --spec-draft-ngl all \
  --spec-type draft-mtp \
  --spec-draft-n-max "$DEPTH" \
  --spec-draft-p-min 0 \
  --ctx-size 204800 \
  --parallel 1 \
  --batch-size 2048 \
  --ubatch-size 512 \
  --n-gpu-layers all \
  --split-mode none \
  --flash-attn on \
  --no-mmap \
  --temp 1.0 \
  --top-k 20 \
  --top-p 0.95 \
  --min-p 0 \
  --presence-penalty 0 \
  --repeat-penalty 1.0 \
  --jinja \
  --reasoning on \
  --reasoning-effort xhigh \
  --reasoning-preserve \
  --reasoning-format deepseek \
  --host 127.0.0.1 \
  --port 8080

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#rtx-pro-6000-blackwell-fastmtp-reference-speedsRTX PRO 6000 Blackwell FastMTP reference speeds

Three-run medians for the uncached 9.8K-token document fixture and three-case means for reasoning. Every FastMTP result reproduced the corresponding embedded-MTP output hashes.

QuantDepthPP tok/sDocument TGReasoning TGvs embedded n2, Doc / Reasonvs MTP-off, Doc / ReasonQ2_K_P33351.29213.95145.09+11.6% / +1.7%2.27x / 1.48xQ3_K_P33317.16216.15137.99+20.5% / +8.8%2.54x / 1.56xQ4_K_P33204.98187.26123.52+18.0% / +2.3%2.67x / 1.71xQ5_K_P32842.05168.29110.50+17.8% / +4.6%2.61x / 1.66xQ6_K_P33081.90156.57103.51+26.5% / +13.8%2.95x / 1.91xQ8_K_P33285.86138.1890.07+35.2% / +21.1%3.02x / 1.93xIQ2_M33050.94219.19135.00+13.8% / +0.4%2.33x / 1.39xIQ3_M33269.27204.98128.45+21.5% / +7.9%2.40x / 1.45xIQ3_XS33165.75210.64138.34+19.1% / +5.9%2.38x / 1.51xIQ4_XS33445.30211.09135.77+21.7% / +9.3%2.68x / 1.66x The full-window gate used the final scrubbed Q3_K_P and FastMTP files:190,000 uncached prompt tokens plus 64 generated tokens completed at 1613.81 PP tok/s and 131.81 TG tok/s, with 92.0% draft acceptance and no truncation inside the configured maximum native context.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#rtx-6000-ada-embedded-mtp-reference-speedsRTX 6000 Ada embedded-MTP reference speeds

Single-run reference results from the final public files at a configured max token context, full CUDA offload,\-\-no\-mmap, the official thinking sampler, and embedded MTP. The workload used an uncached 9.8K-token document-continuation prompt followed by 512 generated tokens.

QuantPP tok/sTG tok/sQ2_K_P1959.14121.88Q3_K_P1944.73112.76Q4_K_P1860.3492.60Q5_K_P1737.5183.25Q6_K_P1747.6072.89Q8_K_P1827.2959.00IQ2_M1884.83121.25IQ3_M1867.48108.45IQ3_XS1880.59111.77IQ4_XS1978.46104.25 With HauhauCS FastMTP enabled, the final Q3_K_P reached138.37 document TG and 87.95 reasoning TG on the same Ada—23.5% and 3.9% faster than the pinned Unsloth Q3 control.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#recommended-settingsRecommended settings

From theofficial Qwen3.8-27B model card:

Thinking mode (default):

• temperature=1\.0
• top\_p=0\.95
• top\_k=20
• min\_p=0\.0
• presence\_penalty=0\.0
• repetition\_penalty=1\.0
• reasoning\_effort=xhighfor the deepest reasoning

Instruct / non-thinking mode:

• temperature=0\.7
• top\_p=0\.80
• top\_k=20
• min\_p=0\.0
• presence\_penalty=1\.5
• repetition\_penalty=1\.0
• enable\_thinking=false

Qwen3.8 supportsxhigh,medium, andlowreasoning effort. Thinking and preserved reasoning are enabled by default in the official model contract.

Important:

• Use\-\-jinjafor the embedded chat template.
• Use the BF16 projector for Vision.
• The model’s native maximum is262144.
• Context length and KV precision have a large VRAM cost. Reduce context before reducing model quality if your workload does not need maximum native context.
• Keep default F16 K/V on the lower tiers unless memory pressure requires otherwise.

If your llama.cpp build does not recognize the reasoning or MTP flags, update it. Older builds may still load the GGUF but will not expose the full Qwen3.8 serving path.

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#turning-thinking-offTurning thinking off

Qwen3.8 uses thinking mode by default. Disable it when you want shorter, faster direct responses.

Example llama-server default for all requests:

--chat-template-kwargs '{"enable_thinking":false}'

Example per request through the OpenAI-compatible API:

{
  "model": "qwen3.8-27b-aggressive-q3",
  "messages": [{"role": "user", "content": "..."}],
  "chat_template_kwargs": {"enable_thinking": false}
}

Example for multi-turn agents, preserve prior reasoning context with:

{
  "chat_template_kwargs": {"preserve_thinking": true}
}

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#compatibilityCompatibility

• **llama.cpp:**recommended; use a current Qwen3.8/MTP-capable build
• **LM Studio, Jan, KoboldCpp, and other GGUF frontends:**base compatibility depends on their bundled llama.cpp version
• **Embedded MTP:**optional and stock-compatible in current llama.cpp
• **HauhauCS FastMTP:**optional; requires the sidecar andHauhauCS-FastMTP-llama.cpp.patch
• **Vision:**requires the separate BF16 projector
• **K_P display:**may appear as?in UIs that do not recognize the suffix

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#authenticityAuthenticity

Every GGUF is covered by the signed HauhauCS release manifest. Exact SHA-256 values identify byte-for-byte mirrors after renaming; canonical tensor fingerprints continue to identify HauhauCS tensors after metadata-only rewriting.

The FastMTP sidecar’s exact file SHA-256 is115e618e1f73cb50817ed5856f0551c6bf9c3d94df96f440eaca78dc63b8968b; its canonical tensor fingerprint is49e248e799f169b6ccc6a8127b9300a95f06cf3d96a8353266f5d457e81d1c87. The public-key DER fingerprint isf7be4a2335582ab7b2e393ca1c40ce70e483f1492c0f57b8c6e05d8a7223833c.

DownloadHauhauCS-RELEASE-MANIFEST.json, itssignature,FastMTP-PROVENANCE.json, itssignature, andHauhauCS-FastMTP-Ed25519-PUBLIC.pem, then verify:

openssl pkeyutl -verify -rawin -pubin \
  -inkey HauhauCS-FastMTP-Ed25519-PUBLIC.pem \
  -in FastMTP-PROVENANCE.json \
  -sigfile FastMTP-PROVENANCE.json.sig

openssl pkeyutl -verify -rawin -pubin \
  -inkey HauhauCS-FastMTP-Ed25519-PUBLIC.pem \
  -in HauhauCS-RELEASE-MANIFEST.json \
  -sigfile HauhauCS-RELEASE-MANIFEST.json.sig

https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF#other-modelsOther models

• HauhauCS models on Hugging Face

Qwen3.8-27B is released by Qwen under the Apache 2.0 license. This quantized Aggressive variant retains that license.