MTP is up, test it out https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP…

Mia-AiLab/Qwable-3.6-27b-MTP · Hugging Face

Source: https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP

Qwable 27Bis a full Hugging Face checkpoint fine-tuned fromqwen/Qwen3\.6\-27Bon a cleaned Fable 5-style reasoning and instruction dataset.

The goal of this model is simple: take a strong Qwen 27B base and push it toward more deliberate, structured, trace-like assistant behavior, especially for code, technical reasoning, and instruction-following workflows.

This isnota LoRA adapter. This repository contains thefull fine-tuned model checkpoint.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#highlightsHighlights

• Base:qwen/Qwen3\.6\-27B
• **Checkpoint type:**full HF model checkpoint
• **Training style:**instruction tuning with trace/reasoning-style examples
• **Dataset:**cleaned Fable 5 reasoning/instruction dataset
• **Primary focus:**coding, structured answers, technical assistance, and local inference
• **MTP:**present in this checkpoint
• **Local-friendly goal:**designed with downstream GGUF conversion in mind

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#model-summaryModel summary

FieldValueBase modelqwen/Qwen3\.6\-27BArchitectureQwen3\_5ForConditionalGenerationModel typeqwen3\_5Checkpoint typeFull HF checkpointPEFT / LoRANoMTP layerspresentTraining styleInstruction + trace-style fine-tuningPrimary useCode, reasoning, structured assistant responses

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#what-this-model-is-good-atWhat this model is good at

Qwable 27B was tuned to be useful in workflows where you want the model to produce more organized and thoughtful responses.

It is intended for:

• structured instruction following
• code-focused generation and editing
• echnical debugging assistance
• trace-style assistant responses
• reasoning-heavy prompts
• local model experimentation
• downstream conversion to GGUF for llama.cpp, LM Studio, or other local runtimes

The model should feel different from the base checkpoint in style: more guided, more explanatory, and more oriented toward step-by-step task completion.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#how-to-useHow to use

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#transformersTransformers

from transformers import AutoTokenizer, Qwen3_5ForConditionalGeneration
import torch

model_id = "your-org-or-username/Qwable-27B"

tokenizer = AutoTokenizer.from_pretrained(
    model_id,
    trust_remote_code=True,
)

model = Qwen3_5ForConditionalGeneration.from_pretrained(
    model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
    trust_remote_code=True,
)

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#simple-generation-exampleSimple generation example

messages = [
    {
        "role": "user",
        "content": "Write a Python function that validates a JSONL training file for chat messages."
    }
]

text = tokenizer.apply_chat_template(
    messages,
    tokenize=False,
    add_generation_prompt=True,
)

inputs = tokenizer(text, return_tensors="pt").to(model.device)

outputs = model.generate(
    **inputs,
    max_new_tokens=1024,
    temperature=0.6,
    top_p=0.95,
)

print(tokenizer.decode(outputs[0], skip_special_tokens=True))

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#suggested-generation-settingsSuggested generation settings

These are starting points only. Tune them for your runtime and use case.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#balancedBalanced

temperature: 0.6
top_p: 0.95
min_p: 0.02
max_new_tokens: 1024-4096

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#more-deterministic-codingMore deterministic coding

temperature: 0.2-0.4
top_p: 0.9
max_new_tokens: 2048-4096

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#more-creative-reasoningMore creative reasoning

temperature: 0.7-0.9
top_p: 0.95
max_new_tokens: 2048-8192

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#gguf–local-inference-notesGGUF / local inference notes

This checkpoint is intended to be convertible to GGUF for local inference.

Important notes:

• This checkpoint hasMTP layers.
• Use the model as a normal Qwen-style causal LM checkpoint.
• When converting to GGUF, validate the converted model before publishing.
• Always test text generation before assuming the conversion is correct.

Recommended validation prompts after conversion:

Explain what this model is in 3 short paragraphs.

Write a Python script that reads a JSONL file and checks that every row has a messages array.

You are given a broken Docker Compose file. Explain how you would debug it step by step.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#intended-useIntended use

Qwable 27B is intended for research, experimentation, local inference, and assistant-style workflows.

Good use cases include:

• coding assistants
• technical writing
• debugging help
• local agent experiments
• instruction-following benchmarks
• reasoning-style assistant responses
• synthetic data experiments

This model isnotguaranteed to be safe, correct, or production-ready without additional evaluation.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#limitationsLimitations

Like all fine-tuned language models, Qwable 27B can produce incorrect, incomplete, or misleading outputs.

Known limitations:

• It may inherit limitations from the base model.
• It may reflect biases or artifacts from the training dataset.
• It may produce confident but incorrect technical answers.
• It may differ from the base model in safety behavior, refusal behavior, and writing style.
• It has not been validated for high-stakes use cases.

Always verify outputs before using them in production, security-sensitive, medical, legal, financial, or safety-critical environments.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#reproducibilityReproducibility

Training and export tooling live in the DSv4-Tune workflow that produced this checkpoint.

The fine-tuning path uses:

data/processed/train.jsonl

This file contains the normalized chat-format training examples used for the run.

Recommended reproducibility checklist:

• verify the base model revision
• verify the tokenizer files
• verify the processed JSONL dataset
• keep the training config
• record the exact export command
• test the exported checkpoint before conversion
• test the converted GGUF separately if publishing local builds

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#namingNaming

Qwable= Qwen + Fable.

The name reflects the goal of the model: combining the Qwen 27B base with Fable-style reasoning and assistant traces.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#licenseLicense

The repository metadata and training/export files are released under the MIT license.

The underlying base model,qwen/Qwen3\.6\-27B, may have its own license terms. Users are responsible for reviewing and complying with the base model license and any dataset license requirements before using, modifying, or redistributing this checkpoint.

https://huggingface.co/Mia-AiLab/Qwable-3.6-27b-MTP#disclaimerDisclaimer

This is an experimental fine-tuned model.

It is provided for research and local experimentation. No warranty is provided. Validate carefully before using it in real-world deployments.It is intended for:

Mia (@MiaAI_lab): I’ve published Qwable 3.6 27b to HF

Qwable = Qwen + Fable.

Based on Qwen 27B with Fable-style reasoning and assistant traces.

Grab it now and test it yourself.