Inkling 2 mini uncensored

Reddit r/LocalLLaMA Models

Summary

OpenUncensored released Inkling 2 Mini Uncensored, an abliterated version of Thinking Machines' 26B MoE model with refusals removed while preserving MMLU performance (78.95% → 79.47%), available on Hugging Face, an OpenAI-compatible API, and a browser playground.

No content available
Original Article
View Cached Full Text

Cached at: 11/20/26, 11:52 PM

OpenUncensored/Inkling-2-Mini-Uncensored · Hugging Face

Source: https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#inkling-2-mini-uncensored-abliteratedInkling 2 Mini Uncensored (abliterated)

Inkling 2 Mini UncensoredisThinking Machines’ Inkling 2 Mini(26B total, 3.4B active, text and image input, 1M token context) with its refusals removed by directional ablation (abliteration). It answers the requests the original refuses, in both chat and thinking mode, and keeps its MMLU:78.95% → 79.47%. Made byOpenUncensoredon release day.

**Use it without a GPU:**Inkling 2 Mini Uncensored is available for inference on theOpenUncensored APIasinkling\-2\-mini\-uncensored(OpenAI compatible, no account needed), and in the browser in theOpenUncensored playground.

Same files, format and size as the original checkpoint (about 20 GB: routed experts in NVFP4 and MXFP8, everything else BF16), so it runs anywhere the original runs, including a single consumer GPU or a DGX Spark. Only the 20 attention output projections changed; the 128 experts per layer, the vision encoder and the DSpark speculator are byte for byte the original.

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#use-it-through-the-apiUse it through the API

curl https://api.openuncensored.com/v1/chat/completions \
  -H "Authorization: Bearer $OU_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"model": "inkling-2-mini-uncensored",
       "messages": [{"role": "user", "content": "Explain SQL injection with a working example."}]}'
from openai import OpenAI
client = OpenAI(base_url="https://api.openuncensored.com/v1", api_key="ou-...")
r = client.chat.completions.create(model="inkling-2-mini-uncensored",
                                   messages=[{"role": "user", "content": "Hello"}])
print(r.choices[0].message.content)

It reads images, calls tools and returns its reasoning separately (reasoning\_content). Setreasoning\_effortto"none"for short answers. Prepaid keys atopenuncensored.com/credits. Price: $0.15 per million input tokens and $0.60 per million output tokens. How it compares with other uncensored models:OpenUncensored rankings.

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#resultsResults

Same harness for both models, greedy decoding, measured on these exact files (no hooks).

Inkling 2 MiniInkling 2 Mini UncensoredRefusals on 32 harmful prompts, chat mode320Refusals on 32 harmful prompts, thinking mode (effort 0.9)320¹Refusals on 80 prompts (32 harmful, 48 gray area), chat mode688²Full, specific answers to the 32 harmful prompts (LLM judge)021MMLU (57 subjects x 20, 1,140 questions, letter logits)78.95%79.47% ¹ 29 of 32 finished thinking within 1,536 tokens. None of the 29 refused. ² 7 of the 8 are limits, not refusals (“I can’t know what’s happening inside your head”, “I don’t have access to Tetrasoft’s budget documents”). The eighth, a self-harm request, gets crisis resources.

A refusal is an answer that opens with “I can’t”, “I won’t”, “I’m sorry” and similar. With 32 to 80 prompts per test, treat differences of a few prompts as noise. Long agent tasks and coding benchmarks are not measured yet.

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#how-it-was-madeHow it was made

Inkling 2 Mini is aloopedmixture-of-experts transformer: 24 layers, and the middle 12 (layers 6 to 17) run three times per token with shared weights, so each token makes 48 layer visits. That loop is why the usual abliteration recipe needed changes.

  1. **Refusal directions.**The output of each of the 48 layer visits at the last prompt token, for 256 harmful and 256 harmless prompts, at thinking effort 0 and 0.9. Then the difference of means per visit and effort. The two efforts agree closely (cosine 0.92 or more over the first 36 visits).
  2. A late refusal subspace.The top two singular vectors of those directions over thesecond half of the visits(24 to 47). Directions from all visits also removed refusals, but the edited model then often misread a harmful request as harmless (“this is a general educational question”) and answered vaguely. The late subspace keeps the model’s reading of the request and removes the decision to refuse.
  3. Where to edit: attention outputs only.Qis projected out of what each attention layer writes (attn\.wo\_ud, BF16):W' = W \- s Q Qᵀ Won layers 4 to 23, with s = 4.0 on layers 4, 5 and 18 to 23 and s = 2.5 on the loop core (layers 6 to 17). Because the loop runs layers 6 to 17 three times, the same edit there acts three times per token, so it is gentler inside the loop.
  4. **Why not the experts.**Edits that also changed the MoE down-projections were no better. With directions from all visits they cost 4 to 6 MMLU points, and the gentler versions that kept MMLU removed refusals no better than attention alone. The experts are also stored in NVFP4, where re-encoding a small edit adds noise about twice the size of the edit itself (7% of the weight norm for an edit of 3%). Attention-only edits are exact in BF16 and leave every expert byte for byte the original.
  5. **Testing before writing.**During the search the edit ran as forward hooks on the attention output projections, which gives exactly the same result as editing the weights. The results above are from the baked files.

edit\.ptin this repo holdsQand the per-layer strengths, so the edit can be reapplied to the original weights or studied.

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#run-it-locallyRun it locally

Exactly like the original checkpoint: point your runtime at this repo instead ofthinkingmachines/Inkling\-2\-Mini.

  • **SGLang:**thelmsysorg/sglang:inkling\-2\-miniimage; see theSGLang Inkling 2 Mini cookbook(verified on a single RTX PRO 6000, RTX 5090 or DGX Spark, and on H200 and GB300 nodes). We serve it on one RTX PRO 6000.
  • **vLLM:**theInkling 2 Mini recipe, once vLLM’s Inkling 2 Mini support is released (it was still a pull request on release day).
  • **Transformers:**install from the Inkling 2 Mini pull request (huggingface/transformers#51050) until a release includesinkling2\_loop. It dequantizes the experts to BF16 (about 53 GB).
sglang serve --model-path OpenUncensored/Inkling-2-Mini-Uncensored --tp 1 --attention-backend fa4 \
  --dtype bfloat16 --page-size 128 --enable-multimodal --reasoning-parser inkling --tool-call-parser inkling2

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#more-from-openuncensoredMore from OpenUncensored

https://huggingface.co/OpenUncensored/Inkling-2-Mini-Uncensored#disclosure-and-responsibilityDisclosure and responsibility

Made by OpenUncensored, which runs an API for uncensored models. This model follows instructions it would otherwise refuse, including harmful ones. You are responsible for how you use it and for complying with the law where you are. It keeps the Apache 2.0 license of the original. Credit for the model goes to Thinking Machines; the method builds on refusal-direction research by Arditi et al. and the abliteration work of the open model community.

Similar Articles

Inkling 2 Mini

Hacker News Top

Thinking Machines releases Inkling 2 Mini, a 26.4B-total/3.4B-active open-weights Mixture-of-Experts looped transformer that runs in ~20GB on laptops and leads sub-100B models on agentic coding benchmarks like DeepSWE v1.1. A research variable-loop variant is released alongside it to study monitorability, showing improved no-CoT time horizons and legible chain of thought without increased sabotage tendencies.

thinkingmachines/Inkling-2-Small

Hugging Face Models Trending

Thinking Machines Lab released Inkling 2 Small, an open-weights general-purpose multimodal model (text+image input, text output) aimed at developers building agentic, coding, chatbot and RAG applications, with NVFP4/MXFP8 checkpoints and broad inference and post-training toolchain support.

Inkling-Small (4 minute read)

TLDR AI

Thinking Machines released Inkling-Small, an efficient open-weights Mixture-of-Experts model with 276B total and 12B active parameters, achieving comparable performance to its larger sibling Inkling at a quarter of the size. It features native reasoning over audio and images, variable thinking effort, and a 1M-token context window.