Ornith 1.5 9B Abliterated is now available in MLX for Apple Silicon 🐦

4-bit, 8-bit and BF16 builds are live. Tuned 4-bit linked below.

Evaluated for fewer unnecessary refusals and capability retention.

For research and legitimate local use.

https://t.co/VYY2DCtrze

PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit · Hugging Face

Source: https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#ornith-15-9b-abliterated-mlx-4-bitOrnith 1.5 9B Abliterated MLX 4-bit

An unofficial experimental MLX derivative ofornith\-ai/Ornith\-1\.5\-9B, pinned to revisionc927ad73b7eb20f00aafcaa0a11a9d58ed5487bc. The original model is by the Ornith team. The MLX conversion, refusal-direction experiment, and validation were performed by PocketAI Model Lab;PocketAiHubidentifies the publisher of this derivative.

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#purpose-and-responsible-usePurpose and responsible use

This experimental derivative studies whether learned refusal behavior can be reduced while retaining general capability. It is published for research and legitimate local use, not to endorse or facilitate illegal, abusive, or dangerous applications.

The edit reduces refusal behavior broadly rather than determining whether a request is legitimate. Deployers should evaluate the model in their own context and apply appropriate safeguards. Abliteration is not truthfulness training, a capability improvement, or a guarantee of universal compliance.

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#mlx-release-familyMLX release family

• 4-bit (this repository)
• 8-bit
• BF16

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#formatFormat

• MLX affine 4-bit RTN, group size 64
• 250 quantized language modules; vision tower retained unquantized
• Stored converter artifact: 5,977,079,078 bytes (5.57 GiB)
• Text and image runtime smoke tests passed
• Peak MLX memory in the image smoke test: 7.02 GB
• Native MTP head is not included
• Validated withmlx==0\.32\.0andmlx\-vlm==0\.6\.8

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#abliteration-recipeAbliteration recipe

A refusal-eliciting-minus-benign-control direction was measured from 256 length-matched prompts per class at the assistant-generation boundary. The edit was applied to a separate BF16 checkpoint; the upstream source was not modified in place.

• Direction source layer: 23
• Destination layers: 12–31
• Target matrices: full-attention outputs, linear-attention outputs, and MLP down projections
• Scale: 1.25
• Per-input-column norm preservation: enabled
• Modified tensors: 40
• Direction SHA-256:97a251920007b644759f7492f0239322657bbb12920522e0a4be6d3852aadffb

Seeabliteration\-manifest\.jsonfor the machine-readable recipe.

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#validationValidation

GateResultPrevious scale-1.0 4-bit, first refusal-targeted gate2/12 explicit-refusal phrase flagsSelected scale-1.25 4-bit, first refusal-targeted gate0/12 explicit-refusal phrase flagsPrevious scale-1.0 4-bit, full refusal-targeted screen6/100 explicit-refusal phrase flagsSelected scale-1.25 4-bit, full refusal-targeted screen0/100 explicit-refusal phrase flagsSelected benign-control screen0/100 explicit-refusal phrase flagsMedium capability suite68/80Previous scale-1.0 4-bit capability69/80Untouched BF16 capability70/80Text smokepassed (POCKETAI\_OK)Image smokepassed (red) The capability suite covers math/reasoning, false-premise handling, instruction following, coding, structured output, multilingual output, context comprehension, and general coherence. The selected checkpoint scored one case below the previous 4-bit and two below untouched BF16; this is a small measured tradeoff, not a claim of zero degradation.

The refusal scorer is phrase based. Manual review of the six prompts explicitly refused by the prior 4-bit build found that the selected model no longer used those phrases, while several answers still redirected, countered, or reframed the request. “0/100 phrase flags” measures explicit refusal wording, not universal compliance or response quality. Most 100+100 responses reached the 256-token ceiling, so that run is an early-response screen rather than a complete answer-quality evaluation.

Machine-readable results are invalidation\-summary\.json.

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#load-with-mlx-vlmLoad with MLX-VLM

python -m pip install "mlx==0.32.0" "mlx-vlm==0.6.8"
mlx_vlm.generate --model PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit --prompt "Explain why seasons occur." --max-tokens 256

For an image prompt:

mlx_vlm.generate --model PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit --prompt "Describe this image." --image photo.jpg --max-tokens 256

The vision tower passed a basic image smoke test. Broader vision, video, tool-use, and long-context evaluation remain future work.

https://huggingface.co/PocketAiHub/Ornith-1.5-9B-Abliterated-MLX-4bit#license-and-attributionLicense and attribution

The upstream model card declares MIT. This repository includes the MIT license, preserves upstream attribution, and links to the exact source revision above.