huff12 - a 12-stream Huffman decoder for Apple Silicon
Summary
huff12 is a 12-stream Huffman decoder optimized for Apple Silicon processors, aiming to improve decoding performance through parallel stream processing.
Similar Articles
harshatheg/Qwen-2.5-1B-RLCD
A high-throughput inference engine for structured information extraction on Apple Silicon using MLX, offering parallel constrained decoding with 5.6x to 7.0x latency reductions and 100% schema validity.
SOTA Apple Silicon Inference (August 15, 2026)
The author conducted a two-week investigation into AI inference optimizations on Apple Silicon and found the software ecosystem fragmented, with critical features like prefix caching and speculative decoding missing, suggesting consolidation around frameworks like vllm-metal.
Antirez/h3.c: MiniMax H3 inference engine for Mac computers
Antirez's h3.c is a native Minimal inference engine for MiniMax-H3 on Apple Silicon, providing a fast, end-to-end prompt-to-video/audio pipeline with Metal optimizations and an interactive session. It is currently focused on performance and memory optimization for M3 Max and M5 Max.
Optimizing On-Device Inference for Apple Silicon (20 minute read)
Apple's Lily engine optimizes on-device LLM inference for Apple silicon by leveraging unified memory and hardware, outperforming MLX-LM, and is tuned for the Qwen3.6-35B-A3B model's architecture.
Qwen3.8-27B is now up to ~3× faster on Apple Silicon with mlx-dspark
mlx-dspark v0.10.0 adds support for Qwen3.8-27B on Apple Silicon, providing up to 3x faster inference through speculative decoding with lossless verification.