Q: Does DFlash (and PFlash) work with Heretic models?

Reddit r/LocalLLaMA News
llm-optimization heretic dflash inference-speed model-decensoring

Summary

The article discusses the potential compatibility of DFlash and PFlash multi-model speedup methods with Heretic, a tool used for model decensoring, while highlighting the performance benefits on models like Qwen3.6 and Gemma 4.

Z-Lab did some good work with speeding up output, while Luce managed to use smaller models of the same family to accelerate prefill... Since Heretic and other "smart ablation" tools can decensor a model, would they work with these multi-model speedup methods? P.S. Wish more people can get on the PFlash bandwagon since both Qwen3.6 and Gemma 4 have smaller models. 5-10x speedup seems ludicrous
Original Article

Similar Articles

Gemma 4 MTP vs DFlash on 1x H100: dense vs MoE results

Reddit r/LocalLLaMA

This benchmark compares Gemma 4's Multi-Token Prediction (MTP) and z-lab's DFlash speculative decoding methods on a single H100 GPU, showing MTP faster for dense models and DFlash faster for MoE models.

I tested DFlash2 for Qwen3.8 27B on a 5090

Reddit r/LocalLLaMA

The user tested DFlash2 on the Qwen3.8 27B model, reporting improved inference speeds for code generation but with increased memory usage compared to MTP.

DFlash and Spec V2 Decoding (14 minute read)

TLDR AI

Z Lab, SGLang, and Modal release DFlash, a new speculative decoding model for Qwen 3.5 397B-A17B that uses block diffusion and KV injection to achieve over 4x throughput improvement over baseline and 1.5x over native MTP.