Posterior Matching Distillation
Summary
A research paper titled 'Posterior Matching Distillation' (arXiv:2611.26629) introducing a distillation approach based on matching posterior distributions. No linked models, datasets, or Spaces have cited it yet on Hugging Face.
View Cached Full Text
Cached at: 11/20/26, 07:35 AM
Paper page - Posterior Matching Distillation
Source: https://huggingface.co/papers/2611.26629 Get this paper in your agent:
hf papers read 2611\.26629
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2611.26629 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2611.26629 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2611.26629 in a Space README.md to link it from this page.
Collections including this paper1
Similar Articles
Dataset Distillation by Influence Matching
This paper introduces Influence Matching (Inf-Match), a dataset distillation method that aligns the final training outcome by learning a compact synthetic set whose effect on converged parameters matches that of the full dataset. It achieves state-of-the-art accuracy on classification benchmarks and outperforms strong baselines on vision-language distillation tasks.
eDMD: Endpoint Distribution Matching for Few-Step Diffusion Distillation
eDMD proposes Endpoint Distribution Matching Distillation, which trains a shared fake model only on the student's final outputs and adds precise teacher supervision, achieving improved 4-step diffusion distillation on SD3-Medium, FLUX.2-klein, and Qwen-Image-2.1.
Any-OPD: Heterogeneous On-Policy Distillation for Flow-Matching Models via Representation-Space Bridging
Any-OPD presents the first framework for on-policy distillation between arbitrary latent flow-matching generators, enabling distillation from a 12B FLUX model to a 2.5B SD3.5 model by bridging via a frozen vision representation. It improves the student's PickScore from 0.846 to 0.884, rivaling the teacher at a fifth of its size.
On-policy distillation: one of the hottest terms on PapersWithCode [R]
Hugging Face's Niels introduces On-policy Distillation (OPD), a key post-training technique used in models like Qwen 3.6/3.7, GLM-5.1, and DeepSeek-V4, now featured on PapersWithCode with a linked whiteboard explanation by Sasha Rush and Dwarkesh Patel.
[2606.05682] Beyond Output Matching: Preserving Internal Geometry in NVFP4 LLM Distillation
This paper studies quantization-aware distillation for NVFP4 low-precision LLMs and finds that output-matching with KL loss alone can mask internal representational drift. The authors propose CKA-QAD, which preserves internal geometry via CKA-guided alignment, improving reasoning and coding accuracy in compact models.