visual-distillation

Tag

Cards List
#visual-distillation

Accelerating Visual On-Policy Distillation with Batched Speculative Jacobi Rollouts

arXiv cs.LG · 2026-08-20 Cached

This paper introduces HB-SJD, a batched speculative Jacobi decoding method for visual on-policy distillation that accelerates rollout generation by processing multiple tokens in parallel, reducing training time while preserving generation quality.

0 favorites 0 likes
#visual-distillation

Self-Supervised Visual On-Policy Distillation

Hugging Face Daily Papers · 2026-08-14 Cached

The paper introduces S^2VOPD, a self-supervised method that improves vision-language models by distilling from original images into strongly augmented student views, achieving performance surpassing GPT-5.4 on benchmarks.

0 favorites 0 likes
← Back to home

Submit Feedback