chinchilla

Tag

Cards List
#chinchilla

Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers

Hugging Face Daily Papers · 2d ago Cached

This paper introduces Chimera, a hybrid visual diffusion backbone with a principled scaling recipe, combining Kimi Delta Attention, Multi-head Latent Attention, and sparse Mixture-of-Experts to efficiently handle long-context image and video generation. It also presents HeteroP, a module-wise hyperparameter transfer scheme, and Chinchilla-style scaling laws to train an 11B-parameter model with 2B activated parameters.

0 favorites 0 likes
← Back to home

Submit Feedback