@anton_lozhkov: It’s really frustrating that @RiversHaveWings @StefanABaumann @Birchlabs et al’s HDiT arch (and NATTEN in general) does…

X AI KOLs Timeline Models

Summary

A tweet thread advocating for wider adoption of the HDiT architecture and NATTEN, highlighting its significant speed improvements in super-resolution, image restoration, and genome labeling.

It’s really frustrating that @RiversHaveWings @StefanABaumann @Birchlabs et al’s HDiT arch (and NATTEN in general) doesn’t have a much wider adoption + It has been the main workhorse of my super-resolution and image restoration experiments for years. + It improved the throughput 11x on our genome labeling project at HF. + It will likely work great for a GroundingDINO-style fine segmentation pipeline I’m trying out. Seriously everyone, stop killing your model capacity and convergence speed with convolutional layers in UNet transformers, learn from HDiT!
Original Article
View Cached Full Text

Cached at: 07/16/26, 08:15 AM

It’s really frustrating that @RiversHaveWings @StefanABaumann @Birchlabs et al’s HDiT arch (and NATTEN in general) doesn’t have a much wider adoption

  • It has been the main workhorse of my super-resolution and image restoration experiments for years.
  • It improved the throughput 11x on our genome labeling project at HF.
  • It will likely work great for a GroundingDINO-style fine segmentation pipeline I’m trying out.

Seriously everyone, stop killing your model capacity and convergence speed with convolutional layers in UNet transformers, learn from HDiT!

Project page: https://crowsonkb.github.io/hourglass-diffusion-transformers/…

Similar Articles

Lite3R: A Model-Agnostic Framework for Efficient Feed-Forward 3D Reconstruction

Hugging Face Daily Papers

Lite3R is a model-agnostic framework that improves the efficiency of transformer-based 3D reconstruction using sparse linear attention and FP8-aware quantization. It reduces latency and memory usage by up to 2.4x while maintaining geometric accuracy on backbones like VGGT and DA3-Large.