gpu-characterization

Tag

Cards List
#gpu-characterization

Serving Masked Diffusion LLMs: Characterization and Design Principles from Real Hardware

arXiv cs.AI · 3d ago Cached

This paper characterizes the serving behavior of masked diffusion language models (dLLMs) using real hardware measurements, identifying key differences from autoregressive models and deriving design principles for efficient inference systems.

0 favorites 0 likes
← Back to home

Submit Feedback