parallel-token-generation

Tag

Cards List
#parallel-token-generation

Orthrus: Memory-Efficient Parallel Token Generation via Dual-View Diffusion

Hugging Face Daily Papers ↗ · 2026-05-12 Cached

Orthrus is a dual-architecture framework that combines autoregressive LLMs with diffusion models for fast parallel token generation while maintaining exact inference fidelity via shared KV caches and consensus mechanisms, achieving up to 7.8x speedup.

0 favorites 0 likes
← Back to home

Submit Feedback