model-architectures

#model-architectures

The Limits of Speculation: Bounding Speculative Decoding in Mixture-of-Experts

arXiv cs.LG ↗ · 2026-09-22 Cached

This paper formulates speculative decoding in Mixture-of-Experts models as a Stochastic Shortest Path problem and uses a diagnostic Oracle to demonstrate that optimal decisions follow a necessary condition balancing cost and progress.

0 favorites 0 likes

#model-architectures

@_avichawla: 8 AI model architectures, visually explained: There's a tendency to treat LLMs as the whole field. But they're one fami…

X AI KOLs Timeline ↗ · 2026-06-09 Cached

A visual breakdown of 8 major AI model architectures including LLMs, VLMs, MoE, SLMs, and more, plus a bonus mention of recursive language models from MIT.

0 favorites 0 likes

model-architectures

The Limits of Speculation: Bounding Speculative Decoding in Mixture-of-Experts

@_avichawla: 8 AI model architectures, visually explained: There's a tendency to treat LLMs as the whole field. But they're one fami…

Submit Feedback