attention-ffn-disaggregation

Tag

Cards List
#attention-ffn-disaggregation

@haoailab: Can Attention-FFN Disaggregation still win on the newest rack-scale GPU systems? We built FastAFD, an open-source AFD r…

X AI KOLs Timeline · 4d ago Cached

FastAFD is an open-source serving system for Attention-FFN Disaggregation of MoE models on Blackwell NVL72, achieving 1.35-1.45× per-GPU decode throughput improvement over colocated MoE serving.

0 favorites 0 likes
← Back to home

Submit Feedback