Tag
The tweet discusses Microsoft AI's use of Ray actors for training the MAI-Thinking-1 model, enabling finer granularity for heterogeneous compute and better CPU resource utilization in GPU clusters.
OpenInfer demonstrates "vertical disaggregation" that boosts Qwen 3.5 27B throughput by ~50% by co-executing quantized layers across a single node’s AMD EPYC CPU and Nvidia L40S GPU with a custom SLA-aware scheduler.