USB4 RDMA seems doable
Summary
Experimental implementation of RDMA over USB4 demonstrated using Thunderbolt and Strix Halo, potentially enabling high-speed data transfer with any USB4 host.
Similar Articles
@zcbenz: MLX's implementation of RDMA (Remote Direct Memory Access) over Thunderbolt on macOS, can now be used as an independent…
MLX's RDMA-over-Thunderbolt implementation for macOS is now available as a standalone library, enabling high-speed Mac clusters for local AI workloads.
Exo labs claiming 4.8 tb/s memory bandwidth through m5u Mac Studio clustering
Exo labs claims to achieve 4.8 tb/s memory bandwidth through clustering Mac Studios using their RDMA solution, which could significantly boost AI inference performance. This Reddit discussion explores the implications for users considering hardware setups for AI workloads.
Deploying RDMA for Large-Scale Inference and Training Workloads
ByteDance and Fudan University researchers present ByteExpress, a software communication layer over RDMA for large-scale parameter-server inference and training, reporting up to 74% lower P99 push latency and significant CPU savings versus TCP in production deployments.
New 10 GbE USB adapters are cooler, smaller, cheaper
A review of new, smaller, cheaper 10 GbE USB adapters based on the RTL8159 chip, highlighting performance variability across different USB standards and recommending USB 3.2 Gen 2x2 ports for full speed.
Framework's 10G Ethernet module exposes USB-C's complexity
Jeff Geerling tests the WisdPi 10G Ethernet Expansion Card for Framework computers, finding that USB-C bandwidth complexities and the Realtek RTL8159 controller limit performance on many laptops, especially under Linux.