@zcbenz: MLX's implementation of RDMA (Remote Direct Memory Access) over Thunderbolt on macOS, can now be used as an independent…

X AI KOLs Following Tools

Summary

MLX's RDMA-over-Thunderbolt implementation for macOS is now available as a standalone library, enabling high-speed Mac clusters for local AI workloads.

MLX's implementation of RDMA (Remote Direct Memory Access) over Thunderbolt on macOS, can now be used as an independent library by anyone: https://github.com/ml-explore/mlx/tree/main/mlx/distributed/jaccl/lib… It is the gem that powers Mac clusters for local AI, and is an order of magnitude faster than protocols over TCP.
Original Article

Similar Articles

New MLX LM Server From Apple

Reddit r/LocalLLaMA

Apple's MLX team introduces MLX LM Server, a tool for running AI agent workflows fully locally on Mac, supporting continuous batching, distributed inference, and M5 neural acceleration, with no need for cloud or API keys.