PyTorch is developing a new communication backend that leverages Thunderbolt interfaces to enable high-speed data transfer for distributed model training and inference on macOS devices.
This development targets the growing need for efficient multi-GPU or multi-Apple Silicon cluster setups where Thunderbolt provides significantly higher bandwidth than standard networking options.
The addition aims to improve performance for users running distributed workloads across multiple Macs connected via Thunderbolt.