Tag
IT vendor Core 4 Solutions listed a decommissioned 300-rack AI supercomputer on eBay for $59.7 million, featuring 9,600 Nvidia A100 GPUs and 4,200 AMD EPYC Rome CPUs, with free shipping available via FedEx Ground.
The author, as part of a 100-part GPU learning series, reviews a GTC 2020 lecture by Andrew Kerr on developing high-performance CUDA kernels for Tensor Cores on NVIDIA A100, discussing techniques and the trade-off between raw CUDA and CUTLASS.