Chinese AI firms mixing different GPUs inside individual AI servers to combat GPU shortages from US sanctions
DigiTimes Asiareports that Chinese AI firms are implementing a multi-chip hybrid approach to improve AI capabilities. The multi-chip approach also brings several advantages. These include increasing LLM training speeds using multi-GPU parallel training, allowing more data to be processed simultaneously for better memory utilization, and reducing costs by not relying solely on expensive Nvidia chips. Chinese tech companies are bundling GPUs from different suppliers for their AI training needs to circumvent American sanctions limiting their access to advanced hardware....