Alibaba Cloud says it cut Nvidia AI GPU use by 82% with new pooling system
tomshardware.comAlibaba Cloud claims its new Aegaeon pooling system reduces the number of Nvidia GPUs required to serve large language models by 82% during a multi-month beta test inside its Model Studio marketplace. The result, published in a peer-reviewed paper presented … Read more