Artificial intelligence has grown so large and power hungry that even cutting edge data centers strain to keep up, yet a technique borrowed from quantum physics is starting to carve these systems down ...

The Google Tensor G4 on the Pixel 9 phones performs poorly on the Geekbench CPU test, despite packing the latest ARM cores. The older ARM Mali-G715 GPU on the Tensor G4 is also pretty weak, ...

Hi, thanks for your great work on Transformer Engine! I am working on a project that requires high-performance batched matrix multiplication (i.e., 3D tensor multiplication) where all inputs are ...

Abstract: We investigate the performance of algorithms for sparse tensor-sparse tensor multiplication (SpGETT). This operation, also called sparse tensor contraction, is a higher order analogue of the ...

Last year, I wrote about the massive energy costs of AI and General Purpose Transformers like ChatGPT. The AI capabilities are amazing, but the energy and environmental cost is concerning. To ...

Parallel computing continues to advance, addressing the demands of high-performance tasks such as deep learning, scientific simulations, and data-intensive computations. A fundamental operation within ...

This time, groundbreaking news came from China in the world of science and technology. China has developed the world’s first carbon nanotube-based tensor processor chip (TPU). The team led by Peng ...