Researchers claim to have developed a new way to run AI language models more efficiently by eliminating matrix multiplication from the process. This fundamentally redesigns neural network operations ...

Researchers from the USA and China have presented a new method for optimizing AI language models. The aim is for large language models (LLMs) to require significantly less memory and computing power ...

Matrix multiplication is at the heart of many machine learning breakthroughs, and it just got faster—twice. Last week, DeepMind announced it discovered a more efficient way to perform matrix ...

A new technical paper titled “Scalable MatMul-free Language Modeling” was published by UC Santa Cruz, Soochow University, UC Davis, and LuxiTech. “Matrix multiplication (MatMul) typically dominates ...