IndexCache, a new sparse attention optimizer, delivers 1.82x faster inference on long-context AI models

Researchers at Tsinghua University and Z.ai built IndexCache to eliminate redundant computation in sparse attention models ...

Google reveals algorithms to address AI memory challenges; memory and storage stocks drop

Google unveils TurboQuant, PolarQuant and more to cut LLM/vector search memory use, pressuring MU, WDC, STX & SNDK.
Science Daily

Study shows addressing working memory can help students with math difficulty improve word problem-solving skills

Working memory is like a mental chalkboard we use to store temporary information while executing other tasks. Scientists worked with more than 200 elementary students to test their working memory, ...
Decrypt

Google Shrinks AI Memory With No Accuracy Loss—But There's a Catch

The technique reduces the memory required to run large language models as context windows grow, a key constraint on AI ...