Nvidia BlueField-4 STX adds a context memory layer to storage to close the agentic AI throughput gap

Nvidia's BlueField-4 STX reference architecture inserts a dedicated context memory layer between GPUs and traditional storage, claiming 5x token throughput and 4x energy efficiency for agentic AI ...

Nvidia says it can shrink LLM memory 20x without changing model weights

Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.

AMD Medusa Point leak hints at more Zen 6 cores, higher cache, and performance boost

AMD’s Zen 6 “Medusa Point” laptop CPU has appeared in Geekbench, revealing a 10-core design and early performance details. The post AMD Medusa Point leak hints at more Zen 6 cores, higher cache, and ...
Carnegie Mellon University

How CMU Is Curbing Energy Demands From AI Data Centers

Researchers at Carnegie Mellon University are developing new technology that could lower how much energy data centers need to operate, reducing the strain on the energy grid that Americans rely on.