The AI Memory Wall: Why LLMs & AI Accelerators Hit a Bottleneck

Description

Hello everyone, over the past two decades, the compute capabilities of single chips have grown about 6,000 times. You would expect that workloads would be six times as fast, but this is not the case. Often engineers, when they profile their workloads, they don't see much…