Where the Blocks Live: Tier-Aware KV-Cache Routing for vLLM at Scale

Description

Hi, I'm Pongup Pak from War at PyTorch Conference North America 2026. I'm presenting a poster called where the block lives. When GPU memory fmflows the KB cache to CPU or storage and LMD tracks where every block lives and sends each request to its cache. You will see when CPU is…