Optimizing Mixture of Experts LLM inference on ARM CPUs

Description

Hi, I'm Majid from Intel Research India, and I'm excited to be speaking at PyTorch Conference North America this October. I'll be talking about efficient mixture of experts LLM inference on using VLLM and OpenVINO, and how we can efficiently run these models on ARM CPUs. If…