Optimize, deploy, and benchmark an open-source LLM with vLLM

Описание

I'm thrilled to introduce this course on fast and efficient LLM inference, built in partnership with Red Hat, and taught by Sergey Kliger. Deploying open source LLMs efficiently, so they can serve many users at once with low latency and reasonable cost, is challenging. In this…