← Back to video hub
YouTube • YouTube — DeepLearning.AI
Optimize, deploy, and benchmark an open-source LLM with vLLM
6 days ago
Description
I'm thrilled to introduce this course on fast and efficient LLM inference, built in partnership with Red Hat, and taught by Sergey Kliger. Deploying open source LLMs efficiently, so they can serve many users at once with low latency and reasonable cost, is challenging. In this…