Astana time
AI QAZAQSTANKZ · AIBeta

Smart portal about artificial intelligence and high technology in Kazakhstan

← Back to video hub

YouTube • YouTube — DeepLearning.AI

Optimize, deploy, and benchmark an open-source LLM with vLLM

6 days ago

Description

I'm thrilled to introduce this course on fast and efficient LLM inference, built in partnership with Red Hat, and taught by Sergey Kliger. Deploying open source LLMs efficiently, so they can serve many users at once with low latency and reasonable cost, is challenging. In this…