Видео

Local AI 301: Quantization

Learn about quantization in this livestream and get started with quantization using llama.cpp and vLLM. Program: - Introduction to Quantization, Merve Noyan, Hugging Face - Calibration based quantization, Colin Kealty (aka bartowski), RedHat - Quantization Aware Distillation, Maxime Labonne, Aditya Tadimeti, LiquidAI - Fast Microscaling Formats on Any GPU with vLLM, Michael Goin, RedHat

5 November 2026 · Source: YouTube — Hugging Face

Watch on YouTube →

More in this topic