AI Qazaqstan
Видео

Материал түпнұсқа тілінде: English.

Efficient Inference of Masked Diffusion Language Models on AMD XDNA2 NPU

Ravi Gupta, Shiksha Patel, and Rishi Madduri (AMD) will present “Efficient Inference of Masked Diffusion Language Models on AMD XDNA2 NPU” at #PyTorchCon North America 2026. Their poster presents a power-efficient deployment of LLaDA-8B-Instruct on an AMD NPU. On a Ryzen AI MAX+ 395 APU at sequence length 128, the NPU vendor path ran at 504 ms per forward at 36 W, compared with 843 ms and 110 W for CPU INT4, making it 1.67x faster and 8.9x better on energy. The poster will also cover the INT4 qu

2026 ж. 18 қазан · Дереккөз: YouTube — PyTorch Official

YouTube-те қарау →

Осы тақырыптан тағы