# Integrating RCCL GPU-Initiated Networking into TorchTitan’s MoE Communication

**Published:** October 14, 2026
**Author:** PyTorch
**Source:** YouTube — PyTorch Official
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/integrating-rccl-gpu-initiated-networking-into-torchtitan-s-moe-communic

Hi, I'm Rishi from AMD. Within distributed training, communication is one of the primary bottlenecks, and limiting the time spent on communication can massively boost end-to-end performance. We investigate this hypothesis by integrating work from the Rickle team to use…

> From the original source: **YouTube — PyTorch Official**
> [Read full article at YouTube — PyTorch Official](https://www.youtube.com/watch?v=5AK6hHW-ZxM)

**Tags:** #GPU & Суперкомпьютеры #YouTube

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*