Hugging Face Journal Club: AsyncOPD and How Stale Can On-Policy Distillation Be?

Description

This paper is doing something if I understand correctly that is very similar to what pipeline RL proposed for reinforcement learning which is where you want to basically have like really decoupled generators from learners from trainers um but you have the additional complexity…