Hugging Face Journal Club: Direct On-Policy Distillation

Description

Okay, so this is quite um interesting paper and a bit uh surprising that uh how it works, but uh basically the idea is that uh in post-training, you have usually uh a pipeline where you have a model and then you uh run RL over that model. And ideally that uh post-RL model should…