# Beyond On-Policy vs. Off-Policy: At What Level Should LLM Agent Distillation Follow the Student?

**Published:** October 26, 2026
**Author:** Ya Gao, Zhengtao Zou, Pekka Marttinen
**Source:** arXiv — cs.AI
**Language:** en-US
**HTML:** https://aiqazaqstan.com/en/articles/beyond-on-policy-vs-off-policy-at-what-level-should-llm-agent-distillati

arXiv:2610.31918v1 Announce Type: new Abstract: Distilling interactive LLM agents requires choosing between teacher-generated demonstrations and student-generated experience, corresponding broadly to off-policy and on-policy distillation. While both have proven effective, we…

> From the original source: **arXiv — cs.AI**
> [Read full article at arXiv — cs.AI](https://arxiv.org/abs/2610.31918)

**Tags:** #arXiv

---

*AI Qazaqstan — non-commercial informational portal about AI in Kazakhstan. Machine translations and summaries are AI-generated.*