阿斯塔纳时间
AI QAZAQSTANKZ · AI测试版

哈萨克斯坦人工智能与高科技领域的智能门户

Research1 分钟阅读

内容来自原始来源:

arXiv — cs.AI

在 arXiv — cs.AI 阅读全文

本内容来自公开来源。若发布内容影响您的权利 → 申请删除信息

标题为英语Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting

Supervised fine-tuning of discrete diffusion language models masks some response tokens and trains the model to recover their original values from the visible context. The masking pattern therefore determines both the context available to the model and the tokens it learns to…

arXiv — cs.AI作者: Loay Mualem, Llu\'is Pastor-P\'erez, Vinh Tong, Andrei Manolache, Tanja Bien, Steffen Staab, Mathias Niepert2026年10月1日 (10月1日)
提供 1 种语言版本

AI 摘要:要点

  • Supervised fine-tuning of discrete diffusion language models masks some response tokens and trains the model to recover their original values from the visible context
  • The masking pattern therefore determines both the context available to the model and the tokens it learns to…
Research
KZ·AI ADC0
Инсайт дня

Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting

标签:#arXiv
Поделиться:

相关文章

返回列表