GoldiMask selects tokens to reveal as context for fine-tuning diffusion language models; it improves learning by tailoring which tokens are masked and recovered.
Read the original at arxiv.org→arXiv:2609.38385v1 Announce Type: new Abstract: Supervised fine-tuning of discrete diffusion language models masks some response tokens and trains the model to recover their original values from the visible context....
Original headline: "Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting"
Coverage timeline
- Oct 1, 04:00 UTC arXiv cs.AI lead source Fine-Tuning Diffusion Language Models with Context Selection and Target Weighting