Multi-Draft On-Policy Distillation for Diffusion Drafters
arXiv:2610.37778v1 Announce Type: new Abstract: Speculative decoding is used to reduce the inference cost of language models. One-step diffusion drafters propose a block of multiple tokens in parallel, reducing the sequential cost of speculative decoding. On-policy distillation trains these drafters
Der Artikeltext wird beim nächsten Sync nachgeladen. Original bei arXiv cs.CL lesen
Quelle: arXiv cs.CL (arXiv cs.CL). Original öffnen