Year: 2025
Type: conference-paper
Abstract: Non-autoregressive transformers (NATs) predict entire sequences in parallel to reduce decoding latency, but they often encounter performance challenges due to the multi-modality problem.A recent advancement, the Directed Acyclic Transformer (DAT), addresses this issue by capturing multiple translation modalities to paths in a Directed Acyclic Graph (DAG).However, the collaboration with the latent variable introduced through the Glancing training (GLAT) is crucial for DAT to attain state-ofthe-art performance.In this paper, we introduce Diffusion Directed Acyclic Transformer (Diff-DAT), which serves as an alternative to GLAT as a latent variable introduction for DAT.Diff-DAT offers two significant benefits over the previous approach.Firstly, it establishes a stronger alignment between training and inference.Secondly, it facilitates a more flexible tradeoff between quality and latency.
Institution: VNU University of Engineering and Technology
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W4412889477