Year: 2026
Type: conference-paper
Abstract: We present a proof-of-concept system for simultaneous speech translation based on dynamic attention masking.Our approach builds on Seam-lessM4T by injecting lightweight per-layer schedulers into the conformer-encoder, training each scheduler to predict the number of future frames needed for translation.The schedulers are trained jointly with LoRA adapters across three language directions: English to German, Italian, and Chinese.At inference time, we evaluate our system using sliding window retranslation inference regime (Sen et al., 2022), and an adapted version of StreamAtt (Papi et al., 2024) that replaces the fixed cutoff with a content-aware threshold derived from the learnt representations from the scheduler outputs.
Author: Benjamin Pong
Institution: University of Washington
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
OpenAlex ID: W7166838643
FWCI:
Cites:
Cited by:
Related to: