2026-09-27 · America/Los_Angeles · 论文 · #20

Attention-Based Adaptive Policies for Simultaneous Speech-to-Text Translation

Simultaneous speech-to-text translation (Simul-S2TT) consists of generating partial translations while the incoming audio frames are processed by the system. However, the streaming nature of this setup creates the challenge of deciding the best moment to perform an accurate translation while minimizing the delay. To address this challenge, we utilize the cross-attention mechanism of the encoder-decoder architecture to find the right alignment between the input speech frames and the target text tokens. In this paper, we propose the Recent Frame Attention Policy (RFAP) and the Dual-Condition…

热度 12.6 / 100；排名与评分保留该期记录。