Year: 2025
Type: conference-paper
Abstract: Sign language segmentation focuses on identifying temporal boundaries within sign language videos.As compared to previous segmentation techniques that have depended on frame-level and phrase-level segmentation, our study emphasizes on subtitle-level segmentation, using synchronized subtitle data to facilitate temporal boundary recognition.Based on Beginning-Inside-Outside (BIO) tagging for subtitle unit delineation, we train a sequenceto-sequence (Seq2Seq) model with and without attention for subtitle boundary identification.Training on optical flow data and aligned subtitles from BOBSL and YouTube-ASL, we show that the Seq2Seq model with attention outperforms baseline models, achieving improved percentage of segments, F1 and IoU score.An additional contribution is the development of a method for subtitle temporal resolution, which automates the generation of time-stamped SubRip Subtitle (.srt) files.
Authors: Kavu Maithri Rao, Yasser Hamidullah, Eleftherios Avramidis
Institution: German Research Centre for Artificial Intelligence
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
Open Access status: hybrid
Award: G4027486869
OpenAlex ID: W4412889382