Work

Effect of Data Augmentation with Multi-View Perspectives of Signers on the DGS-Fabeln-1 Dataset

Year: 2026

Type: conference-paper

Abstract: Sign languages constitute the principal form of communication for deaf communities across the globe.Nevertheless, the development of reliable Continuous Sign Language Translation (CSLT) systems is constrained by the lack of sufficient data and models able to handle spatio-temporal information.In this article, we explore the effect of adding multiview perspectives of the signer to the training set as data augmentation using the UniSign framework for the DGS-Fabeln-1 dataset.Our results reveal that increasing dataset size and using multiple camera perspectives significantly improve performance, with the best configurations achieving BLEU-4 scores of 4.20%.These results provide a competitive baseline for the DGS-Fabeln-1 dataset and guidance for further optimizations of CSLT systems.

Source: Language Resources and Evaluation Conference (LREC)

DOI: 10.63317/2zrdptjrx3pa

Authors: Fabian Renner, Daksitha Withanage Don, Elisabeth Andre, Cristina Luna Jimenez

Institution: University of Augsburg

Language: English

Topic: Hand Gesture Recognition Systems

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funder: Bayerische Forschungsstiftung

OpenAlex ID: W7166592746