Work

LaboSignes: an Interactive French Sign Language Recognition Interface

Year: 2026

Type: conference-paper

Abstract: This article presents the design, implementation and evaluation of LaboSignes, a web-based interface for interactive French Sign Language (LSF) recognition, designed to enable search-by-sign for Deaf users. We iteratively designed a gesture-based recording interface, and integrated a lightweight Transformer model enabling low-latency recognition. We evaluated three recording interfaces (gesture-based, posture-based, and button) through a user study with 16 LSF signers. Participants preferred the gesture-based interface, despite comparable recognition accuracy across variants. The study also brings insights into sources of errors, with participants emphasizing the need to accommodate regional sign variations to support linguistic diversity in SL technology design.

Source: Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA)

DOI: 10.1145/3772363.3799328

Authors: Jules Françoise, Julie Lascar, Cyril Verrechia, Sidonie Minodier, Michèle Gouiffès, Annelies Braffort

Institutions: Centre National de la Recherche Scientifique, Université Paris-Saclay, Laboratoire Interdisciplinaire des Sciences du Numérique

Language: English

Topic: Hand Gesture Recognition Systems

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funders: Agence Nationale de la Recherche, Grand Équipement National De Calcul Intensif

Awards: Multimodal Video-text Analysis for Gesture Understanding, G3896540913