Year: 2026
Type: article
Abstract: Indonesian Sign Language (BISINDO) is the primary language of the Deaf community in Indonesia; however, access to BISINDO learning remains limited, particularly in North Sulawesi. This research develops an interactive web-based BISINDO learning application, BISINDO.app, providing real-time feedback on users' sign gestures via webcam. The system uses MediaPipe Hand Landmarker to extract 21 hand landmarks, classified using low-parameter deep learning models: a one-dimensional Convolutional Neural Network (Conv1D) for static gestures and a Bidirectional Long Short-Term Memory (BiLSTM) network for dynamic gestures. All inference runs client-side via TensorFlow.js, so the application requires no additional installation. The application uses React, Node.js/Express, and SQLite, secured with JSON Web Token (JWT) authentication, with content validated together with North Sulawesi's Indonesian Sign Language Center (PUSBISINDO). Training results show accuracies on the validation set (not yet evaluated on an independent test set) of 97.64% (alphabet, 26 classes), 98.01% (static numbers, 11 classes), 87.69% (dynamic numbers, 10 classes), and 99.26% (basic words, 17 classes), with model weights ranging from 165 KB to 650 KB; evaluation on an independent test set is left for future work. A prediction stabilization algorithm using a 0.8 confidence threshold, three-tick consistency, and Exponential Moving Average smoothing produces stable, responsive feedback. Functional testing across 14 scenarios confirms all features work as specified, and a usability evaluation with 13 respondents yielded an average SUS score of 83.19 (Excellent). The main contribution of this research is the integration of real-time client-side gesture recognition with an interactive feedback mechanism within a single web-based BISINDO learning platform. This research is expected to improve BISINDO learning accessibility and support the Deaf community's social inclusion in Indonesia.
Institution: Politeknik Negeri Manado
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
SDG: Quality education
Open Access status: diamond
OpenAlex ID: W7217939700
