Improved Multimodal Integration with Attention for Live Nepali Sign Language Interpretation
Year: 2025
Type: conference-paper
Abstract: This work introduces a framework for attention-based multimodal integration in real-time Nepali Sign Language (NSL) interpretation by combining hand landmarks, face details, and pose information. I have fine-tuned on frame series from five NSL gestures; as a result, the system attains 97.39% validation precision and 31.18 FPS on a GPU. Experiments reveal 83.48% precision in five-epoch scratch training and 46.96% absent ImageNet initialization. The codebase is shared openly to promote NSL inclusivity.
Author: Pandey, Ashish
Institutions: Khwopa College of Engineering, Khwopa Engineering College
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7093318688
FWCI:
Cites:
Cited by:
Related to: