Year: 2025
Type: article
Abstract: Sign language is a vital form of communication for individuals with hearing and speech impairments, yet it remains incomprehensible to the general population, creating a significant communication barrier. This project aims to develop a highly accurate and efficient sign language recognition system using deep learning techniques, specifically Convolutional Neural Networks (CNNs) and transfer learning with VGG16, to interpret Indian Sign Language (ISL). The system translates these gestures into readable text by recognizing static hand gestures representing alphabets and numerals in ISL, enabling seamless communication between sign language users and the general population. The proposed system addresses the limitations of traditional glove-based recognition systems, offering a vision-based method that enhances accuracy and usability. The project focuses on preprocessing noisy datasets, applying thresholding techniques for segmentation, and using CNN and VGG16 to train and classify hand gestures. The expected outcomes include high accuracy rates for gesture recognition, real-time performance, and a user-friendly interface, significantly improving communication for individuals with hearing impairments.
Institution: Savitribai Phule Pune University
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
SDG: Reduced inequalities
Open Access status: diamond
OpenAlex ID: W4409410817