Year: 2025
Type: article
Abstract: - This project presents an intelligent, multi-functional system designed to empower and support individuals with disabilities, especially those with hearing or speech impairments. The solution integrates real-time Sign Language Detection with an AI-powered assistant to facilitate seamless communication, access to essential services, and daily digital interactions. Built using HTML, CSS, JavaScript, and machine learning techniques, this innovative platform bridges the communication gap between differently-abled users and the digital world. The system uses computer vision models to recognize sign language gestures, particularly the English alphabet, enabling users to communicate through hand signs. The recognized signs are then translated into text or voice using Text-to-Speech (TTS) modules. To extend usability, this feature is integrated into a user-friendly graphical interface that allows users to interact with the system visually and audibly. A major highlight of the project is its Jarvis-inspired voice assistant, which responds to the wake word "Hey Jarvis." Once activated, the assistant can perform various tasks such as opening websites, fetching real-time information (e.g., weather, news, etc.), and responding to queries using a smart chatbot module. The chatbot fetches accurate responses from the Google Search API to ensure up-to-date and contextually relevant answers.
DOI: 10.55041/ijsrem45854
Author: Chaitali Mane
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
SDG: Reduced inequalities
Open Access status: bronze
OpenAlex ID: W4409766105