Enhancing Communication between Speech and Hearing Impaired People
Year: 2025
Type: article
Abstract: Mute Mate is a novel video conferencing system that uses Artificial Intelligence and Real-Time communication technologies to bridge the communication gap between sign language users and verbal communicators. The system uses YOLOv11 for sign language detection, OpenAI's Whisper model for speech-to-text translation, and WebRTC for real-time lag-free video communication. It ensures seamless communication between users of different modes of communication. Large-scale testing demonstrates the system's remarkable accuracy, low latency, and effectiveness, demonstrating its potential to revolutionize accessibility and inclusivity in digital communication. This study highlights the growing prominence of artificial intelligence in assistive communication technologies and the potential of combining deep learning with real-time processing for a more inclusive future. Key Words: Sign Language Recognition, Speech-to-Text Conversion, Real-Time Communication, YOLOv11, OpenAI Whisper, WebRTC
DOI: 10.55041/ijsrem41922
Author: Amudhiniyan Amudhiniyan
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
SDG: Reduced inequalities
Open Access status: hybrid
OpenAlex ID: W4408052765