Emergency Sound Recognition and Direction Indication Using Machine Learning for Individuals with Hearing Loss
Year: 2025
Type: article
Abstract: Sound is a vital means of expression and communication. However, individuals with hearing loss face considerable challenges, particularly in emergency situations. During such events, alerts and critical information are typically conveyed through sirens or verbal commands, which are ineffective for those with hearing loss. To overcome this limitation, an attachable or wearable assistive device is necessary. The proposed wearable system in this work consists of (i) microphone arrays embedded in a headband, and (ii) a wristband with a motor vibrator and display attached to it. The neural network algorithm, specifically the multi-layer perceptron model, is used for selective emergency sound (dog bark, car honk and siren) recognition and classification. Once an emergency sound is detected by the microphone arrays and classified by the algorithm, a vibration signal is transmitted to the motor, while the direction of the sound is simultaneously indicated on the wristband display. The trained model and real-time implementation achieved an accuracy of 90% and 77%, respectively.
Source: Jurnal Kejuruteraan
Authors: Sin Jin Tan, Vern Yee Lim, Texas Instruments Electronics Malaysia, Free Trade Zone, Batu Berendam, Taman Perindustrian Batu Berendam, 75350 Melaka, Malaysia, Huang Shen Chua, Salina Mohmad, Kim Boon Lau
Language: English
Topic: Speech and Audio Processing
Subfield: Signal Processing
Field: Computer Science
Domain: Physical Sciences
Open Access status: diamond
Funder: University of Wollongong
OpenAlex ID: W4414525962