Work

Leveraging Computer Vision and Natural Language Processing for Object Detection and Localization

Year: 2025

Type: article

Abstract: This paper presents a novel approach leveraging the integration of Computer Vision, Natural Language Processing (NLP), and Speech Recognition technologies to create an AI-powered system capable of detecting and locating objects through voice commands. The system developed using Flask, OpenCV, spaCy, and Blip VQA Model, aims to assist caregivers, visually impaired individuals, and the elderly in various daily tasks, such as locating items in the home and checking for potential hazards like leaving the stove on. We also provide the code used for this project1.

Source: Operations Research and Applications An International Journal

DOI: 10.5121/oraj.2025.12101

Authors: B Rahmani, S Bhavanasi, A Maazallahi, HS Korapala, JLS Yenugu, YK Bhatia, MA Salari, E Snir, P Norouzzadeh, J Fritts

Institutions: Saint Louis University, University of Tehran, Washington University in St. Louis

Language: English

Topic: Multimodal Machine Learning Applications

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: diamond

OpenAlex ID: W4411347646

FWCI:

Cites:

Cited by:

Related to: 10