Next-gen interaction experience using virtual mouse system
Year: 2025
Type: article
Abstract: The Virtual Mouse System is an innovative, touch-free control mechanism that replaces traditional computer mice using computer vision and artificial intelligence (AI). With a standard camera or webcam, it interprets hand, head, and eye gestures to perform actions like cursor movement, clicking, and scrolling. Designed for both general users and individuals with physical disabilities, it provides an intuitive, accessible, and futuristic interaction method. Key technologies like OpenCV and AI enable real- time gesture recognition, making it suitable for applications in accessibility, gaming, and education. This system eliminates physical devices, offering convenience and a modern dimension to human-computer interaction. This project focuses on developing a Virtual Mouse System using Python, MediaPipe, and PyAutoGUI, enabling users to control a computer cursor with simple hand gestures. The system leverages MediaPipe’s Hand Tracking API to detect hand landmarks and recognize specific gestures, which are then mapped to mouse actions such as cursor movement, clicking, dragging, and scrolling.
Authors: Pokanati, Naga Sesha Lakshmi, Alla, Satvik Reddy, Pampana, Sai Raja Pradeep, Mohammad, Ashan, Sakala, Swamy, Sai Chintam, Veera Venkata Naga Surya Devi
Institution: Aditya University
Language: English
Subfield: Human-Computer Interaction
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7081660102
FWCI:
Cites:
Cited by:
Related to: