Work

Theater of Future Puppetry: An Immersive Puppeteering Experience Based on Hands Tracking and Gestures Recognition

Year: 2024

Type: conference-paper

Abstract: There are many studies on hand tracking and interaction with virtual puppets in the immersive experience.This research presents an advanced gesture recognition system called Theater of Future Puppetry.Unlike systems that only use hand tracking and hand skeleton manipulation of puppets, this system can recognize specific gestures used in traditional Budaixi (Taiwanese glove puppetry) and interact with them.The gestures were designed based on discussions with traditional Budaixi masters.Through this system, users can learn and understand the knowledge and cultural background of Budaixi puppet manipulation.

Source: SIGGRAPH Asia XR

DOI: 10.1145/3681759.3688909

Authors: Wei-Chen Yen, Jen-Kai Liu, Jia-Jiu Peng, Hsiao-Yu Luo, Ping-Hsuan Han, Chun-Cheng Hsu

Institutions: National Yang Ming Chiao Tung University, National Taipei University of Technology, Harvard University

Language: English

Topic: Hand Gesture Recognition Systems

Subfield: Human-Computer Interaction

Field: Computer Science

Domain: Physical Sciences

Open Access status: bronze

Funders: National Science and Technology Council, National Science and Technology Council

Award: G8484647193