Work

I see what you do: The HumAct algorithm for live human action recognition and applications

Year: 2025

Type: conference-paper

Abstract: Realtime human action recognition from video streams is becoming increasingly essential for applications that require immediate interpretation of human behavior. This includes scenarios such as interactive virtual environments and responsive healthcare systems. This paper presents HumAct, a novel algorithm developed for live human action recognition. It reliably detects a broad range of human actions, even within diverse and challenging video content. The algorithm achieves realtime performance, identifying actions for multiple persons in the scene with a delay of only two seconds from their occurrence in a video live stream. We demonstrate the practical effectiveness of the HumAct algorithm through two applications: enhancing intuitive interaction in VR/XR environments and delivering timely alerts for falling elderly persons in an ambient assisted living setting. Together, these examples highlight the flexibility and strong potential of our proposed live human action recognition algorithm for real-world deployment.

Source: Zenodo (CERN European Organization for Nuclear Research)

DOI: 10.5281/zenodo.17241679

Author: Fassold, Hannes

Institution: Joanneum Research

Language: English

Topic: Human Pose and Action Recognition

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: European Commission

Award: A toolset for hyper-realistic and XR-based human-human and human-machine interactions