Work

Exploring Vision Language Models for Egocentric Action Localization

Year: 2026

Type: article

Abstract: Context-aware systems can support humans at work by automatically performing quality control, providing assistance, or generating instructions and documentation for latter use. However, the adaptation of such intelligent systems to custom use cases demands training data, expertise, and effort. With the dissemination of Vision Language Models (VLMs), recognition capabilities are becoming more accessible. We explore the use of readily available VLMs for understanding egocentric video footage of common manual tasks in production environments. Results demonstrate the feasibility of using VLMs in such contexts.

Source: OJS

DOI: 10.60643/urai.v2025p23

Authors: Knoben, Valentin, Kramme, Julia, Hein, Björn, Wurll, Christian

Institutions: Karlsruhe Institute of Technology, Karlsruhe University of Applied Sciences

Language: English

Topic: Multimodal Machine Learning Applications

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

OpenAlex ID: W7141162102

FWCI:

Cites:

Cited by:

Related to: