Year: 2023
Type: conference-paper
Abstract: The intimate entanglement between objects affordances and human poses is of large interest, among others, for behavioural sciences, cognitive psychology, and Computer Vision communities. In recent years, the latter has developed several object-centric approaches: starting from items, learning pipelines synthesizing human poses and dynamics in a realistic way, satisfying both geometrical and functional expectations. However, the inverse perspective is significantly less explored: Can we infer 3D objects and their poses from human interactions alone? Our investigation follows this direction, showing that a generic 3D human point cloud is enough to pop up an unobserved object, even when the user is just imitating a functionality (e.g., looking through a binocular) without involving a tangible counterpart. We validate our method qualitatively and quantitatively, with synthetic data and sequences acquired for the task, showing applicability for XR/VR.
Authors: Ilya A. Petrov, Riccardo Marin, Julian Chibane, Gerard Pons-Moll
Institutions: University of Tübingen, Max Planck Institute for Informatics
Language: English
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
Funders: Alexander von Humboldt-Stiftung, International Max Planck Research School for Environmental, Cellular and Molecular Microbiology, Deutsche Forschungsgemeinschaft, Bundesministerium für Bildung und Forschung, International Max Planck Research School for Advanced Methods in Process and Systems Engineering
OpenAlex ID: W4386065366
