Taming VR Teleoperation and Learning from Demonstration for Multi-Task Bimanual Table Service Manipulation
Year: 2025
Type: preprint
Abstract: This technical report presents the champion solution of the Table Service Track in the ICRA 2025 What Bimanuals Can Do (WBCD) competition. We tackled a series of demanding tasks under strict requirements for speed, precision, and reliability: unfolding a tablecloth (deformable-object manipulation), placing a pizza into the container (pick-and-place), and opening and closing a food container with the lid. Our solution combines VR-based teleoperation and Learning from Demonstrations (LfD) to balance robustness and autonomy. Most subtasks were executed through high-fidelity remote teleoperation, while the pizza placement was handled by an ACT-based policy trained from 100 in-person teleoperated demonstrations with randomized initial configurations. By carefully integrating scoring rules, task characteristics, and current technical capabilities, our approach achieved both high efficiency and reliability, ultimately securing the first place in the competition.
Source: arXiv (Cornell University)
Authors: Li, Weize, Han, Zhengxiao, Xu, Lixin, Chen, Xiangyu, Bounds, Harrison, Zhang, Chenrui, Xu, Yifan
Language: English
Subfield: Control and Systems Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W4416050133
Cites:
Cited by:
Related to: