Hidden Variables Behind Real-Robot Data Quality: Lessons from Hundreds of Thousands of Hours
Year: 2026
Type: preprint
Abstract: As real-robot data collection scales, collection-system design shapes both operator efficiency and the behaviors learned by robot policies. Workspace limitations, control-interface friction, and latency can introduce pauses, detours, and corrective motions into otherwise successful demonstrations. We investigate these effects across embodiment, teleoperation control, and data consistency, combining a kinematic study of 25 dual-arm robots, controlled teleoperation experiments, and real-robot evaluation of fine-tuned $π_{0.5}$ policies. The embodiment study shows that positional reachability overstates orientation-aware task coverage and that modest shoulder motion can substantially expand the effective workspace. Teleoperation experiments show that parallelizing body-part control reduces task completion time by 43-53%, while compliant control improves success and reduces peak contact forces on constrained and contact-rich tasks. Policy-learning experiments show that demonstrations must capture the visual information underlying action choices: active-search demonstrations improve arm-selection accuracy from chance (50%) to 100%. Calibration experiments reveal that mixed-calibration training data remain usable in our tested configurations when an inference-aligned subset is retained, whereas inference-time miscalibration causes all 30 trials to fail. Policies also retain approximately 90% of the extra path length in detour-contaminated demonstrations, showing how inefficient operator motions persist in learned behavior. Together, these findings connect collection-system design to demonstration quality and downstream policy execution. They motivate evaluating effective workspace, control efficiency, observation completeness, calibration alignment, and motion quality before scaling collection, and addressing system-induced compensations at their source.
Source: arXiv (Cornell University)
Authors: World Manipulation Team, Calvin, Che Tsang, Chen, Xingyu, Jiang, Bowen, Gao, Naixiang, Cai, Xiongfeng, Gu, Enlin, Li, Ruiying, Li, Peize, Zhu, Mianrui, Zhang, Haomiao, He, Xin, Yu, Minhui, Zhao, Jun, Zhu, Zihao, Chen, Yang, Jin, Jingmei, Zhou, Keru, Wang, Chen, Zhou, Chang, Hou, Zhiwen, Yang, Di, Sun, Wenjun, Yang, Fan, Zhang, Liyan, Lu, Yi, Ma, Haojun, Zhu, Jun, Zha, Pengxin, Wang, Zhaosheng, Zhao, Xin, He, Xindong, Liu, Chiming, Song, Jianheng, Ma, Jiayao, Yao, Maoqing, Ren, Guanghui, Wang, Qian, Shan, Wei, Yang, Yang, Liu, Li, Wang, Wenhao
Language: English
Subfield: Control and Systems Engineering
Field: Engineering
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7236372352
