Simultaneous Color Registration and Depth Completion of Point Clouds with Curriculum Learning
Year: 2025
Type: article
Abstract: Dense depth completion is critical for 3D computer vision but remains challenging when depth data are sparse and misaligned with color images due to sensor offsets. We propose a fully convolutional neural network architecture that simultaneously performs depth completion and color image registration, effectively addressing the problem of sparse depth maps and misaligned RGB inputs. Our model is trained with a novel synthetic depth generation strategy that mimics real time-of-flight (ToF) sensor noise and occlusion artifacts, helping to bridge the simulation-to-real gap. In addition, we adopt a staged curriculum learning paradigm that progressively increases task complexity over three training phases, from easy alignment scenarios to full-depth completion with simulated sensor noise. By leveraging shared features between the depth and color tasks, the joint model outperforms separate single-task approaches. At the KITTI Depth Completion benchmark, the proposed approach achieves competitive accuracy while using significantly fewer parameters and achieving faster inference than existing methods, demonstrating its effectiveness and efficiency.
Source: Sensors
DOI: 10.3390/s25113328
Authors: Juan Camilo Martinez, Ana María Montes, Cesar Marín, David Álvarez-Martínez
Institution: Universidad de Los Andes
Language: English
Topic: Advanced Vision and Imaging
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
Estimated APC paid: $3,137
OpenAlex ID: W4410754652