Work

Unsupervised pose adaptation based 3D face reconstruction algorithm

Year: 2024

Type: conference-paper

Abstract: We propose an unsupervised learning method to accurately reconstruct 3D shapes from single-view images without relying on externally supervised signals or a priori shape models. Our innovative approach generates new images and depth maps of different angles by performing pose transformations on top of existing data, with a particular focus on image reconstruction in extreme poses. By using these newly generated images and depth maps as training samples, we re-input the model and optimize it using the generated predictive depth maps. Experimental results show that the proposed method has excellent performance in the task of 3D reconstruction of faces from single-view images, especially in extreme poses, which is significantly better than traditional methods.

Source: International Conference on E-Business, Information Management and Computer Science (EBIMCS)

DOI: 10.1145/3723420.3723435

Authors: Sifan Cao, Xiaodong Li, Zhengsheng Yu

Institution: Hangzhou Dianzi University

Language: English

Topic: Face recognition and analysis

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funders: National Natural Science Foundation of China, Natural Science Foundation of Zhejiang Province

Awards: G5724995688, 面向复杂数据基于核迁移学习的算法研究