Work

Photoconsistent and Trajectory Guided Novel-View Synthesis Tool for UAV Cinematography Based on Autoregressive Transformers

Year: 2024

Type: conference-paper

Abstract: Novel view synthesis is the task of generating new images that render an object or scene from a different viewpoint than the one given. It aims to create new views of a specific subject starting from a number of pictures taken from a known points of view. The novel view synthesis problem can be approached in two different ways: as a problem of interpolation of images between two known images or extrapolation of images from one or a subset of images. During this work, the problem of the extrapolation will be addressed. Taking advantage of the fact that it is possible to pre-calculate the trajectories that we want the camera that takes the images to execute, from a series of known shot-types. Based on that and on the Autoregressive Transformers, it is presented a end-to-end tool for novel-view synthesis from previously unvisited points of view for aerial cinematography robots.

Source: IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

DOI: 10.1109/mlsp58920.2024.10734750

Authors: Marco A. Montes-Grova, Vasileios Mygdalis, Francisco J. Pérez-Grau, Antidio Viguria, Ioannis Pitas

Institutions: Center for Advanced Aerospace Technologies, Aristotle University of Thessaloniki

Language: English

Topic: Advanced Vision and Imaging

Subfield: Computer Vision and Pattern Recognition

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: European Commission

Award: A European Excellence Centre for Media, Society and Democracy