Year: 2010
Type: dissertation
Abstract: Diffusion maps have been shown to model relations between points by considering the overall connectivity of the graph. This report outlines how we \ncan apply the diffusion framework to dense optical flow estimation where diffusion maps are used to embed distributions of local spatial gradients. \nWe review the problem of dense optical flow estimation and several broad types of approaches to computing accurate estimate of the flow. We then \nreview the diffusion framework and its predecessors in the manifold learning literature. Local image features are recorded by diffusion distances \ncalculated from the graph Laplacian whose kernel function depends on inter-pixel intensity differences in a certain neighbourhood. These features are \nthen used in a correlational optical flow estimation algorithm to illustrate the improvement to the dense estimate of optical flow by using a richer \ndescription of features as the elementary unit in the estimation. \n \nBy considering systems of correlation vectors from image neigbourhoods, we also increase the smoothness of the estimate. The present \nwork compares several smoothing principles, including the vector mean, vector median, marginal median which are based on both the maximum correlation \nand minimum rank of correlation vectors from the correlation matrix. \n \nA large number of very accurate estimates, spread through the image can be identified based on level of consensus with the estimates from surrounding \npixels, which we term as confidence. We use this confidence information as a basis for smoothing the motion estimate by filling regions with poor \nconfidence with estimates from neighboring high confidence regions. \n \nThe proposed methodology was applied on two distinct image sequences from the Middlebury data set, as well as a fluid motion data set. Results show \nthe robustness of our method to the different types of input data.
Author: Szymon Wartak
Language: English
Topic: Advanced Vision and Imaging
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W2132260616