Work

A Unified Approach to PCA, PLS, MLR and CCA

Year: 1997
Type: report
Abstract: This paper presents a novel algorithm for analysis of stochastic processes. The algorithm can be used to find the required solutions in the cases of principal component analysis (PCA), partial least squares (PLS), canonical correlation analysis (CCA) or multiple linear regression (MLR). The algorithm is iterative and sequential in its structure and uses on-line stochastic approximation to reach an equilibrium point. A quotient between two quadratic forms is used as an energy function and it is shown that the equilibrium points constitute solutions to the generalized eigenproblem. Keywords: Generalized eigenproblem, stochastic approximation, on-line algorithm, system learning, self-adaptation, principal components, partial least squares, canonical correlation, linear regression, reduced rank, mutual information, independent components. 1 Introduction The ability to perform dimensionality reduction is crucial to systems exposed to high dimensional data e.g. images, image sequences [10]...
Language: English
Open Access status: green
OpenAlex ID: W1808935448
Cites: 21
Cited by: 75
Related to: 10