R. D. Cook and L. Forzani's contribution to the Discussion of ‘On optimal linear prediction’ by I. Helland
Year: 2025
Type: article
Abstract: We congratulate Inge on his intriguing article.He has long been known for his work on PLS regression and we have followed his recent venture into quantum mechanics.Pursuing a syntheses of Statistics, PLS, and quantum mechanics is a laudable goal and we wish him future success.In this brief comment, we focus on aspects of PLS: its structure as a dimension reduction (DR) method, its operational characteristics in non-linear regressions and insights into its optimality.Notation, references, and context are the same as those used by Helland, unless stated otherwise.PLS regression is a sufficient dimension reduction (SDR) method, and thus has SIR, SAVE, PhD, …as its cousins.PLS algorithms such as NIPALS and SIMPLS perform DR and then automatically fit a linear model based on the reduced predictors.The DR step returns a moment-based estimate of a basis for 𝚺 xx (), the 𝚺 xx -envelope of ∶= span(𝜷), defined as the smallest reducing subspace of 𝚺 xx that contains .The dimension of envelope is the true number of components, m.Under the linear model, y ⟂ ⟂ x|P 𝚺 xx () x, where P (⋅) projects onto the indicated subspace.Thus, the envelope is a DR subspace.SDR methods have a long history of successful application, particularly when n ≫ p. Cook and Forzani (2024, Section 4.3.2) gave an example where PLS dominates OLS in a regression with p = 4 and n = 79.Generally, we do not associate PLS with just large p regressions, but view it as an SDR method that may be effective when p is large or small, even with p = 4.Helland expands the foundations of PLS by establishing certain optimality conditions in the context of linear regression.PLS foundations can be expanded also by considering its scope.In particular, the DR step of a PLS algorithm can be serviceable in non-linear regression, as it is in linear regression.Let E(y|x) denote the central mean subspace for the regression of y on x, defined as the intersection of all subspaces so that y ⟂ ⟂ E(y|x)|P x.Then under mild conditions,
DOI: 10.1111/sjos.70038
Authors: R. Dennis Cook, Liliana Forzani
Institutions: University of Minnesota, Universidad Nacional del Litoral
Language: English
Subfield: Statistics and Probability
Field: Mathematics
Domain: Physical Sciences
Open Access status: hybrid
Estimated APC paid: $3,500
OpenAlex ID: W4417289271