Exact Risk Profiles for Data Selection in Least-Squares Regression
Year: 2026
Type: preprint
Abstract: We study the worst-case loss incurred when a minimum-norm least-squares learner is trained on a prescribed number of selected examples, with repetitions allowed. A bounded-support reduction and a polynomial characterization of minimum-norm regression yield a terminating exact algorithm for every fixed dimension and budget, in both weighted and unweighted models; every finite value is real algebraic. The unweighted regression profile equals infinity below the input dimension and one plus that dimension at every budget at least as large. For mean estimation we determine the planar profile at every budget, prove the exact two-point value 4/3 in dimension three, and obtain the three-point values 11/9 and 26/21 in dimensions six and seven. Complete analytic arguments and rational computational certificates are included.
Author: Zheng, Zhijie
Institution: Peking University
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7235930440
